2024-05-24T22:54:59.877382723Z ..... 2024-05-24T22:55:00.481346193Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-24T22:55:01.935521307Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-24T22:55:06.042307968Z [2024-05-24T22:55:06.041+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-05-24T22:55:19.379638736Z 2024-05-24T22:55:20.083298138Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-24T22:55:21.107221181Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-24T22:55:26.208327893Z ____________ _____________ 2024-05-24T22:55:26.208344900Z ____ |__( )_________ __/__ /________ __ 2024-05-24T22:55:26.208348626Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-05-24T22:55:26.208352204Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-05-24T22:55:26.208355749Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-05-24T22:55:26.208359573Z [2024-05-24T22:55:26.206+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-05-24T22:55:26.214934944Z [2024-05-24T22:55:26.208+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-05-24T22:55:26.895177621Z [2024-05-24T22:55:26.894+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-05-24T22:55:26.929985519Z [2024-05-24T22:55:26.906+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 15 2024-05-24T22:55:26.932734960Z [2024-05-24T22:55:26.932+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T22:55:26.961021422Z [2024-05-24T22:55:26.951+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-05-24T22:55:26.968091726Z [2024-05-24T22:55:26.967+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-05-24T22:56:29.366120563Z [2024-05-24T22:56:29.365+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T22:56:29.413332317Z [2024-05-24T22:56:29.412+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T22:56:29.413352002Z 2024-05-24T22:56:29.413660218Z [2024-05-24T22:56:29.413+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T22:56:29.414256752Z [2024-05-24T22:56:29.414+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T22:56:29.414268059Z 2024-05-24T22:56:29.417860023Z [2024-05-24T22:56:29.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T22:56:29.418511203Z [2024-05-24T22:56:29.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T22:56:29.706641179Z [2024-05-24T22:56:29.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T22:54:00+00:00 exited with status queued for try_number 1 2024-05-24T22:56:29.726985835Z [2024-05-24T22:56:29.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 613e61da-444e-4f13-b463-bf9c299fb3f0 2024-05-24T22:57:02.117974088Z [2024-05-24T22:57:02.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T22:54:00+00:00 exited with status success for try_number 1 2024-05-24T22:57:02.126280829Z [2024-05-24T22:57:02.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T22:54:00+00:00, map_index=-1, run_start_date=2024-05-24 22:56:30.561193+00:00, run_end_date=2024-05-24 22:57:00.965484+00:00, run_duration=30.404291, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 22:56:29.414758+00:00, queued_by_job_id=1, pid=50 2024-05-24T22:57:11.178639261Z [2024-05-24T22:57:11.178+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T22:57:11.178682618Z 2024-05-24T22:57:11.179054061Z [2024-05-24T22:57:11.178+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T22:57:11.180081579Z [2024-05-24T22:57:11.179+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T22:57:11.180107191Z 2024-05-24T22:57:11.183672206Z [2024-05-24T22:57:11.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T22:54:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T22:57:11.184148829Z [2024-05-24T22:57:11.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T22:57:11.230858229Z [2024-05-24T22:57:11.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T22:54:00+00:00 exited with status queued for try_number 2 2024-05-24T22:57:11.236947246Z [2024-05-24T22:57:11.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7106c08c-fbeb-469f-b112-d66952bf2f18 2024-05-24T22:57:21.714878213Z [2024-05-24T22:57:21.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T22:57:21.729420399Z [2024-05-24T22:57:21.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 22:54:00+00:00, run_id=scheduled__2024-05-24T22:54:00+00:00, run_start_date=2024-05-24 22:56:29.375628+00:00, run_end_date=2024-05-24 22:57:21.714864+00:00, run_duration=52.339236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 22:54:00+00:00, data_interval_end=2024-05-24 22:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T22:57:21.750477246Z [2024-05-24T22:57:21.749+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T22:56:00+00:00, run_after=2024-05-24T22:58:00+00:00 2024-05-24T22:57:21.864195474Z [2024-05-24T22:57:21.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T22:54:00+00:00 exited with status success for try_number 2 2024-05-24T22:57:21.894974495Z [2024-05-24T22:57:21.894+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T22:54:00+00:00, map_index=-1, run_start_date=2024-05-24 22:57:11.829562+00:00, run_end_date=2024-05-24 22:57:20.329923+00:00, run_duration=8.500361, state=success, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 22:57:11.180710+00:00, queued_by_job_id=1, pid=68 2024-05-24T22:58:00.108124663Z [2024-05-24T22:58:00.107+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T22:58:00.149851564Z [2024-05-24T22:58:00.149+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T22:58:00.149865516Z 2024-05-24T22:58:00.150256935Z [2024-05-24T22:58:00.149+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T22:58:00.150779521Z [2024-05-24T22:58:00.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T22:58:00.150788104Z 2024-05-24T22:58:00.153393900Z [2024-05-24T22:58:00.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T22:58:00.153597793Z [2024-05-24T22:58:00.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T22:58:00.223456231Z [2024-05-24T22:58:00.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T22:56:00+00:00 exited with status queued for try_number 1 2024-05-24T22:58:00.229087929Z [2024-05-24T22:58:00.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ea46060-2418-42b1-805a-c782332245b2 2024-05-24T22:58:02.453394445Z [2024-05-24T22:58:02.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T22:58:02.453617757Z [2024-05-24T22:58:02.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 22:56:00+00:00, run_id=scheduled__2024-05-24T22:56:00+00:00, run_start_date=2024-05-24 22:58:00.118940+00:00, run_end_date=2024-05-24 22:58:02.453348+00:00, run_duration=2.334408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 22:56:00+00:00, data_interval_end=2024-05-24 22:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T22:58:02.461127266Z [2024-05-24T22:58:02.460+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T22:58:00+00:00, run_after=2024-05-24T23:00:00+00:00 2024-05-24T22:58:02.499187953Z [2024-05-24T22:58:02.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T22:56:00+00:00 exited with status success for try_number 1 2024-05-24T22:58:02.504495326Z [2024-05-24T22:58:02.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T22:56:00+00:00, map_index=-1, run_start_date=2024-05-24 22:58:00.980095+00:00, run_end_date=2024-05-24 22:58:01.417956+00:00, run_duration=0.437861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 22:58:00.151048+00:00, queued_by_job_id=1, pid=75 2024-05-24T23:00:01.056758059Z [2024-05-24T23:00:01.056+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:00:01.094217360Z [2024-05-24T23:00:01.093+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:00:01.094233773Z 2024-05-24T23:00:01.094368458Z [2024-05-24T23:00:01.094+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:00:01.095066631Z [2024-05-24T23:00:01.094+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:00:01.095075876Z 2024-05-24T23:00:01.097183702Z [2024-05-24T23:00:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:00:01.097394178Z [2024-05-24T23:00:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:00:01.176609667Z [2024-05-24T23:00:01.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T22:58:00+00:00 exited with status queued for try_number 1 2024-05-24T23:00:01.184006928Z [2024-05-24T23:00:01.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11596b86-ae6d-4dea-bfdc-3a10e366a5cb 2024-05-24T23:00:02.952258466Z [2024-05-24T23:00:02.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:00:02.952980747Z [2024-05-24T23:00:02.952+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 22:58:00+00:00, run_id=scheduled__2024-05-24T22:58:00+00:00, run_start_date=2024-05-24 23:00:01.065934+00:00, run_end_date=2024-05-24 23:00:02.952188+00:00, run_duration=1.886254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 22:58:00+00:00, data_interval_end=2024-05-24 23:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:00:02.966725267Z [2024-05-24T23:00:02.966+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:00:00+00:00, run_after=2024-05-24T23:02:00+00:00 2024-05-24T23:00:03.005079309Z [2024-05-24T23:00:03.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T22:58:00+00:00 exited with status success for try_number 1 2024-05-24T23:00:03.014264053Z [2024-05-24T23:00:03.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T22:58:00+00:00, map_index=-1, run_start_date=2024-05-24 23:00:01.842915+00:00, run_end_date=2024-05-24 23:00:02.212767+00:00, run_duration=0.369852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:00:01.095317+00:00, queued_by_job_id=1, pid=108 2024-05-24T23:00:27.146689045Z [2024-05-24T23:00:27.146+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T23:02:00.705781046Z [2024-05-24T23:02:00.704+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:02:00.750095533Z [2024-05-24T23:02:00.749+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:02:00.750106769Z 2024-05-24T23:02:00.750242628Z [2024-05-24T23:02:00.750+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:02:00.750881446Z [2024-05-24T23:02:00.750+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:02:00.750888658Z 2024-05-24T23:02:00.752746270Z [2024-05-24T23:02:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:02:00.752880585Z [2024-05-24T23:02:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:02:00.813702453Z [2024-05-24T23:02:00.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status queued for try_number 1 2024-05-24T23:02:00.819479227Z [2024-05-24T23:02:00.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to af9692c7-c926-4ae9-b8e4-46ea3feabe30 2024-05-24T23:02:01.939232159Z [2024-05-24T23:02:01.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:02:01.939415237Z [2024-05-24T23:02:01.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:00:00+00:00, run_id=scheduled__2024-05-24T23:00:00+00:00, run_start_date=2024-05-24 23:02:00.720449+00:00, run_end_date=2024-05-24 23:02:01.939140+00:00, run_duration=1.218691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:00:00+00:00, data_interval_end=2024-05-24 23:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:02:01.947815260Z [2024-05-24T23:02:01.947+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:02:00+00:00, run_after=2024-05-24T23:04:00+00:00 2024-05-24T23:02:03.061316730Z [2024-05-24T23:02:03.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status success for try_number 1 2024-05-24T23:02:03.068836103Z [2024-05-24T23:02:03.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:00:00+00:00, map_index=-1, run_start_date=2024-05-24 23:02:01.549787+00:00, run_end_date=2024-05-24 23:02:01.886781+00:00, run_duration=0.336994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:02:00.751093+00:00, queued_by_job_id=1, pid=141 2024-05-24T23:03:57.318159484Z [2024-05-24T23:03:57.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:03:00+00:00, run_after=2024-05-24T23:04:00+00:00 2024-05-24T23:03:57.371741230Z [2024-05-24T23:03:57.371+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:03:57.371775364Z 2024-05-24T23:03:57.371817713Z [2024-05-24T23:03:57.371+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:03:57.372354396Z [2024-05-24T23:03:57.372+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:03:57.372362875Z 2024-05-24T23:03:57.376029141Z [2024-05-24T23:03:57.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:03:57.376213202Z [2024-05-24T23:03:57.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:03:57.459580448Z [2024-05-24T23:03:57.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:02:00+00:00 exited with status queued for try_number 1 2024-05-24T23:03:57.463797370Z [2024-05-24T23:03:57.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8f4aa47-503a-4fc9-b4a1-26f23d6f9c12 2024-05-24T23:03:57.534085845Z [2024-05-24T23:03:57.533+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:03:57.611697300Z [2024-05-24T23:03:57.611+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:03:57.611730767Z 2024-05-24T23:03:57.611838252Z [2024-05-24T23:03:57.611+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:03:57.612457762Z [2024-05-24T23:03:57.612+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:03:57.612475556Z 2024-05-24T23:03:57.614376574Z [2024-05-24T23:03:57.614+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:03:57.614514780Z [2024-05-24T23:03:57.614+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:03:57.658682653Z [2024-05-24T23:03:57.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:02:00+00:00 exited with status queued for try_number 1 2024-05-24T23:03:57.663541803Z [2024-05-24T23:03:57.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bf06932-0bfd-4368-bd23-461443b37206 2024-05-24T23:04:00.156964466Z [2024-05-24T23:04:00.156+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:04:00.168451153Z [2024-05-24T23:04:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:04:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:04:00.233826626Z [2024-05-24T23:04:00.233+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-24T23:04:00.233845226Z 2024-05-24T23:04:00.233849069Z 2024-05-24T23:04:00.233955372Z [2024-05-24T23:04:00.233+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:04:00.234150099Z [2024-05-24T23:04:00.233+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 1/16 running and queued tasks 2024-05-24T23:04:00.234665829Z [2024-05-24T23:04:00.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:04:00.234676321Z 2024-05-24T23:04:00.234686750Z 2024-05-24T23:04:00.237940733Z [2024-05-24T23:04:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:04:00.238082720Z [2024-05-24T23:04:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:04:00.238342398Z [2024-05-24T23:04:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:04:00.238549736Z [2024-05-24T23:04:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:04:00.417554353Z [2024-05-24T23:04:00.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:02:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:00.417768430Z [2024-05-24T23:04:00.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:03:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:00.429723944Z [2024-05-24T23:04:00.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to be8dc7d9-7107-4104-adf3-87ac75310c11 2024-05-24T23:04:00.430239931Z [2024-05-24T23:04:00.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40da13b1-4008-4f4e-86e8-ffbe4fe15f6f 2024-05-24T23:04:01.601111932Z [2024-05-24T23:04:01.600+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:04:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:04:01.670114868Z [2024-05-24T23:04:01.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:04:01.670434875Z [2024-05-24T23:04:01.670+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:02:00+00:00, run_id=scheduled__2024-05-24T23:02:00+00:00, run_start_date=2024-05-24 23:04:00.179413+00:00, run_end_date=2024-05-24 23:04:01.670102+00:00, run_duration=1.490689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:02:00+00:00, data_interval_end=2024-05-24 23:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:04:01.688322793Z [2024-05-24T23:04:01.688+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:04:00+00:00, run_after=2024-05-24T23:06:00+00:00 2024-05-24T23:04:01.754552211Z [2024-05-24T23:04:01.754+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:04:01.754577250Z 2024-05-24T23:04:01.756244006Z [2024-05-24T23:04:01.756+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:04:01.756853839Z [2024-05-24T23:04:01.756+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:04:01.756864068Z 2024-05-24T23:04:01.759098750Z [2024-05-24T23:04:01.758+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:04:01.759337194Z [2024-05-24T23:04:01.759+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:04:01.845227536Z [2024-05-24T23:04:01.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:03:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:01.845338005Z [2024-05-24T23:04:01.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:02:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:01.857335785Z [2024-05-24T23:04:01.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:02:00+00:00, map_index=-1, run_start_date=2024-05-24 23:04:01.109389+00:00, run_end_date=2024-05-24 23:04:01.602842+00:00, run_duration=0.493453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:00.235157+00:00, queued_by_job_id=1, pid=200 2024-05-24T23:04:01.857552458Z [2024-05-24T23:04:01.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a937598-4e2a-4781-b86d-e0e1f60c842a 2024-05-24T23:04:03.028063010Z [2024-05-24T23:04:03.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:04:03.028700327Z [2024-05-24T23:04:03.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:02:00+00:00, run_id=scheduled__2024-05-24T23:02:00+00:00, run_start_date=2024-05-24 23:03:57.578790+00:00, run_end_date=2024-05-24 23:04:03.028255+00:00, run_duration=5.449465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:02:00+00:00, data_interval_end=2024-05-24 23:03:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:04:03.043180328Z [2024-05-24T23:04:03.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:03:00+00:00, run_after=2024-05-24T23:04:00+00:00 2024-05-24T23:04:03.050055381Z [2024-05-24T23:04:03.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:04:03.050455121Z [2024-05-24T23:04:03.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:02:00+00:00, run_id=scheduled__2024-05-24T23:02:00+00:00, run_start_date=2024-05-24 23:03:57.328363+00:00, run_end_date=2024-05-24 23:04:03.050166+00:00, run_duration=5.721803, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:02:00+00:00, data_interval_end=2024-05-24 23:03:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:04:03.060963971Z [2024-05-24T23:04:03.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:03:00+00:00, run_after=2024-05-24T23:04:00+00:00 2024-05-24T23:04:03.118055786Z [2024-05-24T23:04:03.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:02:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:03.118298600Z [2024-05-24T23:04:03.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:02:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:03.126227925Z [2024-05-24T23:04:03.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:02:00+00:00, map_index=-1, run_start_date=2024-05-24 23:03:59.628717+00:00, run_end_date=2024-05-24 23:04:02.366626+00:00, run_duration=2.737909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:03:57.612828+00:00, queued_by_job_id=1, pid=187 2024-05-24T23:04:03.126650671Z [2024-05-24T23:04:03.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:02:00+00:00, map_index=-1, run_start_date=2024-05-24 23:03:59.587980+00:00, run_end_date=2024-05-24 23:04:02.045737+00:00, run_duration=2.457757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:03:57.372789+00:00, queued_by_job_id=1, pid=186 2024-05-24T23:04:04.162012973Z [2024-05-24T23:04:04.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:04:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:04:04.182643103Z [2024-05-24T23:04:04.180+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:04:04.212395831Z [2024-05-24T23:04:04.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:04:04.212803762Z [2024-05-24T23:04:04.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:03:00+00:00, run_id=scheduled__2024-05-24T23:03:00+00:00, run_start_date=2024-05-24 23:04:01.616503+00:00, run_end_date=2024-05-24 23:04:04.212244+00:00, run_duration=2.595741, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:03:00+00:00, data_interval_end=2024-05-24 23:04:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:04:04.224460572Z [2024-05-24T23:04:04.223+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:04:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:04:04.230055266Z [2024-05-24T23:04:04.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:04:04.230329999Z [2024-05-24T23:04:04.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:03:00+00:00, run_id=scheduled__2024-05-24T23:03:00+00:00, run_start_date=2024-05-24 23:04:00.179789+00:00, run_end_date=2024-05-24 23:04:04.229958+00:00, run_duration=4.050169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:03:00+00:00, data_interval_end=2024-05-24 23:04:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:04:04.239098151Z [2024-05-24T23:04:04.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:04:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:04:04.261058815Z [2024-05-24T23:04:04.260+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:04:04.261084264Z 2024-05-24T23:04:04.261509948Z [2024-05-24T23:04:04.261+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:04:04.262261137Z [2024-05-24T23:04:04.262+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:04:04.262268515Z 2024-05-24T23:04:04.264756669Z [2024-05-24T23:04:04.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:04:04.265063546Z [2024-05-24T23:04:04.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:04:04.338165489Z [2024-05-24T23:04:04.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:03:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:04.338439417Z [2024-05-24T23:04:04.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:03:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:04.338614569Z [2024-05-24T23:04:04.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:03:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:04.349122507Z [2024-05-24T23:04:04.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:03:00+00:00, map_index=-1, run_start_date=2024-05-24 23:04:02.734405+00:00, run_end_date=2024-05-24 23:04:03.186540+00:00, run_duration=0.452135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:01.757261+00:00, queued_by_job_id=1, pid=219 2024-05-24T23:04:04.349572338Z [2024-05-24T23:04:04.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba0e3281-7009-451e-a4dd-a76fd5a48217 2024-05-24T23:04:04.350700507Z [2024-05-24T23:04:04.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:03:00+00:00, map_index=-1, run_start_date=2024-05-24 23:04:02.519472+00:00, run_end_date=2024-05-24 23:04:03.948897+00:00, run_duration=1.429425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:00.235157+00:00, queued_by_job_id=1, pid=218 2024-05-24T23:04:09.976894243Z [2024-05-24T23:04:09.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:04:09.977257827Z [2024-05-24T23:04:09.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:03:00+00:00, run_id=scheduled__2024-05-24T23:03:00+00:00, run_start_date=2024-05-24 23:04:04.194491+00:00, run_end_date=2024-05-24 23:04:09.976799+00:00, run_duration=5.782308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:03:00+00:00, data_interval_end=2024-05-24 23:04:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:04:09.986421478Z [2024-05-24T23:04:09.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:04:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:04:10.041623502Z [2024-05-24T23:04:10.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:03:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:10.048184524Z [2024-05-24T23:04:10.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:03:00+00:00, map_index=-1, run_start_date=2024-05-24 23:04:05.931691+00:00, run_end_date=2024-05-24 23:04:09.280538+00:00, run_duration=3.348847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:04.262675+00:00, queued_by_job_id=1, pid=237 2024-05-24T23:04:17.761957026Z [2024-05-24T23:04:17.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:00:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:04:17.798603722Z [2024-05-24T23:04:17.798+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:04:17.798625248Z 2024-05-24T23:04:17.798705544Z [2024-05-24T23:04:17.798+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:04:17.799489291Z [2024-05-24T23:04:17.799+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:04:17.799502632Z 2024-05-24T23:04:17.801345644Z [2024-05-24T23:04:17.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:04:17.801415329Z [2024-05-24T23:04:17.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:04:17.868436862Z [2024-05-24T23:04:17.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:17.886951181Z [2024-05-24T23:04:17.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to f80977fe-9f52-4e3b-b743-d9f8e1867e4e 2024-05-24T23:04:20.123310000Z [2024-05-24T23:04:20.123+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:04:20.123332156Z 2024-05-24T23:04:20.124224578Z [2024-05-24T23:04:20.124+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:04:20.124899583Z [2024-05-24T23:04:20.124+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:04:20.124909118Z 2024-05-24T23:04:20.129771396Z [2024-05-24T23:04:20.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:04:20.129931939Z [2024-05-24T23:04:20.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:04:20.166297587Z [2024-05-24T23:04:20.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:20.166505989Z [2024-05-24T23:04:20.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:20.172614697Z [2024-05-24T23:04:20.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc93d091-99da-4445-bd7f-9cf096b63506 2024-05-24T23:04:20.172925921Z [2024-05-24T23:04:20.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T22:55:00+00:00, map_index=-1, run_start_date=2024-05-24 23:04:19.532291+00:00, run_end_date=2024-05-24 23:04:19.867421+00:00, run_duration=0.33513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:17.799739+00:00, queued_by_job_id=1, pid=263 2024-05-24T23:04:22.950428792Z [2024-05-24T23:04:22.950+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:04:22.950478069Z 2024-05-24T23:04:22.950490282Z [2024-05-24T23:04:22.950+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:04:22.951019214Z [2024-05-24T23:04:22.950+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:04:22.951042852Z 2024-05-24T23:04:22.953699095Z [2024-05-24T23:04:22.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T22:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:04:22.953731254Z [2024-05-24T23:04:22.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:04:23.063756710Z [2024-05-24T23:04:23.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:23.063924823Z [2024-05-24T23:04:23.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:23.082039512Z [2024-05-24T23:04:23.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4306a38-d8a9-46cd-a1d0-4cbd7f18902a 2024-05-24T23:04:23.082636483Z [2024-05-24T23:04:23.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T22:55:00+00:00, map_index=-1, run_start_date=2024-05-24 23:04:21.788801+00:00, run_end_date=2024-05-24 23:04:22.142969+00:00, run_duration=0.354168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:20.127112+00:00, queued_by_job_id=1, pid=276 2024-05-24T23:04:25.298268773Z [2024-05-24T23:04:25.297+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:04:25.298293405Z 2024-05-24T23:04:25.298444212Z [2024-05-24T23:04:25.298+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:04:25.299010463Z [2024-05-24T23:04:25.298+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:04:25.299021741Z 2024-05-24T23:04:25.300819451Z [2024-05-24T23:04:25.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:04:25.301024139Z [2024-05-24T23:04:25.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:04:25.348767875Z [2024-05-24T23:04:25.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:25.348926410Z [2024-05-24T23:04:25.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:25.353973004Z [2024-05-24T23:04:25.353+0000] {scheduler_job.py:635} INFO - Setting external_id for to c09f8767-5d3e-45ee-b41a-d8c0e1931693 2024-05-24T23:04:25.354246829Z [2024-05-24T23:04:25.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T22:55:00+00:00, map_index=0, run_start_date=2024-05-24 23:04:24.557432+00:00, run_end_date=2024-05-24 23:04:24.868732+00:00, run_duration=0.3113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:22.951229+00:00, queued_by_job_id=1, pid=284 2024-05-24T23:04:27.504788449Z [2024-05-24T23:04:27.504+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:04:27.504953344Z [2024-05-24T23:04:27.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 22:55:00+00:00, run_id=scheduled__2024-05-24T22:55:00+00:00, run_start_date=2024-05-24 23:04:17.770615+00:00, run_end_date=2024-05-24 23:04:27.504715+00:00, run_duration=9.7341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 22:55:00+00:00, data_interval_end=2024-05-24 23:00:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-24T23:04:27.510274761Z [2024-05-24T23:04:27.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:00:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:04:27.529359131Z [2024-05-24T23:04:27.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:27.533395703Z [2024-05-24T23:04:27.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T22:55:00+00:00, map_index=-1, run_start_date=2024-05-24 23:04:27.011368+00:00, run_end_date=2024-05-24 23:04:27.337088+00:00, run_duration=0.32572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:25.299310+00:00, queued_by_job_id=1, pid=292 2024-05-24T23:04:29.210888025Z [2024-05-24T23:04:29.210+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:04:29.224848180Z [2024-05-24T23:04:29.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:04:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:04:29.264003898Z [2024-05-24T23:04:29.263+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-24T23:04:29.264023049Z 2024-05-24T23:04:29.264026775Z 2024-05-24T23:04:29.264256188Z [2024-05-24T23:04:29.263+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:04:29.264452975Z [2024-05-24T23:04:29.264+0000] {scheduler_job.py:425} INFO - DAG vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:04:29.265070697Z [2024-05-24T23:04:29.264+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:04:29.265081742Z 2024-05-24T23:04:29.265085298Z 2024-05-24T23:04:29.267271209Z [2024-05-24T23:04:29.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:04:29.267486234Z [2024-05-24T23:04:29.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:04:29.267845814Z [2024-05-24T23:04:29.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:04:29.267891503Z [2024-05-24T23:04:29.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:04:29.446296488Z [2024-05-24T23:04:29.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:03:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:29.446330747Z [2024-05-24T23:04:29.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:03:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:29.454418435Z [2024-05-24T23:04:29.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ca91e7e-4fde-4919-8822-9804013c0ba7 2024-05-24T23:04:29.454697898Z [2024-05-24T23:04:29.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93b1e7b3-cba9-4ee2-9407-c2fe9536d308 2024-05-24T23:04:33.160468421Z [2024-05-24T23:04:33.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:04:33.160960627Z [2024-05-24T23:04:33.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, execution_date=2024-05-24 23:03:00+00:00, run_id=scheduled__2024-05-24T23:03:00+00:00, run_start_date=2024-05-24 23:04:29.232659+00:00, run_end_date=2024-05-24 23:04:33.160429+00:00, run_duration=3.92777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:03:00+00:00, data_interval_end=2024-05-24 23:04:00+00:00, dag_hash=1fdef68d39d00c1c614f2a3d271815a2 2024-05-24T23:04:33.175231485Z [2024-05-24T23:04:33.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:04:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:04:33.182961370Z [2024-05-24T23:04:33.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:04:33.183007733Z [2024-05-24T23:04:33.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0, execution_date=2024-05-24 23:03:00+00:00, run_id=scheduled__2024-05-24T23:03:00+00:00, run_start_date=2024-05-24 23:04:29.233395+00:00, run_end_date=2024-05-24 23:04:33.182742+00:00, run_duration=3.949347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:03:00+00:00, data_interval_end=2024-05-24 23:04:00+00:00, dag_hash=92b6a8e6588785685c79bd880e10d21b 2024-05-24T23:04:33.195723858Z [2024-05-24T23:04:33.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:04:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:04:33.236066396Z [2024-05-24T23:04:33.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:03:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:33.236494798Z [2024-05-24T23:04:33.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:03:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:33.243289684Z [2024-05-24T23:04:33.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:03:00+00:00, map_index=-1, run_start_date=2024-05-24 23:04:31.075828+00:00, run_end_date=2024-05-24 23:04:32.576395+00:00, run_duration=1.500567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:29.265520+00:00, queued_by_job_id=1, pid=307 2024-05-24T23:04:33.243735366Z [2024-05-24T23:04:33.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:03:00+00:00, map_index=-1, run_start_date=2024-05-24 23:04:31.084975+00:00, run_end_date=2024-05-24 23:04:32.306731+00:00, run_duration=1.221756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:29.265520+00:00, queued_by_job_id=1, pid=308 2024-05-24T23:04:49.364454355Z [2024-05-24T23:04:49.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:00:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:04:49.426095188Z [2024-05-24T23:04:49.425+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:04:49.426135552Z 2024-05-24T23:04:49.426453298Z [2024-05-24T23:04:49.426+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:04:49.427121467Z [2024-05-24T23:04:49.426+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:04:49.427134812Z 2024-05-24T23:04:49.429688679Z [2024-05-24T23:04:49.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:04:49.429802489Z [2024-05-24T23:04:49.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:04:49.489256036Z [2024-05-24T23:04:49.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:49.496477373Z [2024-05-24T23:04:49.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25a1b55a-3778-4c88-ab9f-761bdd4b9425 2024-05-24T23:04:52.375606703Z [2024-05-24T23:04:52.374+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:04:52.375634580Z 2024-05-24T23:04:52.375715164Z [2024-05-24T23:04:52.375+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:04:52.376231715Z [2024-05-24T23:04:52.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:04:52.376245662Z 2024-05-24T23:04:52.379142021Z [2024-05-24T23:04:52.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='split_metrics', run_id='scheduled__2024-05-24T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:04:52.379262074Z [2024-05-24T23:04:52.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'split_metrics', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:04:52.437151417Z [2024-05-24T23:04:52.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.split_metrics run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:52.437177031Z [2024-05-24T23:04:52.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:52.441680137Z [2024-05-24T23:04:52.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T22:55:00+00:00, map_index=-1, run_start_date=2024-05-24 23:04:50.959394+00:00, run_end_date=2024-05-24 23:04:51.272743+00:00, run_duration=0.313349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:49.427506+00:00, queued_by_job_id=1, pid=326 2024-05-24T23:04:52.441819673Z [2024-05-24T23:04:52.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3c6be5d-4a9b-4c1b-9eb0-059ba131cc0a 2024-05-24T23:04:55.746013247Z [2024-05-24T23:04:55.745+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:04:55.746041446Z 2024-05-24T23:04:55.746090069Z [2024-05-24T23:04:55.745+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:04:55.747088017Z [2024-05-24T23:04:55.746+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:04:55.747094474Z 2024-05-24T23:04:55.750609854Z [2024-05-24T23:04:55.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='collect_metrics', run_id='scheduled__2024-05-24T22:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:04:55.750654603Z [2024-05-24T23:04:55.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'collect_metrics', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:04:55.815149352Z [2024-05-24T23:04:55.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.collect_metrics run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status queued for try_number 1 2024-05-24T23:04:55.815171003Z [2024-05-24T23:04:55.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.split_metrics run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status success for try_number 1 2024-05-24T23:04:55.820118660Z [2024-05-24T23:04:55.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=split_metrics, run_id=scheduled__2024-05-24T22:55:00+00:00, map_index=-1, run_start_date=2024-05-24 23:04:54.090429+00:00, run_end_date=2024-05-24 23:04:54.478618+00:00, run_duration=0.388189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:52.376425+00:00, queued_by_job_id=1, pid=339 2024-05-24T23:04:55.820241205Z [2024-05-24T23:04:55.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to a371d461-42b1-4373-995d-bf073059a254 2024-05-24T23:04:57.483691004Z [2024-05-24T23:04:57.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.collect_metrics run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status failed for try_number 1 2024-05-24T23:04:57.487595033Z [2024-05-24T23:04:57.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=collect_metrics, run_id=scheduled__2024-05-24T22:55:00+00:00, map_index=0, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:04:55.747335+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:04:57.488127602Z [2024-05-24T23:04:57.487+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:04:57.489603052Z [2024-05-24T23:04:57.489+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:04:57.503946989Z [2024-05-24T23:04:57.503+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=collect_metrics, map_index=0, execution_date=20240524T225500, start_date=, end_date=20240524T230457 2024-05-24T23:05:00.617066325Z [2024-05-24T23:05:00.616+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:05:00.640913439Z [2024-05-24T23:05:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:10:00+00:00 2024-05-24T23:05:00.661646810Z [2024-05-24T23:05:00.661+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:06:00+00:00 2024-05-24T23:05:00.679879599Z [2024-05-24T23:05:00.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:06:00+00:00 2024-05-24T23:05:00.690679082Z [2024-05-24T23:05:00.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:06:00+00:00 2024-05-24T23:05:00.700182229Z [2024-05-24T23:05:00.699+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:10:00+00:00 2024-05-24T23:05:00.706035104Z [2024-05-24T23:05:00.705+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:05:00.719086460Z [2024-05-24T23:05:00.718+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:06:00+00:00 2024-05-24T23:05:00.834885895Z [2024-05-24T23:05:00.834+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-05-24T23:05:00.834924306Z 2024-05-24T23:05:00.834961253Z 2024-05-24T23:05:00.834970792Z 2024-05-24T23:05:00.834978373Z 2024-05-24T23:05:00.834986028Z 2024-05-24T23:05:00.834993563Z 2024-05-24T23:05:00.835001004Z 2024-05-24T23:05:00.835069477Z 2024-05-24T23:05:00.835078962Z [2024-05-24T23:05:00.834+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:05:00.835101675Z [2024-05-24T23:05:00.834+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:05:00.835140335Z [2024-05-24T23:05:00.834+0000] {scheduler_job.py:425} INFO - DAG vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b has 0/16 running and queued tasks 2024-05-24T23:05:00.835201970Z [2024-05-24T23:05:00.835+0000] {scheduler_job.py:425} INFO - DAG vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:05:00.835345660Z [2024-05-24T23:05:00.835+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:05:00.835486232Z [2024-05-24T23:05:00.835+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:05:00.835549429Z [2024-05-24T23:05:00.835+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:05:00.835701353Z [2024-05-24T23:05:00.835+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:05:00.836417847Z [2024-05-24T23:05:00.836+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:05:00.836440757Z 2024-05-24T23:05:00.836449442Z 2024-05-24T23:05:00.836471446Z 2024-05-24T23:05:00.836479450Z 2024-05-24T23:05:00.836487303Z 2024-05-24T23:05:00.836495072Z 2024-05-24T23:05:00.836502762Z 2024-05-24T23:05:00.836511324Z 2024-05-24T23:05:00.841745111Z [2024-05-24T23:05:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:05:00.841775293Z [2024-05-24T23:05:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:05:00.842025767Z [2024-05-24T23:05:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:05:00.842132609Z [2024-05-24T23:05:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:05:00.842395142Z [2024-05-24T23:05:00.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:05:00.842413953Z [2024-05-24T23:05:00.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:05:00.842725093Z [2024-05-24T23:05:00.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:05:00.842743769Z [2024-05-24T23:05:00.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:05:00.842990968Z [2024-05-24T23:05:00.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:05:00.843009358Z [2024-05-24T23:05:00.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:05:00.843295823Z [2024-05-24T23:05:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:05:00.843324450Z [2024-05-24T23:05:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:05:00.843573894Z [2024-05-24T23:05:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:05:00.843638941Z [2024-05-24T23:05:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:05:00.844092121Z [2024-05-24T23:05:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:05:00.844125238Z [2024-05-24T23:05:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:05:01.918425753Z [2024-05-24T23:05:01.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status queued for try_number 1 2024-05-24T23:05:01.918701656Z [2024-05-24T23:05:01.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status queued for try_number 1 2024-05-24T23:05:01.918889190Z [2024-05-24T23:05:01.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status queued for try_number 1 2024-05-24T23:05:01.919053982Z [2024-05-24T23:05:01.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status queued for try_number 1 2024-05-24T23:05:01.919208700Z [2024-05-24T23:05:01.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status queued for try_number 1 2024-05-24T23:05:01.919371252Z [2024-05-24T23:05:01.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status queued for try_number 1 2024-05-24T23:05:01.919518723Z [2024-05-24T23:05:01.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status queued for try_number 1 2024-05-24T23:05:01.919684964Z [2024-05-24T23:05:01.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status queued for try_number 1 2024-05-24T23:05:01.950944079Z [2024-05-24T23:05:01.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8dc20b89-7b51-49f7-8186-77b024c60e5b 2024-05-24T23:05:01.951253229Z [2024-05-24T23:05:01.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b55a231-21a1-468b-abd8-daca2f40771e 2024-05-24T23:05:01.951461805Z [2024-05-24T23:05:01.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2849749e-d9d8-4da1-aea0-81a7c068ffb8 2024-05-24T23:05:01.951695183Z [2024-05-24T23:05:01.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6126622d-365f-466a-9b18-6c0de581c557 2024-05-24T23:05:01.951939495Z [2024-05-24T23:05:01.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fcdf50a-1db3-4123-8991-d54fb86aa092 2024-05-24T23:05:01.952160265Z [2024-05-24T23:05:01.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to d436a0c1-fa0f-4784-8d83-076ef93d16d2 2024-05-24T23:05:01.952368362Z [2024-05-24T23:05:01.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5452d7c9-898a-46f1-a7c4-dbb73f55cf12 2024-05-24T23:05:01.952591879Z [2024-05-24T23:05:01.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5f202d0-54d7-4407-86fc-49413f9cea8f 2024-05-24T23:05:02.073991277Z [2024-05-24T23:05:02.073+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:05:02.420907263Z [2024-05-24T23:05:02.416+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:05:02.420933986Z 2024-05-24T23:05:02.420937888Z [2024-05-24T23:05:02.416+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b has 0/16 running and queued tasks 2024-05-24T23:05:02.420954547Z [2024-05-24T23:05:02.417+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:05:02.420957863Z 2024-05-24T23:05:02.420961984Z [2024-05-24T23:05:02.420+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:05:02.420965254Z [2024-05-24T23:05:02.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:05:02.572363174Z [2024-05-24T23:05:02.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status queued for try_number 1 2024-05-24T23:05:02.585077147Z [2024-05-24T23:05:02.584+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e7d3dc4-413a-45e7-a188-89e03ceef79c 2024-05-24T23:05:05.597165263Z [2024-05-24T23:05:05.596+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:05:05.597377044Z [2024-05-24T23:05:05.597+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:04:00+00:00, run_id=scheduled__2024-05-24T23:04:00+00:00, run_start_date=2024-05-24 23:05:00.734357+00:00, run_end_date=2024-05-24 23:05:05.597053+00:00, run_duration=4.862696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:04:00+00:00, data_interval_end=2024-05-24 23:05:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:05:05.624808935Z [2024-05-24T23:05:05.624+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:06:00+00:00 2024-05-24T23:05:05.858355893Z [2024-05-24T23:05:05.858+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:05:05.858427635Z 2024-05-24T23:05:05.858448883Z [2024-05-24T23:05:05.858+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:05:05.859018964Z [2024-05-24T23:05:05.858+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:05:05.859026702Z 2024-05-24T23:05:05.864434227Z [2024-05-24T23:05:05.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:05:05.864546080Z [2024-05-24T23:05:05.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:05:05.990381924Z [2024-05-24T23:05:05.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status queued for try_number 1 2024-05-24T23:05:05.992454222Z [2024-05-24T23:05:05.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status success for try_number 1 2024-05-24T23:05:05.992715577Z [2024-05-24T23:05:05.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status failed for try_number 1 2024-05-24T23:05:05.992818978Z [2024-05-24T23:05:05.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status success for try_number 1 2024-05-24T23:05:06.009069331Z [2024-05-24T23:05:06.008+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:00:00+00:00, map_index=-1, run_start_date=2024-05-24 23:05:04.667166+00:00, run_end_date=2024-05-24 23:05:05.212363+00:00, run_duration=0.545197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:00.837827+00:00, queued_by_job_id=1, pid=388 2024-05-24T23:05:06.009349562Z [2024-05-24T23:05:06.009+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecfa1dea-cf89-4c56-9327-f80aa37ba39d 2024-05-24T23:05:06.009544184Z [2024-05-24T23:05:06.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:00:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:00.837827+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:05:06.009973653Z [2024-05-24T23:05:06.009+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:06.029189187Z [2024-05-24T23:05:06.028+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:06.053154575Z [2024-05-24T23:05:06.049+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=extract_metrics_from_vnfrs, execution_date=20240524T230000, start_date=, end_date=20240524T230506 2024-05-24T23:05:06.076314041Z [2024-05-24T23:05:06.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:04:00+00:00, map_index=-1, run_start_date=2024-05-24 23:05:02.990624+00:00, run_end_date=2024-05-24 23:05:04.150308+00:00, run_duration=1.159684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:00.837827+00:00, queued_by_job_id=1, pid=368 2024-05-24T23:05:07.232111056Z [2024-05-24T23:05:07.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status failed for try_number 1 2024-05-24T23:05:07.232366021Z [2024-05-24T23:05:07.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status failed for try_number 1 2024-05-24T23:05:07.241143734Z [2024-05-24T23:05:07.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:04:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:00.837827+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:05:07.241712355Z [2024-05-24T23:05:07.241+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:07.244654950Z [2024-05-24T23:05:07.244+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:07.262320064Z [2024-05-24T23:05:07.262+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240524T230400, start_date=, end_date=20240524T230507 2024-05-24T23:05:07.272998175Z [2024-05-24T23:05:07.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:04:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:00.837827+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:05:07.273550506Z [2024-05-24T23:05:07.273+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:07.277852358Z [2024-05-24T23:05:07.277+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:07.294490247Z [2024-05-24T23:05:07.294+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240524T230400, start_date=, end_date=20240524T230507 2024-05-24T23:05:08.363973364Z [2024-05-24T23:05:08.363+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:05:08.364343587Z [2024-05-24T23:05:08.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, execution_date=2024-05-24 23:04:00+00:00, run_id=scheduled__2024-05-24T23:04:00+00:00, run_start_date=2024-05-24 23:05:00.732001+00:00, run_end_date=2024-05-24 23:05:08.364022+00:00, run_duration=7.632021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:04:00+00:00, data_interval_end=2024-05-24 23:05:00+00:00, dag_hash=11d8272ff72a1eea9ea85ef21142a938 2024-05-24T23:05:08.373576786Z [2024-05-24T23:05:08.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:06:00+00:00 2024-05-24T23:05:08.380403708Z [2024-05-24T23:05:08.380+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:05:08.380546027Z [2024-05-24T23:05:08.380+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:04:00+00:00, run_id=scheduled__2024-05-24T23:04:00+00:00, run_start_date=2024-05-24 23:05:00.737711+00:00, run_end_date=2024-05-24 23:05:08.380313+00:00, run_duration=7.642602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:04:00+00:00, data_interval_end=2024-05-24 23:05:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:05:08.390581620Z [2024-05-24T23:05:08.390+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:06:00+00:00 2024-05-24T23:05:08.397629971Z [2024-05-24T23:05:08.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:05:08.398038930Z [2024-05-24T23:05:08.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:04:00+00:00, run_id=scheduled__2024-05-24T23:04:00+00:00, run_start_date=2024-05-24 23:05:00.735476+00:00, run_end_date=2024-05-24 23:05:08.397564+00:00, run_duration=7.662088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:04:00+00:00, data_interval_end=2024-05-24 23:05:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:05:08.406805114Z [2024-05-24T23:05:08.406+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:06:00+00:00 2024-05-24T23:05:08.481546861Z [2024-05-24T23:05:08.481+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:05:08.481588234Z 2024-05-24T23:05:08.481609085Z [2024-05-24T23:05:08.481+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:05:08.482122125Z [2024-05-24T23:05:08.481+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:05:08.482144248Z 2024-05-24T23:05:08.484000843Z [2024-05-24T23:05:08.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='collect_metrics', run_id='scheduled__2024-05-24T22:55:00+00:00', try_number=2, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:05:08.484030155Z [2024-05-24T23:05:08.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'collect_metrics', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:05:08.529586890Z [2024-05-24T23:05:08.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.collect_metrics run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status queued for try_number 2 2024-05-24T23:05:08.529613738Z [2024-05-24T23:05:08.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status success for try_number 1 2024-05-24T23:05:08.529832348Z [2024-05-24T23:05:08.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status success for try_number 1 2024-05-24T23:05:08.529903131Z [2024-05-24T23:05:08.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status success for try_number 1 2024-05-24T23:05:08.539507307Z [2024-05-24T23:05:08.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:04:00+00:00, map_index=-1, run_start_date=2024-05-24 23:05:04.907083+00:00, run_end_date=2024-05-24 23:05:07.167378+00:00, run_duration=2.260295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:00.837827+00:00, queued_by_job_id=1, pid=390 2024-05-24T23:05:08.539619780Z [2024-05-24T23:05:08.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:04:00+00:00, map_index=-1, run_start_date=2024-05-24 23:05:06.550598+00:00, run_end_date=2024-05-24 23:05:07.790982+00:00, run_duration=1.240384, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:00.837827+00:00, queued_by_job_id=1, pid=459 2024-05-24T23:05:08.539781013Z [2024-05-24T23:05:08.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:04:00+00:00, map_index=-1, run_start_date=2024-05-24 23:05:05.642528+00:00, run_end_date=2024-05-24 23:05:07.876384+00:00, run_duration=2.233856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:00.837827+00:00, queued_by_job_id=1, pid=411 2024-05-24T23:05:08.539994094Z [2024-05-24T23:05:08.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef407ab3-ebd4-4595-b0f5-f7bb922cbf24 2024-05-24T23:05:09.738806865Z [2024-05-24T23:05:09.738+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:05:09.738946225Z [2024-05-24T23:05:09.738+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, execution_date=2024-05-24 23:04:00+00:00, run_id=scheduled__2024-05-24T23:04:00+00:00, run_start_date=2024-05-24 23:05:02.097822+00:00, run_end_date=2024-05-24 23:05:09.738713+00:00, run_duration=7.640891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:04:00+00:00, data_interval_end=2024-05-24 23:05:00+00:00, dag_hash=1f7f193cae8a48c8b44b009c68ef077c 2024-05-24T23:05:09.749383455Z [2024-05-24T23:05:09.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:06:00+00:00 2024-05-24T23:05:09.827194418Z [2024-05-24T23:05:09.826+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:05:09.827240363Z 2024-05-24T23:05:09.827530864Z [2024-05-24T23:05:09.827+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:05:09.828776039Z [2024-05-24T23:05:09.828+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:05:09.828800444Z 2024-05-24T23:05:09.832077104Z [2024-05-24T23:05:09.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:05:09.832460792Z [2024-05-24T23:05:09.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:05:09.901663817Z [2024-05-24T23:05:09.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status queued for try_number 1 2024-05-24T23:05:09.901746988Z [2024-05-24T23:05:09.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status success for try_number 1 2024-05-24T23:05:09.901869657Z [2024-05-24T23:05:09.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status success for try_number 1 2024-05-24T23:05:09.913811631Z [2024-05-24T23:05:09.913+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:04:00+00:00, map_index=-1, run_start_date=2024-05-24 23:05:07.295274+00:00, run_end_date=2024-05-24 23:05:09.036097+00:00, run_duration=1.740823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:02.418008+00:00, queued_by_job_id=1, pid=470 2024-05-24T23:05:09.914012523Z [2024-05-24T23:05:09.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74c3fac2-4e37-4ff1-8ca6-b7ab3e901054 2024-05-24T23:05:09.914270015Z [2024-05-24T23:05:09.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:00:00+00:00, map_index=-1, run_start_date=2024-05-24 23:05:08.581147+00:00, run_end_date=2024-05-24 23:05:08.988904+00:00, run_duration=0.407757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:05.859407+00:00, queued_by_job_id=1, pid=486 2024-05-24T23:05:11.190547847Z [2024-05-24T23:05:11.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.collect_metrics run_id=scheduled__2024-05-24T22:55:00+00:00 exited with status failed for try_number 2 2024-05-24T23:05:11.197919602Z [2024-05-24T23:05:11.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=collect_metrics, run_id=scheduled__2024-05-24T22:55:00+00:00, map_index=0, run_start_date=None, run_end_date=2024-05-24 23:04:57.493337+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:08.482328+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:05:11.198631354Z [2024-05-24T23:05:11.198+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:11.201736422Z [2024-05-24T23:05:11.201+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:11.217392822Z [2024-05-24T23:05:11.217+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=collect_metrics, map_index=0, execution_date=20240524T225500, start_date=, end_date=20240524T230511 2024-05-24T23:05:12.155394140Z [2024-05-24T23:05:12.154+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:05:12.155426310Z 2024-05-24T23:05:12.155597113Z [2024-05-24T23:05:12.155+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:05:12.156300051Z [2024-05-24T23:05:12.156+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:05:12.156313237Z 2024-05-24T23:05:12.158785011Z [2024-05-24T23:05:12.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:05:12.158800603Z [2024-05-24T23:05:12.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:05:12.236570975Z [2024-05-24T23:05:12.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status queued for try_number 1 2024-05-24T23:05:12.236615346Z [2024-05-24T23:05:12.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status success for try_number 1 2024-05-24T23:05:12.247379367Z [2024-05-24T23:05:12.246+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:00:00+00:00, map_index=0, run_start_date=2024-05-24 23:05:11.412416+00:00, run_end_date=2024-05-24 23:05:11.747176+00:00, run_duration=0.33476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:09.829709+00:00, queued_by_job_id=1, pid=505 2024-05-24T23:05:12.247527531Z [2024-05-24T23:05:12.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6523dac9-4516-4803-8b0a-2276ee259f92 2024-05-24T23:05:12.333313500Z [2024-05-24T23:05:12.332+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T23:05:12.334722754Z [2024-05-24T23:05:12.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, execution_date=2024-05-24 22:55:00+00:00, run_id=scheduled__2024-05-24T22:55:00+00:00, run_start_date=2024-05-24 23:04:49.373034+00:00, run_end_date=2024-05-24 23:05:12.333150+00:00, run_duration=22.960116, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 22:55:00+00:00, data_interval_end=2024-05-24 23:00:00+00:00, dag_hash=28b2ae496e2520e256ac671fc42b9553 2024-05-24T23:05:12.341777585Z [2024-05-24T23:05:12.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:00:00+00:00, run_after=2024-05-24T23:05:00+00:00 2024-05-24T23:05:13.433616326Z [2024-05-24T23:05:13.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:10:00+00:00 2024-05-24T23:05:14.617847998Z [2024-05-24T23:05:14.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:05:14.617967518Z [2024-05-24T23:05:14.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:00:00+00:00, run_id=scheduled__2024-05-24T23:00:00+00:00, run_start_date=2024-05-24 23:05:00.730253+00:00, run_end_date=2024-05-24 23:05:14.617734+00:00, run_duration=13.887481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:00:00+00:00, data_interval_end=2024-05-24 23:05:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-24T23:05:14.623578478Z [2024-05-24T23:05:14.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:10:00+00:00 2024-05-24T23:05:14.702212463Z [2024-05-24T23:05:14.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status success for try_number 1 2024-05-24T23:05:14.709630202Z [2024-05-24T23:05:14.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:00:00+00:00, map_index=-1, run_start_date=2024-05-24 23:05:13.946699+00:00, run_end_date=2024-05-24 23:05:14.364003+00:00, run_duration=0.417304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:12.156723+00:00, queued_by_job_id=1, pid=513 2024-05-24T23:05:16.956944119Z [2024-05-24T23:05:16.956+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:05:16.956997506Z 2024-05-24T23:05:16.958041918Z [2024-05-24T23:05:16.957+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:05:16.959292003Z [2024-05-24T23:05:16.958+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:05:16.959325037Z 2024-05-24T23:05:16.963358091Z [2024-05-24T23:05:16.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:00:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:05:16.963512446Z [2024-05-24T23:05:16.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:05:17.023811732Z [2024-05-24T23:05:17.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status queued for try_number 2 2024-05-24T23:05:17.031524375Z [2024-05-24T23:05:17.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 080da041-2f32-4306-93bb-bb80f7ce839e 2024-05-24T23:05:17.516059521Z [2024-05-24T23:05:17.515+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-24T23:05:17.516097023Z 2024-05-24T23:05:17.516101523Z 2024-05-24T23:05:17.516437512Z [2024-05-24T23:05:17.516+0000] {scheduler_job.py:425} INFO - DAG vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:05:17.516819680Z [2024-05-24T23:05:17.516+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:05:17.518926724Z [2024-05-24T23:05:17.517+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:05:17.518955656Z 2024-05-24T23:05:17.518974494Z 2024-05-24T23:05:17.521750832Z [2024-05-24T23:05:17.521+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:04:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:05:17.522070975Z [2024-05-24T23:05:17.521+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:05:17.522406747Z [2024-05-24T23:05:17.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:04:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:05:17.522616530Z [2024-05-24T23:05:17.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:05:17.720934540Z [2024-05-24T23:05:17.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status queued for try_number 2 2024-05-24T23:05:17.721524286Z [2024-05-24T23:05:17.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status queued for try_number 2 2024-05-24T23:05:17.733048206Z [2024-05-24T23:05:17.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcc56adb-e572-4875-8d44-07ea7dc88119 2024-05-24T23:05:17.733311248Z [2024-05-24T23:05:17.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f23cd8d-5683-4faf-a62f-b346763cb977 2024-05-24T23:05:18.980952708Z [2024-05-24T23:05:18.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:00:00+00:00 exited with status failed for try_number 2 2024-05-24T23:05:18.992817861Z [2024-05-24T23:05:18.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:00:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 23:05:06.039198+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:16.960226+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:05:18.993786118Z [2024-05-24T23:05:18.993+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:18.997432308Z [2024-05-24T23:05:18.996+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:19.016149554Z [2024-05-24T23:05:19.015+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=extract_metrics_from_vnfrs, execution_date=20240524T230000, start_date=, end_date=20240524T230519 2024-05-24T23:05:20.147883816Z [2024-05-24T23:05:20.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status failed for try_number 2 2024-05-24T23:05:20.148012926Z [2024-05-24T23:05:20.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status failed for try_number 2 2024-05-24T23:05:20.153730175Z [2024-05-24T23:05:20.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:04:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 23:05:07.246866+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:17.518757+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:05:20.154243660Z [2024-05-24T23:05:20.153+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:20.156460148Z [2024-05-24T23:05:20.156+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:20.170052794Z [2024-05-24T23:05:20.169+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240524T230400, start_date=, end_date=20240524T230520 2024-05-24T23:05:20.179764112Z [2024-05-24T23:05:20.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:04:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 23:05:07.282147+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:05:17.518757+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:05:20.180087223Z [2024-05-24T23:05:20.179+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:20.182772028Z [2024-05-24T23:05:20.182+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:05:20.197051710Z [2024-05-24T23:05:20.196+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240524T230400, start_date=, end_date=20240524T230520 2024-05-24T23:05:21.280560532Z [2024-05-24T23:05:21.280+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T23:05:21.281160256Z [2024-05-24T23:05:21.280+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0, execution_date=2024-05-24 23:04:00+00:00, run_id=scheduled__2024-05-24T23:04:00+00:00, run_start_date=2024-05-24 23:05:00.733137+00:00, run_end_date=2024-05-24 23:05:21.280637+00:00, run_duration=20.5475, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:04:00+00:00, data_interval_end=2024-05-24 23:05:00+00:00, dag_hash=92b6a8e6588785685c79bd880e10d21b 2024-05-24T23:05:21.290644158Z [2024-05-24T23:05:21.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:06:00+00:00 2024-05-24T23:05:21.298052028Z [2024-05-24T23:05:21.297+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T23:05:21.298257290Z [2024-05-24T23:05:21.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, execution_date=2024-05-24 23:04:00+00:00, run_id=scheduled__2024-05-24T23:04:00+00:00, run_start_date=2024-05-24 23:05:00.736698+00:00, run_end_date=2024-05-24 23:05:21.297921+00:00, run_duration=20.561223, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:04:00+00:00, data_interval_end=2024-05-24 23:05:00+00:00, dag_hash=1fdef68d39d00c1c614f2a3d271815a2 2024-05-24T23:05:21.306880130Z [2024-05-24T23:05:21.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:06:00+00:00 2024-05-24T23:05:22.807982582Z [2024-05-24T23:05:22.807+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T23:05:22.811668825Z [2024-05-24T23:05:22.808+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, execution_date=2024-05-24 23:00:00+00:00, run_id=scheduled__2024-05-24T23:00:00+00:00, run_start_date=2024-05-24 23:05:00.731617+00:00, run_end_date=2024-05-24 23:05:22.808582+00:00, run_duration=22.076965, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:00:00+00:00, data_interval_end=2024-05-24 23:05:00+00:00, dag_hash=28b2ae496e2520e256ac671fc42b9553 2024-05-24T23:05:22.818805801Z [2024-05-24T23:05:22.818+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:05:00+00:00, run_after=2024-05-24T23:10:00+00:00 2024-05-24T23:05:27.220311216Z [2024-05-24T23:05:27.219+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T23:06:00.991347999Z [2024-05-24T23:06:00.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:06:00+00:00, run_after=2024-05-24T23:07:00+00:00 2024-05-24T23:06:00.998781040Z [2024-05-24T23:06:00.998+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:06:01.005038756Z [2024-05-24T23:06:01.004+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:06:01.012103420Z [2024-05-24T23:06:01.011+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:06:01.028739774Z [2024-05-24T23:06:01.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b to 2024-05-24T23:06:00+00:00, run_after=2024-05-24T23:07:00+00:00 2024-05-24T23:06:01.041871494Z [2024-05-24T23:06:01.041+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:06:00+00:00, run_after=2024-05-24T23:07:00+00:00 2024-05-24T23:06:01.057567725Z [2024-05-24T23:06:01.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:06:00+00:00, run_after=2024-05-24T23:07:00+00:00 2024-05-24T23:06:01.065298461Z [2024-05-24T23:06:01.064+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:06:01.241380398Z [2024-05-24T23:06:01.240+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-05-24T23:06:01.241452726Z 2024-05-24T23:06:01.241466093Z 2024-05-24T23:06:01.241474568Z 2024-05-24T23:06:01.241508336Z 2024-05-24T23:06:01.241516583Z 2024-05-24T23:06:01.241524257Z 2024-05-24T23:06:01.241531883Z 2024-05-24T23:06:01.241539892Z 2024-05-24T23:06:01.241562776Z [2024-05-24T23:06:01.241+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:06:01.241843237Z [2024-05-24T23:06:01.241+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:06:01.242063794Z [2024-05-24T23:06:01.241+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:06:01.242261940Z [2024-05-24T23:06:01.241+0000] {scheduler_job.py:425} INFO - DAG vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b has 0/16 running and queued tasks 2024-05-24T23:06:01.242481465Z [2024-05-24T23:06:01.242+0000] {scheduler_job.py:425} INFO - DAG vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:06:01.242681578Z [2024-05-24T23:06:01.242+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:06:01.242896145Z [2024-05-24T23:06:01.242+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:06:01.243114562Z [2024-05-24T23:06:01.242+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b has 0/16 running and queued tasks 2024-05-24T23:06:01.244620947Z [2024-05-24T23:06:01.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:06:01.244704800Z 2024-05-24T23:06:01.244714263Z 2024-05-24T23:06:01.244721932Z 2024-05-24T23:06:01.244729537Z 2024-05-24T23:06:01.244736991Z 2024-05-24T23:06:01.244771170Z 2024-05-24T23:06:01.244779500Z 2024-05-24T23:06:01.244787168Z 2024-05-24T23:06:01.253035572Z [2024-05-24T23:06:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:06:01.253116494Z [2024-05-24T23:06:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:06:01.253679300Z [2024-05-24T23:06:01.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:06:01.253769974Z [2024-05-24T23:06:01.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:06:01.254246381Z [2024-05-24T23:06:01.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:06:01.254276491Z [2024-05-24T23:06:01.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:06:01.254663974Z [2024-05-24T23:06:01.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:06:01.254743377Z [2024-05-24T23:06:01.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:06:01.255111902Z [2024-05-24T23:06:01.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:06:01.255189750Z [2024-05-24T23:06:01.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:06:01.255537040Z [2024-05-24T23:06:01.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:06:01.255565316Z [2024-05-24T23:06:01.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:06:01.255842781Z [2024-05-24T23:06:01.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:06:01.256029541Z [2024-05-24T23:06:01.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:06:01.256233196Z [2024-05-24T23:06:01.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:06:01.256252433Z [2024-05-24T23:06:01.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:06:02.404364076Z [2024-05-24T23:06:02.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status queued for try_number 1 2024-05-24T23:06:02.404399352Z [2024-05-24T23:06:02.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 1 2024-05-24T23:06:02.404453138Z [2024-05-24T23:06:02.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 1 2024-05-24T23:06:02.404510905Z [2024-05-24T23:06:02.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 1 2024-05-24T23:06:02.404582203Z [2024-05-24T23:06:02.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 1 2024-05-24T23:06:02.404637107Z [2024-05-24T23:06:02.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 1 2024-05-24T23:06:02.404708231Z [2024-05-24T23:06:02.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 1 2024-05-24T23:06:02.404800266Z [2024-05-24T23:06:02.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 1 2024-05-24T23:06:02.426832968Z [2024-05-24T23:06:02.426+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2320c7b-566d-448e-8810-a4fbf032c8a4 2024-05-24T23:06:02.426868570Z [2024-05-24T23:06:02.426+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0108171c-02c6-424a-b0f2-565a751e24e2 2024-05-24T23:06:02.427004920Z [2024-05-24T23:06:02.426+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89558b05-2521-480a-978b-eecb4c0e19ee 2024-05-24T23:06:02.427099640Z [2024-05-24T23:06:02.426+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7370cde-3965-4af6-9d79-fc1c07249493 2024-05-24T23:06:02.427201220Z [2024-05-24T23:06:02.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0370c47-e5b0-4139-9faa-721279f6ae9f 2024-05-24T23:06:02.427301803Z [2024-05-24T23:06:02.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to db22c72d-2d6d-4042-aad0-5acd846000d8 2024-05-24T23:06:02.427402805Z [2024-05-24T23:06:02.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a2bd1a0-9938-4ccc-bf1e-3ecca8b8e81e 2024-05-24T23:06:02.427492855Z [2024-05-24T23:06:02.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 249bd0cc-f9c3-48cd-b17f-72a20a000306 2024-05-24T23:06:04.642679633Z [2024-05-24T23:06:04.642+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:06:04.642897034Z [2024-05-24T23:06:04.642+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:05:00+00:00, run_id=scheduled__2024-05-24T23:05:00+00:00, run_start_date=2024-05-24 23:06:01.085134+00:00, run_end_date=2024-05-24 23:06:04.642594+00:00, run_duration=3.55746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:05:00+00:00, data_interval_end=2024-05-24 23:06:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:06:04.657414798Z [2024-05-24T23:06:04.657+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:06:00+00:00, run_after=2024-05-24T23:07:00+00:00 2024-05-24T23:06:04.676374640Z [2024-05-24T23:06:04.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:06:04.676524610Z [2024-05-24T23:06:04.676+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:04:00+00:00, run_id=scheduled__2024-05-24T23:04:00+00:00, run_start_date=2024-05-24 23:06:01.076376+00:00, run_end_date=2024-05-24 23:06:04.676290+00:00, run_duration=3.599914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:04:00+00:00, data_interval_end=2024-05-24 23:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:06:04.689526853Z [2024-05-24T23:06:04.689+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:06:00+00:00, run_after=2024-05-24T23:08:00+00:00 2024-05-24T23:06:04.870113686Z [2024-05-24T23:06:04.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:04:00+00:00 exited with status success for try_number 1 2024-05-24T23:06:04.870135589Z [2024-05-24T23:06:04.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status success for try_number 1 2024-05-24T23:06:04.890954225Z [2024-05-24T23:06:04.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:04:00+00:00, map_index=-1, run_start_date=2024-05-24 23:06:02.959741+00:00, run_end_date=2024-05-24 23:06:03.807420+00:00, run_duration=0.847679, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:06:01.247348+00:00, queued_by_job_id=1, pid=563 2024-05-24T23:06:04.891119564Z [2024-05-24T23:06:04.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=2024-05-24 23:06:03.035443+00:00, run_end_date=2024-05-24 23:06:03.655158+00:00, run_duration=0.619715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:06:01.247348+00:00, queued_by_job_id=1, pid=564 2024-05-24T23:06:06.012802250Z [2024-05-24T23:06:06.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status failed for try_number 1 2024-05-24T23:06:06.013619245Z [2024-05-24T23:06:06.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status failed for try_number 1 2024-05-24T23:06:06.013987528Z [2024-05-24T23:06:06.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status failed for try_number 1 2024-05-24T23:06:06.014236221Z [2024-05-24T23:06:06.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status failed for try_number 1 2024-05-24T23:06:06.028495924Z [2024-05-24T23:06:06.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:06:01.247348+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:06:06.028512396Z [2024-05-24T23:06:06.027+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:06.038796296Z [2024-05-24T23:06:06.029+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:06.049522129Z [2024-05-24T23:06:06.042+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240524T230500, start_date=, end_date=20240524T230606 2024-05-24T23:06:06.049547607Z [2024-05-24T23:06:06.049+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:06:01.247348+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:06:06.049839124Z [2024-05-24T23:06:06.049+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:06.051815167Z [2024-05-24T23:06:06.051+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:06.062283617Z [2024-05-24T23:06:06.062+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240524T230500, start_date=, end_date=20240524T230606 2024-05-24T23:06:06.069585289Z [2024-05-24T23:06:06.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:06:01.247348+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:06:06.070001808Z [2024-05-24T23:06:06.069+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:06.073845126Z [2024-05-24T23:06:06.073+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:06.086546696Z [2024-05-24T23:06:06.086+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240524T230500, start_date=, end_date=20240524T230606 2024-05-24T23:06:06.092834509Z [2024-05-24T23:06:06.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:06:01.247348+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:06:06.093298943Z [2024-05-24T23:06:06.093+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:06.095645228Z [2024-05-24T23:06:06.095+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:06.106145206Z [2024-05-24T23:06:06.105+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240524T230500, start_date=, end_date=20240524T230606 2024-05-24T23:06:07.163954449Z [2024-05-24T23:06:07.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:06:07.164387228Z [2024-05-24T23:06:07.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:05:00+00:00, run_id=scheduled__2024-05-24T23:05:00+00:00, run_start_date=2024-05-24 23:06:01.080423+00:00, run_end_date=2024-05-24 23:06:07.164032+00:00, run_duration=6.083609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:05:00+00:00, data_interval_end=2024-05-24 23:06:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:06:07.174175743Z [2024-05-24T23:06:07.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:06:00+00:00, run_after=2024-05-24T23:07:00+00:00 2024-05-24T23:06:07.183033440Z [2024-05-24T23:06:07.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:06:07.183516251Z [2024-05-24T23:06:07.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:05:00+00:00, run_id=scheduled__2024-05-24T23:05:00+00:00, run_start_date=2024-05-24 23:06:01.086538+00:00, run_end_date=2024-05-24 23:06:07.182952+00:00, run_duration=6.096414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:05:00+00:00, data_interval_end=2024-05-24 23:06:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:06:07.194578747Z [2024-05-24T23:06:07.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:06:00+00:00, run_after=2024-05-24T23:07:00+00:00 2024-05-24T23:06:07.271934650Z [2024-05-24T23:06:07.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status success for try_number 1 2024-05-24T23:06:07.278904942Z [2024-05-24T23:06:07.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=2024-05-24 23:06:04.699720+00:00, run_end_date=2024-05-24 23:06:06.305079+00:00, run_duration=1.605359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:06:01.247348+00:00, queued_by_job_id=1, pid=585 2024-05-24T23:06:08.402179054Z [2024-05-24T23:06:08.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status success for try_number 1 2024-05-24T23:06:08.407937689Z [2024-05-24T23:06:08.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=2024-05-24 23:06:05.543302+00:00, run_end_date=2024-05-24 23:06:07.045954+00:00, run_duration=1.502652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:06:01.247348+00:00, queued_by_job_id=1, pid=627 2024-05-24T23:06:16.107140123Z [2024-05-24T23:06:16.106+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-24T23:06:16.107184595Z 2024-05-24T23:06:16.107188552Z 2024-05-24T23:06:16.107424152Z [2024-05-24T23:06:16.106+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:06:16.107651476Z [2024-05-24T23:06:16.107+0000] {scheduler_job.py:425} INFO - DAG vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b has 0/16 running and queued tasks 2024-05-24T23:06:16.108418613Z [2024-05-24T23:06:16.108+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:06:16.108472531Z 2024-05-24T23:06:16.108478603Z 2024-05-24T23:06:16.112170620Z [2024-05-24T23:06:16.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:06:16.112537982Z [2024-05-24T23:06:16.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:06:16.113084664Z [2024-05-24T23:06:16.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:06:16.113607361Z [2024-05-24T23:06:16.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:06:16.271107553Z [2024-05-24T23:06:16.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 2 2024-05-24T23:06:16.271341137Z [2024-05-24T23:06:16.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 2 2024-05-24T23:06:16.279968976Z [2024-05-24T23:06:16.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b1711a4-a72a-43c5-973a-ebe811fca475 2024-05-24T23:06:16.280472455Z [2024-05-24T23:06:16.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59345422-fcd7-4419-9809-fa376e201510 2024-05-24T23:06:16.362261460Z [2024-05-24T23:06:16.361+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-24T23:06:16.362285805Z 2024-05-24T23:06:16.362289438Z 2024-05-24T23:06:16.362559309Z [2024-05-24T23:06:16.362+0000] {scheduler_job.py:425} INFO - DAG vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0 has 0/16 running and queued tasks 2024-05-24T23:06:16.362785343Z [2024-05-24T23:06:16.362+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b has 0/16 running and queued tasks 2024-05-24T23:06:16.363422760Z [2024-05-24T23:06:16.363+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:06:16.363439496Z 2024-05-24T23:06:16.363444717Z 2024-05-24T23:06:16.365898174Z [2024-05-24T23:06:16.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:06:16.366208331Z [2024-05-24T23:06:16.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:06:16.366602695Z [2024-05-24T23:06:16.366+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:06:16.366866759Z [2024-05-24T23:06:16.366+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:06:16.635644421Z [2024-05-24T23:06:16.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 2 2024-05-24T23:06:16.637958291Z [2024-05-24T23:06:16.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 2 2024-05-24T23:06:16.646613171Z [2024-05-24T23:06:16.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd67eab7-07e3-4008-87cd-e5aeb5638585 2024-05-24T23:06:16.646771867Z [2024-05-24T23:06:16.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to 784eb042-aa89-4e6b-a589-91aae54714ba 2024-05-24T23:06:18.960263066Z [2024-05-24T23:06:18.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status failed for try_number 2 2024-05-24T23:06:18.960723355Z [2024-05-24T23:06:18.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status failed for try_number 2 2024-05-24T23:06:18.960988056Z [2024-05-24T23:06:18.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status failed for try_number 2 2024-05-24T23:06:18.961180896Z [2024-05-24T23:06:18.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status failed for try_number 2 2024-05-24T23:06:18.970264546Z [2024-05-24T23:06:18.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 23:06:06.031283+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:06:16.109315+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:06:18.970782084Z [2024-05-24T23:06:18.970+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:18.973065842Z [2024-05-24T23:06:18.972+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:18.987911434Z [2024-05-24T23:06:18.987+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240524T230500, start_date=, end_date=20240524T230618 2024-05-24T23:06:18.996348145Z [2024-05-24T23:06:18.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 23:06:06.053543+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:06:16.109315+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:06:18.996826079Z [2024-05-24T23:06:18.996+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:18.998936875Z [2024-05-24T23:06:18.998+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:19.011424979Z [2024-05-24T23:06:19.011+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240524T230500, start_date=, end_date=20240524T230619 2024-05-24T23:06:19.019780200Z [2024-05-24T23:06:19.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 23:06:06.076843+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:06:16.363981+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:06:19.020583908Z [2024-05-24T23:06:19.020+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:19.023714922Z [2024-05-24T23:06:19.023+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:19.038100963Z [2024-05-24T23:06:19.037+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240524T230500, start_date=, end_date=20240524T230619 2024-05-24T23:06:19.047897096Z [2024-05-24T23:06:19.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 23:06:06.097602+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:06:16.363981+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:06:19.048342208Z [2024-05-24T23:06:19.048+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:19.050798544Z [2024-05-24T23:06:19.050+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:06:19.062856925Z [2024-05-24T23:06:19.062+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240524T230500, start_date=, end_date=20240524T230619 2024-05-24T23:06:20.140448493Z [2024-05-24T23:06:20.139+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T23:06:20.140992125Z [2024-05-24T23:06:20.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0, execution_date=2024-05-24 23:05:00+00:00, run_id=scheduled__2024-05-24T23:05:00+00:00, run_start_date=2024-05-24 23:06:01.078546+00:00, run_end_date=2024-05-24 23:06:20.140229+00:00, run_duration=19.061683, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:05:00+00:00, data_interval_end=2024-05-24 23:06:00+00:00, dag_hash=1fdef68d39d00c1c614f2a3d271815a2 2024-05-24T23:06:20.153814661Z [2024-05-24T23:06:20.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:06:00+00:00, run_after=2024-05-24T23:07:00+00:00 2024-05-24T23:06:20.162080063Z [2024-05-24T23:06:20.161+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T23:06:20.162507385Z [2024-05-24T23:06:20.162+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, execution_date=2024-05-24 23:05:00+00:00, run_id=scheduled__2024-05-24T23:05:00+00:00, run_start_date=2024-05-24 23:06:01.082199+00:00, run_end_date=2024-05-24 23:06:20.161920+00:00, run_duration=19.079721, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:05:00+00:00, data_interval_end=2024-05-24 23:06:00+00:00, dag_hash=11d8272ff72a1eea9ea85ef21142a938 2024-05-24T23:06:20.185225974Z [2024-05-24T23:06:20.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b to 2024-05-24T23:06:00+00:00, run_after=2024-05-24T23:07:00+00:00 2024-05-24T23:06:20.195043414Z [2024-05-24T23:06:20.194+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T23:06:20.195234095Z [2024-05-24T23:06:20.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0, execution_date=2024-05-24 23:05:00+00:00, run_id=scheduled__2024-05-24T23:05:00+00:00, run_start_date=2024-05-24 23:06:01.083763+00:00, run_end_date=2024-05-24 23:06:20.194878+00:00, run_duration=19.111115, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:05:00+00:00, data_interval_end=2024-05-24 23:06:00+00:00, dag_hash=92b6a8e6588785685c79bd880e10d21b 2024-05-24T23:06:20.211081646Z [2024-05-24T23:06:20.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0 to 2024-05-24T23:06:00+00:00, run_after=2024-05-24T23:07:00+00:00 2024-05-24T23:06:20.219075028Z [2024-05-24T23:06:20.218+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T23:06:20.219296875Z [2024-05-24T23:06:20.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b, execution_date=2024-05-24 23:05:00+00:00, run_id=scheduled__2024-05-24T23:05:00+00:00, run_start_date=2024-05-24 23:06:01.087837+00:00, run_end_date=2024-05-24 23:06:20.218903+00:00, run_duration=19.131066, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:05:00+00:00, data_interval_end=2024-05-24 23:06:00+00:00, dag_hash=1f7f193cae8a48c8b44b009c68ef077c 2024-05-24T23:06:20.228137944Z [2024-05-24T23:06:20.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b to 2024-05-24T23:06:00+00:00, run_after=2024-05-24T23:07:00+00:00 2024-05-24T23:07:00.195303823Z [2024-05-24T23:07:00.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:07:00+00:00, run_after=2024-05-24T23:08:00+00:00 2024-05-24T23:07:00.210144804Z [2024-05-24T23:07:00.209+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:07:00+00:00, run_after=2024-05-24T23:08:00+00:00 2024-05-24T23:07:00.218168912Z [2024-05-24T23:07:00.217+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:07:00.290498900Z [2024-05-24T23:07:00.289+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:07:00.290576309Z 2024-05-24T23:07:00.290588942Z 2024-05-24T23:07:00.290600392Z 2024-05-24T23:07:00.290611916Z [2024-05-24T23:07:00.290+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:07:00.290623449Z [2024-05-24T23:07:00.290+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:07:00.290634949Z [2024-05-24T23:07:00.290+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:07:00.291129798Z [2024-05-24T23:07:00.290+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:07:00.291149542Z 2024-05-24T23:07:00.291153102Z 2024-05-24T23:07:00.291156640Z 2024-05-24T23:07:00.295651392Z [2024-05-24T23:07:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:07:00.295839790Z [2024-05-24T23:07:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:07:00.296247987Z [2024-05-24T23:07:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:07:00.296475655Z [2024-05-24T23:07:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:07:00.296794407Z [2024-05-24T23:07:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:07:00.296964496Z [2024-05-24T23:07:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:07:00.473291756Z [2024-05-24T23:07:00.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:06:00+00:00 exited with status queued for try_number 1 2024-05-24T23:07:00.473344597Z [2024-05-24T23:07:00.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:06:00+00:00 exited with status queued for try_number 1 2024-05-24T23:07:00.473348493Z [2024-05-24T23:07:00.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:06:00+00:00 exited with status queued for try_number 1 2024-05-24T23:07:00.480000976Z [2024-05-24T23:07:00.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b24d645-e74a-49b6-a1cd-f23c31201e0e 2024-05-24T23:07:00.480027310Z [2024-05-24T23:07:00.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37afaeef-8452-482e-a2af-b1256f26598c 2024-05-24T23:07:00.480155267Z [2024-05-24T23:07:00.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59ebe640-832c-4400-9b84-1efaee6b928f 2024-05-24T23:07:01.640643250Z [2024-05-24T23:07:01.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:07:01.641574975Z [2024-05-24T23:07:01.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:06:00+00:00, run_id=scheduled__2024-05-24T23:06:00+00:00, run_start_date=2024-05-24 23:07:00.231006+00:00, run_end_date=2024-05-24 23:07:01.640715+00:00, run_duration=1.409709, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:06:00+00:00, data_interval_end=2024-05-24 23:07:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:07:01.667263761Z [2024-05-24T23:07:01.666+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:07:00+00:00, run_after=2024-05-24T23:08:00+00:00 2024-05-24T23:07:01.738479612Z [2024-05-24T23:07:01.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:06:00+00:00 exited with status success for try_number 1 2024-05-24T23:07:01.745612381Z [2024-05-24T23:07:01.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:06:00+00:00, map_index=-1, run_start_date=2024-05-24 23:07:01.076079+00:00, run_end_date=2024-05-24 23:07:01.469842+00:00, run_duration=0.393763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:07:00.291886+00:00, queued_by_job_id=1, pid=712 2024-05-24T23:07:04.283852925Z [2024-05-24T23:07:04.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:07:04.284457923Z [2024-05-24T23:07:04.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:06:00+00:00, run_id=scheduled__2024-05-24T23:06:00+00:00, run_start_date=2024-05-24 23:07:00.229718+00:00, run_end_date=2024-05-24 23:07:04.283687+00:00, run_duration=4.053969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:06:00+00:00, data_interval_end=2024-05-24 23:07:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:07:04.297994651Z [2024-05-24T23:07:04.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:07:00+00:00, run_after=2024-05-24T23:08:00+00:00 2024-05-24T23:07:04.306483544Z [2024-05-24T23:07:04.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:07:04.306873267Z [2024-05-24T23:07:04.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:06:00+00:00, run_id=scheduled__2024-05-24T23:06:00+00:00, run_start_date=2024-05-24 23:07:00.232156+00:00, run_end_date=2024-05-24 23:07:04.306353+00:00, run_duration=4.074197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:06:00+00:00, data_interval_end=2024-05-24 23:07:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:07:04.317750385Z [2024-05-24T23:07:04.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:07:00+00:00, run_after=2024-05-24T23:08:00+00:00 2024-05-24T23:07:04.353259058Z [2024-05-24T23:07:04.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:06:00+00:00 exited with status success for try_number 1 2024-05-24T23:07:04.353387085Z [2024-05-24T23:07:04.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:06:00+00:00 exited with status success for try_number 1 2024-05-24T23:07:04.361657218Z [2024-05-24T23:07:04.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:06:00+00:00, map_index=-1, run_start_date=2024-05-24 23:07:02.188230+00:00, run_end_date=2024-05-24 23:07:03.539042+00:00, run_duration=1.350812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:07:00.291886+00:00, queued_by_job_id=1, pid=731 2024-05-24T23:07:04.361834522Z [2024-05-24T23:07:04.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:06:00+00:00, map_index=-1, run_start_date=2024-05-24 23:07:02.054369+00:00, run_end_date=2024-05-24 23:07:03.714273+00:00, run_duration=1.659904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:07:00.291886+00:00, queued_by_job_id=1, pid=730 2024-05-24T23:08:00.615212639Z [2024-05-24T23:08:00.614+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:08:00+00:00, run_after=2024-05-24T23:09:00+00:00 2024-05-24T23:08:00.626217252Z [2024-05-24T23:08:00.625+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:08:00.641675065Z [2024-05-24T23:08:00.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:08:00+00:00, run_after=2024-05-24T23:09:00+00:00 2024-05-24T23:08:00.648734053Z [2024-05-24T23:08:00.648+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:08:00.754162318Z [2024-05-24T23:08:00.753+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:08:00.754187864Z 2024-05-24T23:08:00.754192235Z 2024-05-24T23:08:00.754196113Z 2024-05-24T23:08:00.754199297Z 2024-05-24T23:08:00.754473689Z [2024-05-24T23:08:00.754+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:08:00.754706641Z [2024-05-24T23:08:00.754+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:08:00.754892585Z [2024-05-24T23:08:00.754+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:08:00.755087191Z [2024-05-24T23:08:00.754+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:08:00.755770957Z [2024-05-24T23:08:00.755+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:08:00.755783596Z 2024-05-24T23:08:00.755787516Z 2024-05-24T23:08:00.755790762Z 2024-05-24T23:08:00.755793925Z 2024-05-24T23:08:00.760465974Z [2024-05-24T23:08:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:08:00.760574700Z [2024-05-24T23:08:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:08:00.760918002Z [2024-05-24T23:08:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:08:00.761195552Z [2024-05-24T23:08:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:08:00.761568860Z [2024-05-24T23:08:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:08:00.761825549Z [2024-05-24T23:08:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:08:00.762327617Z [2024-05-24T23:08:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:08:00.762413946Z [2024-05-24T23:08:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:08:01.047580980Z [2024-05-24T23:08:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:06:00+00:00 exited with status queued for try_number 1 2024-05-24T23:08:01.048074241Z [2024-05-24T23:08:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:07:00+00:00 exited with status queued for try_number 1 2024-05-24T23:08:01.048160793Z [2024-05-24T23:08:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:07:00+00:00 exited with status queued for try_number 1 2024-05-24T23:08:01.048305830Z [2024-05-24T23:08:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:07:00+00:00 exited with status queued for try_number 1 2024-05-24T23:08:01.063021711Z [2024-05-24T23:08:01.062+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d9a62a9-ac5f-4312-9e20-14ab3f789f8c 2024-05-24T23:08:01.063295916Z [2024-05-24T23:08:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b20886a-e3ee-45f0-8c1b-5b3594046bb3 2024-05-24T23:08:01.063532994Z [2024-05-24T23:08:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fb4da1d-21d2-4e98-b3fc-d44cdf5874e5 2024-05-24T23:08:01.063755413Z [2024-05-24T23:08:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48fb34bb-c6d7-47fe-a727-4d6ec9bd7250 2024-05-24T23:08:02.380197517Z [2024-05-24T23:08:02.379+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:08:02.380741880Z [2024-05-24T23:08:02.380+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:06:00+00:00, run_id=scheduled__2024-05-24T23:06:00+00:00, run_start_date=2024-05-24 23:08:00.659819+00:00, run_end_date=2024-05-24 23:08:02.380328+00:00, run_duration=1.720509, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:06:00+00:00, data_interval_end=2024-05-24 23:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:08:02.392732536Z [2024-05-24T23:08:02.392+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:08:00+00:00, run_after=2024-05-24T23:10:00+00:00 2024-05-24T23:08:02.406516802Z [2024-05-24T23:08:02.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:08:02.406763628Z [2024-05-24T23:08:02.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:07:00+00:00, run_id=scheduled__2024-05-24T23:07:00+00:00, run_start_date=2024-05-24 23:08:00.661116+00:00, run_end_date=2024-05-24 23:08:02.406514+00:00, run_duration=1.745398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:07:00+00:00, data_interval_end=2024-05-24 23:08:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:08:02.416568781Z [2024-05-24T23:08:02.416+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:08:00+00:00, run_after=2024-05-24T23:09:00+00:00 2024-05-24T23:08:02.497999492Z [2024-05-24T23:08:02.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:06:00+00:00 exited with status success for try_number 1 2024-05-24T23:08:02.498111401Z [2024-05-24T23:08:02.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:07:00+00:00 exited with status success for try_number 1 2024-05-24T23:08:02.504467123Z [2024-05-24T23:08:02.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:07:00+00:00, map_index=-1, run_start_date=2024-05-24 23:08:01.531705+00:00, run_end_date=2024-05-24 23:08:01.990329+00:00, run_duration=0.458624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:08:00.756754+00:00, queued_by_job_id=1, pid=764 2024-05-24T23:08:02.504771739Z [2024-05-24T23:08:02.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:06:00+00:00, map_index=-1, run_start_date=2024-05-24 23:08:01.806297+00:00, run_end_date=2024-05-24 23:08:02.255006+00:00, run_duration=0.448709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:08:00.756754+00:00, queued_by_job_id=1, pid=765 2024-05-24T23:08:04.673870883Z [2024-05-24T23:08:04.672+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:08:04.674138746Z [2024-05-24T23:08:04.673+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:07:00+00:00, run_id=scheduled__2024-05-24T23:07:00+00:00, run_start_date=2024-05-24 23:08:00.662282+00:00, run_end_date=2024-05-24 23:08:04.673639+00:00, run_duration=4.011357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:07:00+00:00, data_interval_end=2024-05-24 23:08:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:08:04.693656077Z [2024-05-24T23:08:04.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:08:00+00:00, run_after=2024-05-24T23:09:00+00:00 2024-05-24T23:08:04.755065106Z [2024-05-24T23:08:04.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:07:00+00:00 exited with status success for try_number 1 2024-05-24T23:08:04.765623567Z [2024-05-24T23:08:04.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:07:00+00:00, map_index=-1, run_start_date=2024-05-24 23:08:02.951262+00:00, run_end_date=2024-05-24 23:08:04.320754+00:00, run_duration=1.369492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:08:00.756754+00:00, queued_by_job_id=1, pid=789 2024-05-24T23:08:05.830036946Z [2024-05-24T23:08:05.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:08:05.830422578Z [2024-05-24T23:08:05.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:07:00+00:00, run_id=scheduled__2024-05-24T23:07:00+00:00, run_start_date=2024-05-24 23:08:00.663491+00:00, run_end_date=2024-05-24 23:08:05.829814+00:00, run_duration=5.166323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:07:00+00:00, data_interval_end=2024-05-24 23:08:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:08:05.848060796Z [2024-05-24T23:08:05.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:08:00+00:00, run_after=2024-05-24T23:09:00+00:00 2024-05-24T23:08:05.898123875Z [2024-05-24T23:08:05.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:07:00+00:00 exited with status success for try_number 1 2024-05-24T23:08:05.909143569Z [2024-05-24T23:08:05.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:07:00+00:00, map_index=-1, run_start_date=2024-05-24 23:08:02.882510+00:00, run_end_date=2024-05-24 23:08:04.831543+00:00, run_duration=1.949033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:08:00.756754+00:00, queued_by_job_id=1, pid=788 2024-05-24T23:09:00.142702113Z [2024-05-24T23:09:00.141+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:09:00.160785812Z [2024-05-24T23:09:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:09:00+00:00, run_after=2024-05-24T23:10:00+00:00 2024-05-24T23:09:00.187470689Z [2024-05-24T23:09:00.186+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:09:00+00:00, run_after=2024-05-24T23:10:00+00:00 2024-05-24T23:09:00.281416628Z [2024-05-24T23:09:00.280+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:09:00.281508041Z 2024-05-24T23:09:00.281513724Z 2024-05-24T23:09:00.281518409Z 2024-05-24T23:09:00.282839241Z [2024-05-24T23:09:00.281+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:09:00.283257020Z [2024-05-24T23:09:00.282+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:09:00.283541882Z [2024-05-24T23:09:00.283+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:09:00.285577266Z [2024-05-24T23:09:00.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:09:00.285593040Z 2024-05-24T23:09:00.285597969Z 2024-05-24T23:09:00.285602405Z 2024-05-24T23:09:00.293113855Z [2024-05-24T23:09:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:09:00.293169242Z [2024-05-24T23:09:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:09:00.293175034Z [2024-05-24T23:09:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:09:00.293179815Z [2024-05-24T23:09:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:09:00.293184766Z [2024-05-24T23:09:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:09:00.293204970Z [2024-05-24T23:09:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:09:00.756291295Z [2024-05-24T23:09:00.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:08:00+00:00 exited with status queued for try_number 1 2024-05-24T23:09:00.758213271Z [2024-05-24T23:09:00.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:08:00+00:00 exited with status queued for try_number 1 2024-05-24T23:09:00.758352515Z [2024-05-24T23:09:00.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:08:00+00:00 exited with status queued for try_number 1 2024-05-24T23:09:00.769204971Z [2024-05-24T23:09:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to e29323ed-1fe5-4cea-8ed0-d563c321c2b2 2024-05-24T23:09:00.773611380Z [2024-05-24T23:09:00.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d43fe0b-b7d3-4ba3-a1bb-1aa1b6e399fe 2024-05-24T23:09:00.773850627Z [2024-05-24T23:09:00.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68d6c60b-7171-4998-8403-fb26ebf8f9ac 2024-05-24T23:09:02.429888385Z [2024-05-24T23:09:02.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:09:02.432858207Z [2024-05-24T23:09:02.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:08:00+00:00, run_id=scheduled__2024-05-24T23:08:00+00:00, run_start_date=2024-05-24 23:09:00.203685+00:00, run_end_date=2024-05-24 23:09:02.429780+00:00, run_duration=2.226095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:08:00+00:00, data_interval_end=2024-05-24 23:09:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:09:02.463434053Z [2024-05-24T23:09:02.463+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:09:00+00:00, run_after=2024-05-24T23:10:00+00:00 2024-05-24T23:09:04.058132094Z [2024-05-24T23:09:04.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:08:00+00:00 exited with status success for try_number 1 2024-05-24T23:09:04.074307032Z [2024-05-24T23:09:04.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:08:00+00:00, map_index=-1, run_start_date=2024-05-24 23:09:01.305084+00:00, run_end_date=2024-05-24 23:09:02.277088+00:00, run_duration=0.972004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:09:00.287304+00:00, queued_by_job_id=1, pid=821 2024-05-24T23:09:06.266772516Z [2024-05-24T23:09:06.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:09:06.266933016Z [2024-05-24T23:09:06.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:08:00+00:00, run_id=scheduled__2024-05-24T23:08:00+00:00, run_start_date=2024-05-24 23:09:00.202348+00:00, run_end_date=2024-05-24 23:09:06.266687+00:00, run_duration=6.064339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:08:00+00:00, data_interval_end=2024-05-24 23:09:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:09:06.325620932Z [2024-05-24T23:09:06.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:09:00+00:00, run_after=2024-05-24T23:10:00+00:00 2024-05-24T23:09:07.589675991Z [2024-05-24T23:09:07.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:09:07.590229695Z [2024-05-24T23:09:07.589+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:08:00+00:00, run_id=scheduled__2024-05-24T23:08:00+00:00, run_start_date=2024-05-24 23:09:00.200734+00:00, run_end_date=2024-05-24 23:09:07.589705+00:00, run_duration=7.388971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:08:00+00:00, data_interval_end=2024-05-24 23:09:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:09:07.615929013Z [2024-05-24T23:09:07.615+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:09:00+00:00, run_after=2024-05-24T23:10:00+00:00 2024-05-24T23:09:07.653243175Z [2024-05-24T23:09:07.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:08:00+00:00 exited with status success for try_number 1 2024-05-24T23:09:07.653555458Z [2024-05-24T23:09:07.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:08:00+00:00 exited with status success for try_number 1 2024-05-24T23:09:07.662134772Z [2024-05-24T23:09:07.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:08:00+00:00, map_index=-1, run_start_date=2024-05-24 23:09:04.475650+00:00, run_end_date=2024-05-24 23:09:06.346562+00:00, run_duration=1.870912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:09:00.287304+00:00, queued_by_job_id=1, pid=834 2024-05-24T23:09:07.662722654Z [2024-05-24T23:09:07.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:08:00+00:00, map_index=-1, run_start_date=2024-05-24 23:09:04.797767+00:00, run_end_date=2024-05-24 23:09:06.130669+00:00, run_duration=1.332902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:09:00.287304+00:00, queued_by_job_id=1, pid=840 2024-05-24T23:10:00.885447159Z [2024-05-24T23:10:00.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:10:00+00:00, run_after=2024-05-24T23:15:00+00:00 2024-05-24T23:10:00.896354898Z [2024-05-24T23:10:00.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:10:00+00:00, run_after=2024-05-24T23:11:00+00:00 2024-05-24T23:10:00.903703862Z [2024-05-24T23:10:00.903+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:10:00.910213025Z [2024-05-24T23:10:00.909+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:10:00.921536071Z [2024-05-24T23:10:00.921+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:10:00+00:00, run_after=2024-05-24T23:11:00+00:00 2024-05-24T23:10:01.002712619Z [2024-05-24T23:10:01.002+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T23:10:01.002736877Z 2024-05-24T23:10:01.002740766Z 2024-05-24T23:10:01.002745756Z 2024-05-24T23:10:01.002748927Z 2024-05-24T23:10:01.002752143Z 2024-05-24T23:10:01.002980407Z [2024-05-24T23:10:01.002+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:10:01.003212146Z [2024-05-24T23:10:01.003+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:10:01.003431570Z [2024-05-24T23:10:01.003+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:10:01.003704728Z [2024-05-24T23:10:01.003+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:10:01.003908672Z [2024-05-24T23:10:01.003+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:10:01.004633123Z [2024-05-24T23:10:01.004+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:10:01.004644577Z 2024-05-24T23:10:01.004648778Z 2024-05-24T23:10:01.004652461Z 2024-05-24T23:10:01.004669331Z 2024-05-24T23:10:01.004672491Z 2024-05-24T23:10:01.014739792Z [2024-05-24T23:10:01.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:10:01.015600416Z [2024-05-24T23:10:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:10:01.016040247Z [2024-05-24T23:10:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:10:01.017113666Z [2024-05-24T23:10:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:10:01.017413989Z [2024-05-24T23:10:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:10:01.017531952Z [2024-05-24T23:10:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:10:01.017772653Z [2024-05-24T23:10:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:10:01.018177292Z [2024-05-24T23:10:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:10:01.018550467Z [2024-05-24T23:10:01.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:10:01.021453963Z [2024-05-24T23:10:01.021+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:10:01.590587893Z [2024-05-24T23:10:01.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 1 2024-05-24T23:10:01.591256780Z [2024-05-24T23:10:01.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:08:00+00:00 exited with status queued for try_number 1 2024-05-24T23:10:01.591404135Z [2024-05-24T23:10:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:09:00+00:00 exited with status queued for try_number 1 2024-05-24T23:10:01.591611104Z [2024-05-24T23:10:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:09:00+00:00 exited with status queued for try_number 1 2024-05-24T23:10:01.591745957Z [2024-05-24T23:10:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:09:00+00:00 exited with status queued for try_number 1 2024-05-24T23:10:01.629240681Z [2024-05-24T23:10:01.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49f1cb43-0708-4982-a765-c48cdbaa5361 2024-05-24T23:10:01.630761013Z [2024-05-24T23:10:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61934afb-ba29-4ff9-bbaf-bb16d6ffa91d 2024-05-24T23:10:01.637662596Z [2024-05-24T23:10:01.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 746754cf-e53c-4e78-a965-95f856e89975 2024-05-24T23:10:01.638231720Z [2024-05-24T23:10:01.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12d01a40-c56e-4b08-a568-09cac86ba611 2024-05-24T23:10:01.638505715Z [2024-05-24T23:10:01.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c823bfd-2637-46ec-ab8d-5409497009e3 2024-05-24T23:10:03.830748832Z [2024-05-24T23:10:03.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:10:03.831630309Z [2024-05-24T23:10:03.831+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:08:00+00:00, run_id=scheduled__2024-05-24T23:08:00+00:00, run_start_date=2024-05-24 23:10:00.932128+00:00, run_end_date=2024-05-24 23:10:03.831173+00:00, run_duration=2.899045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:08:00+00:00, data_interval_end=2024-05-24 23:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:10:03.840118218Z [2024-05-24T23:10:03.839+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:10:00+00:00, run_after=2024-05-24T23:12:00+00:00 2024-05-24T23:10:03.846367383Z [2024-05-24T23:10:03.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:10:03.846713296Z [2024-05-24T23:10:03.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:09:00+00:00, run_id=scheduled__2024-05-24T23:09:00+00:00, run_start_date=2024-05-24 23:10:00.935070+00:00, run_end_date=2024-05-24 23:10:03.846332+00:00, run_duration=2.911262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:09:00+00:00, data_interval_end=2024-05-24 23:10:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:10:03.868142857Z [2024-05-24T23:10:03.867+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:10:00+00:00, run_after=2024-05-24T23:11:00+00:00 2024-05-24T23:10:04.042624833Z [2024-05-24T23:10:04.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:08:00+00:00 exited with status success for try_number 1 2024-05-24T23:10:04.042714355Z [2024-05-24T23:10:04.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:09:00+00:00 exited with status success for try_number 1 2024-05-24T23:10:04.057626567Z [2024-05-24T23:10:04.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:08:00+00:00, map_index=-1, run_start_date=2024-05-24 23:10:02.648082+00:00, run_end_date=2024-05-24 23:10:03.438577+00:00, run_duration=0.790495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:10:01.005955+00:00, queued_by_job_id=1, pid=874 2024-05-24T23:10:04.057762419Z [2024-05-24T23:10:04.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:09:00+00:00, map_index=-1, run_start_date=2024-05-24 23:10:02.650989+00:00, run_end_date=2024-05-24 23:10:03.576072+00:00, run_duration=0.925083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:10:01.005955+00:00, queued_by_job_id=1, pid=875 2024-05-24T23:10:05.775774330Z [2024-05-24T23:10:05.775+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:10:05.775828866Z 2024-05-24T23:10:05.775845180Z [2024-05-24T23:10:05.775+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:10:05.776740652Z [2024-05-24T23:10:05.776+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:10:05.776754361Z 2024-05-24T23:10:05.780026142Z [2024-05-24T23:10:05.779+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:10:05.780167881Z [2024-05-24T23:10:05.779+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:10:05.850530320Z [2024-05-24T23:10:05.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 1 2024-05-24T23:10:05.850872854Z [2024-05-24T23:10:05.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status success for try_number 1 2024-05-24T23:10:05.861833493Z [2024-05-24T23:10:05.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=2024-05-24 23:10:04.583911+00:00, run_end_date=2024-05-24 23:10:05.132944+00:00, run_duration=0.549033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:10:01.005955+00:00, queued_by_job_id=1, pid=899 2024-05-24T23:10:05.862279061Z [2024-05-24T23:10:05.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to 697c4722-87be-4d24-8173-90380de99021 2024-05-24T23:10:07.008373016Z [2024-05-24T23:10:07.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:10:07.008659832Z [2024-05-24T23:10:07.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:09:00+00:00, run_id=scheduled__2024-05-24T23:09:00+00:00, run_start_date=2024-05-24 23:10:00.934115+00:00, run_end_date=2024-05-24 23:10:07.008275+00:00, run_duration=6.07416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:09:00+00:00, data_interval_end=2024-05-24 23:10:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:10:07.021182547Z [2024-05-24T23:10:07.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:10:00+00:00, run_after=2024-05-24T23:11:00+00:00 2024-05-24T23:10:07.102428001Z [2024-05-24T23:10:07.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:09:00+00:00 exited with status success for try_number 1 2024-05-24T23:10:07.111263832Z [2024-05-24T23:10:07.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:09:00+00:00, map_index=-1, run_start_date=2024-05-24 23:10:04.718093+00:00, run_end_date=2024-05-24 23:10:06.316966+00:00, run_duration=1.598873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:10:01.005955+00:00, queued_by_job_id=1, pid=905 2024-05-24T23:10:08.169216302Z [2024-05-24T23:10:08.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:10:08.169597156Z [2024-05-24T23:10:08.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:09:00+00:00, run_id=scheduled__2024-05-24T23:09:00+00:00, run_start_date=2024-05-24 23:10:00.933102+00:00, run_end_date=2024-05-24 23:10:08.169122+00:00, run_duration=7.23602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:09:00+00:00, data_interval_end=2024-05-24 23:10:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:10:08.178731992Z [2024-05-24T23:10:08.178+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:10:00+00:00, run_after=2024-05-24T23:11:00+00:00 2024-05-24T23:10:08.226429371Z [2024-05-24T23:10:08.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:09:00+00:00 exited with status success for try_number 1 2024-05-24T23:10:08.236434933Z [2024-05-24T23:10:08.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:09:00+00:00, map_index=-1, run_start_date=2024-05-24 23:10:04.986091+00:00, run_end_date=2024-05-24 23:10:07.473499+00:00, run_duration=2.487408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:10:01.005955+00:00, queued_by_job_id=1, pid=912 2024-05-24T23:10:09.159208242Z [2024-05-24T23:10:09.158+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:10:09.159257806Z 2024-05-24T23:10:09.160281479Z [2024-05-24T23:10:09.159+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:10:09.162042561Z [2024-05-24T23:10:09.161+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:10:09.162069847Z 2024-05-24T23:10:09.166488002Z [2024-05-24T23:10:09.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:10:09.166977030Z [2024-05-24T23:10:09.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:10:09.217569018Z [2024-05-24T23:10:09.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 1 2024-05-24T23:10:09.217684244Z [2024-05-24T23:10:09.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status success for try_number 1 2024-05-24T23:10:09.228106156Z [2024-05-24T23:10:09.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=2024-05-24 23:10:07.521931+00:00, run_end_date=2024-05-24 23:10:08.107620+00:00, run_duration=0.585689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:10:05.777319+00:00, queued_by_job_id=1, pid=940 2024-05-24T23:10:09.228476577Z [2024-05-24T23:10:09.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3258f169-3f1d-4bd2-9532-dc3e83d9a2e7 2024-05-24T23:10:11.553749546Z [2024-05-24T23:10:11.553+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:10:11.553924273Z 2024-05-24T23:10:11.553970414Z [2024-05-24T23:10:11.553+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:10:11.554406279Z [2024-05-24T23:10:11.554+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:10:11.554453354Z 2024-05-24T23:10:11.556596041Z [2024-05-24T23:10:11.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:10:11.556648337Z [2024-05-24T23:10:11.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:10:11.631122436Z [2024-05-24T23:10:11.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status queued for try_number 1 2024-05-24T23:10:11.631232074Z [2024-05-24T23:10:11.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status success for try_number 1 2024-05-24T23:10:11.639143450Z [2024-05-24T23:10:11.638+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=0, run_start_date=2024-05-24 23:10:10.813953+00:00, run_end_date=2024-05-24 23:10:11.187295+00:00, run_duration=0.373342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:10:09.163159+00:00, queued_by_job_id=1, pid=951 2024-05-24T23:10:11.639302239Z [2024-05-24T23:10:11.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to 349e44c4-7fcd-42fa-b1d1-9e61b11c418c 2024-05-24T23:10:14.318714331Z [2024-05-24T23:10:14.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:10:14.319125353Z [2024-05-24T23:10:14.318+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:05:00+00:00, run_id=scheduled__2024-05-24T23:05:00+00:00, run_start_date=2024-05-24 23:10:00.930769+00:00, run_end_date=2024-05-24 23:10:14.318451+00:00, run_duration=13.387682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:05:00+00:00, data_interval_end=2024-05-24 23:10:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-24T23:10:14.329616693Z [2024-05-24T23:10:14.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:10:00+00:00, run_after=2024-05-24T23:15:00+00:00 2024-05-24T23:10:14.374180290Z [2024-05-24T23:10:14.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:05:00+00:00 exited with status success for try_number 1 2024-05-24T23:10:14.383109998Z [2024-05-24T23:10:14.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:05:00+00:00, map_index=-1, run_start_date=2024-05-24 23:10:13.458284+00:00, run_end_date=2024-05-24 23:10:13.896145+00:00, run_duration=0.437861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:10:11.554677+00:00, queued_by_job_id=1, pid=959 2024-05-24T23:10:27.301897700Z [2024-05-24T23:10:27.301+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T23:11:01.071292683Z [2024-05-24T23:11:01.070+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:11:01.090907964Z [2024-05-24T23:11:01.090+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:11:00+00:00, run_after=2024-05-24T23:12:00+00:00 2024-05-24T23:11:01.105385801Z [2024-05-24T23:11:01.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:11:00+00:00, run_after=2024-05-24T23:12:00+00:00 2024-05-24T23:11:01.200736060Z [2024-05-24T23:11:01.200+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:11:01.200775062Z 2024-05-24T23:11:01.200780813Z 2024-05-24T23:11:01.200785801Z 2024-05-24T23:11:01.200919234Z [2024-05-24T23:11:01.200+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:11:01.201135676Z [2024-05-24T23:11:01.200+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:11:01.201320330Z [2024-05-24T23:11:01.201+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:11:01.201957291Z [2024-05-24T23:11:01.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:11:01.201970511Z 2024-05-24T23:11:01.201975198Z 2024-05-24T23:11:01.201979400Z 2024-05-24T23:11:01.205171384Z [2024-05-24T23:11:01.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:11:01.205410167Z [2024-05-24T23:11:01.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:11:01.205737605Z [2024-05-24T23:11:01.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:11:01.205922266Z [2024-05-24T23:11:01.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:11:01.206178482Z [2024-05-24T23:11:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:11:01.206374639Z [2024-05-24T23:11:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:11:01.473469679Z [2024-05-24T23:11:01.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status queued for try_number 1 2024-05-24T23:11:01.473895710Z [2024-05-24T23:11:01.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status queued for try_number 1 2024-05-24T23:11:01.474051824Z [2024-05-24T23:11:01.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status queued for try_number 1 2024-05-24T23:11:01.482676296Z [2024-05-24T23:11:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0321c924-ca28-4933-9f70-bc7429f518a8 2024-05-24T23:11:01.482946792Z [2024-05-24T23:11:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9674eb56-9080-4fc0-9aa1-05200aeaec96 2024-05-24T23:11:01.483105487Z [2024-05-24T23:11:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71c22375-5cb0-4506-8f6c-2eb53411aa4e 2024-05-24T23:11:03.400741940Z [2024-05-24T23:11:03.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:11:03.400885513Z [2024-05-24T23:11:03.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:10:00+00:00, run_id=scheduled__2024-05-24T23:10:00+00:00, run_start_date=2024-05-24 23:11:01.120525+00:00, run_end_date=2024-05-24 23:11:03.400476+00:00, run_duration=2.279951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:10:00+00:00, data_interval_end=2024-05-24 23:11:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:11:03.412174811Z [2024-05-24T23:11:03.411+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:11:00+00:00, run_after=2024-05-24T23:12:00+00:00 2024-05-24T23:11:03.491423894Z [2024-05-24T23:11:03.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status success for try_number 1 2024-05-24T23:11:03.503033937Z [2024-05-24T23:11:03.502+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:10:00+00:00, map_index=-1, run_start_date=2024-05-24 23:11:02.062903+00:00, run_end_date=2024-05-24 23:11:02.499780+00:00, run_duration=0.436877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:11:01.202845+00:00, queued_by_job_id=1, pid=968 2024-05-24T23:11:05.022616723Z [2024-05-24T23:11:05.022+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:11:05.023248889Z [2024-05-24T23:11:05.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:10:00+00:00, run_id=scheduled__2024-05-24T23:10:00+00:00, run_start_date=2024-05-24 23:11:01.122234+00:00, run_end_date=2024-05-24 23:11:05.022696+00:00, run_duration=3.900462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:10:00+00:00, data_interval_end=2024-05-24 23:11:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:11:05.033364731Z [2024-05-24T23:11:05.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:11:00+00:00, run_after=2024-05-24T23:12:00+00:00 2024-05-24T23:11:05.085884759Z [2024-05-24T23:11:05.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status success for try_number 1 2024-05-24T23:11:05.092861274Z [2024-05-24T23:11:05.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:10:00+00:00, map_index=-1, run_start_date=2024-05-24 23:11:03.120614+00:00, run_end_date=2024-05-24 23:11:04.640995+00:00, run_duration=1.520381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:11:01.202845+00:00, queued_by_job_id=1, pid=986 2024-05-24T23:11:06.152124598Z [2024-05-24T23:11:06.151+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:11:06.152274164Z [2024-05-24T23:11:06.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:10:00+00:00, run_id=scheduled__2024-05-24T23:10:00+00:00, run_start_date=2024-05-24 23:11:01.119015+00:00, run_end_date=2024-05-24 23:11:06.151973+00:00, run_duration=5.032958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:10:00+00:00, data_interval_end=2024-05-24 23:11:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:11:06.162045893Z [2024-05-24T23:11:06.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:11:00+00:00, run_after=2024-05-24T23:12:00+00:00 2024-05-24T23:11:06.195650520Z [2024-05-24T23:11:06.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status success for try_number 1 2024-05-24T23:11:06.203484291Z [2024-05-24T23:11:06.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:10:00+00:00, map_index=-1, run_start_date=2024-05-24 23:11:03.325744+00:00, run_end_date=2024-05-24 23:11:05.063501+00:00, run_duration=1.737757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:11:01.202845+00:00, queued_by_job_id=1, pid=987 2024-05-24T23:12:00.856940847Z [2024-05-24T23:12:00.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:12:00+00:00, run_after=2024-05-24T23:13:00+00:00 2024-05-24T23:12:00.866273145Z [2024-05-24T23:12:00.865+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:12:00.879105083Z [2024-05-24T23:12:00.878+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:12:00+00:00, run_after=2024-05-24T23:13:00+00:00 2024-05-24T23:12:00.886770930Z [2024-05-24T23:12:00.886+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:12:00.972172200Z [2024-05-24T23:12:00.971+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:12:00.972213480Z 2024-05-24T23:12:00.972223337Z 2024-05-24T23:12:00.972231973Z 2024-05-24T23:12:00.972241153Z 2024-05-24T23:12:00.972249870Z [2024-05-24T23:12:00.971+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:12:00.972412927Z [2024-05-24T23:12:00.972+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:12:00.972519836Z [2024-05-24T23:12:00.972+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:12:00.972740323Z [2024-05-24T23:12:00.972+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:12:00.973357820Z [2024-05-24T23:12:00.973+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:12:00.973374056Z 2024-05-24T23:12:00.973382078Z 2024-05-24T23:12:00.973388653Z 2024-05-24T23:12:00.973395158Z 2024-05-24T23:12:00.976566170Z [2024-05-24T23:12:00.976+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:12:00.976747331Z [2024-05-24T23:12:00.976+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:12:00.977082187Z [2024-05-24T23:12:00.976+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:12:00.977091444Z [2024-05-24T23:12:00.976+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:12:00.977446589Z [2024-05-24T23:12:00.977+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:12:00.977587377Z [2024-05-24T23:12:00.977+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:12:00.977883034Z [2024-05-24T23:12:00.977+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:12:00.977911726Z [2024-05-24T23:12:00.977+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:12:01.320448652Z [2024-05-24T23:12:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status queued for try_number 1 2024-05-24T23:12:01.320708451Z [2024-05-24T23:12:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:11:00+00:00 exited with status queued for try_number 1 2024-05-24T23:12:01.320855277Z [2024-05-24T23:12:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:11:00+00:00 exited with status queued for try_number 1 2024-05-24T23:12:01.321005917Z [2024-05-24T23:12:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:11:00+00:00 exited with status queued for try_number 1 2024-05-24T23:12:01.341907055Z [2024-05-24T23:12:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5581f59a-39fb-4097-afc7-7d4751aef2ae 2024-05-24T23:12:01.341938032Z [2024-05-24T23:12:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d1f9577-dfd2-4c72-9e9b-73a3189d3e7c 2024-05-24T23:12:01.341941678Z [2024-05-24T23:12:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb3e81c3-c383-4fe9-9761-ca4baf7996cc 2024-05-24T23:12:01.341944885Z [2024-05-24T23:12:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6873ac85-6389-487c-aa0a-8e034fbd4804 2024-05-24T23:12:02.583900078Z [2024-05-24T23:12:02.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:12:02.584331880Z [2024-05-24T23:12:02.584+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:10:00+00:00, run_id=scheduled__2024-05-24T23:10:00+00:00, run_start_date=2024-05-24 23:12:00.899322+00:00, run_end_date=2024-05-24 23:12:02.583844+00:00, run_duration=1.684522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:10:00+00:00, data_interval_end=2024-05-24 23:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:12:02.608002986Z [2024-05-24T23:12:02.607+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:12:00+00:00, run_after=2024-05-24T23:14:00+00:00 2024-05-24T23:12:02.641328602Z [2024-05-24T23:12:02.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:12:02.641683779Z [2024-05-24T23:12:02.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:11:00+00:00, run_id=scheduled__2024-05-24T23:11:00+00:00, run_start_date=2024-05-24 23:12:00.901791+00:00, run_end_date=2024-05-24 23:12:02.641265+00:00, run_duration=1.739474, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:11:00+00:00, data_interval_end=2024-05-24 23:12:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:12:02.652812903Z [2024-05-24T23:12:02.652+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:12:00+00:00, run_after=2024-05-24T23:13:00+00:00 2024-05-24T23:12:02.683418567Z [2024-05-24T23:12:02.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status success for try_number 1 2024-05-24T23:12:02.683496303Z [2024-05-24T23:12:02.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:11:00+00:00 exited with status success for try_number 1 2024-05-24T23:12:02.690850221Z [2024-05-24T23:12:02.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:10:00+00:00, map_index=-1, run_start_date=2024-05-24 23:12:01.767327+00:00, run_end_date=2024-05-24 23:12:02.136187+00:00, run_duration=0.36886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:12:00.974128+00:00, queued_by_job_id=1, pid=1017 2024-05-24T23:12:02.691024376Z [2024-05-24T23:12:02.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:11:00+00:00, map_index=-1, run_start_date=2024-05-24 23:12:01.981754+00:00, run_end_date=2024-05-24 23:12:02.428564+00:00, run_duration=0.44681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:12:00.974128+00:00, queued_by_job_id=1, pid=1021 2024-05-24T23:12:04.867873488Z [2024-05-24T23:12:04.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:12:04.868242702Z [2024-05-24T23:12:04.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:11:00+00:00, run_id=scheduled__2024-05-24T23:11:00+00:00, run_start_date=2024-05-24 23:12:00.903164+00:00, run_end_date=2024-05-24 23:12:04.867606+00:00, run_duration=3.964442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:11:00+00:00, data_interval_end=2024-05-24 23:12:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:12:04.878927037Z [2024-05-24T23:12:04.878+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:12:00+00:00, run_after=2024-05-24T23:13:00+00:00 2024-05-24T23:12:04.888675365Z [2024-05-24T23:12:04.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:12:04.889122818Z [2024-05-24T23:12:04.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:11:00+00:00, run_id=scheduled__2024-05-24T23:11:00+00:00, run_start_date=2024-05-24 23:12:00.900632+00:00, run_end_date=2024-05-24 23:12:04.888548+00:00, run_duration=3.987916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:11:00+00:00, data_interval_end=2024-05-24 23:12:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:12:04.901494653Z [2024-05-24T23:12:04.900+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:12:00+00:00, run_after=2024-05-24T23:13:00+00:00 2024-05-24T23:12:04.946180470Z [2024-05-24T23:12:04.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:11:00+00:00 exited with status success for try_number 1 2024-05-24T23:12:04.952129522Z [2024-05-24T23:12:04.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:11:00+00:00, map_index=-1, run_start_date=2024-05-24 23:12:02.975582+00:00, run_end_date=2024-05-24 23:12:04.421917+00:00, run_duration=1.446335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:12:00.974128+00:00, queued_by_job_id=1, pid=1045 2024-05-24T23:12:05.534350358Z [2024-05-24T23:12:05.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:11:00+00:00 exited with status success for try_number 1 2024-05-24T23:12:05.549758413Z [2024-05-24T23:12:05.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:11:00+00:00, map_index=-1, run_start_date=2024-05-24 23:12:02.963404+00:00, run_end_date=2024-05-24 23:12:04.838625+00:00, run_duration=1.875221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:12:00.974128+00:00, queued_by_job_id=1, pid=1044 2024-05-24T23:13:00.364249902Z [2024-05-24T23:13:00.363+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:13:00.382427600Z [2024-05-24T23:13:00.382+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:13:00+00:00, run_after=2024-05-24T23:14:00+00:00 2024-05-24T23:13:00.413030521Z [2024-05-24T23:13:00.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:13:00+00:00, run_after=2024-05-24T23:14:00+00:00 2024-05-24T23:13:00.482913015Z [2024-05-24T23:13:00.482+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:13:00.482944411Z 2024-05-24T23:13:00.482949969Z 2024-05-24T23:13:00.482954553Z 2024-05-24T23:13:00.483104382Z [2024-05-24T23:13:00.482+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:13:00.483320419Z [2024-05-24T23:13:00.483+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:13:00.483494851Z [2024-05-24T23:13:00.483+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:13:00.484117995Z [2024-05-24T23:13:00.483+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:13:00.484125017Z 2024-05-24T23:13:00.484128138Z 2024-05-24T23:13:00.484131075Z 2024-05-24T23:13:00.487389574Z [2024-05-24T23:13:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:13:00.487585704Z [2024-05-24T23:13:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:13:00.487893590Z [2024-05-24T23:13:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:13:00.488070004Z [2024-05-24T23:13:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:13:00.488339822Z [2024-05-24T23:13:00.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:13:00.488511553Z [2024-05-24T23:13:00.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:13:00.721326515Z [2024-05-24T23:13:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:12:00+00:00 exited with status queued for try_number 1 2024-05-24T23:13:00.721512988Z [2024-05-24T23:13:00.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:12:00+00:00 exited with status queued for try_number 1 2024-05-24T23:13:00.721653940Z [2024-05-24T23:13:00.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:12:00+00:00 exited with status queued for try_number 1 2024-05-24T23:13:00.729887783Z [2024-05-24T23:13:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c011c0a-1765-4169-86dd-268eadc8ca33 2024-05-24T23:13:00.730196673Z [2024-05-24T23:13:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56bbf6b8-a531-4f7e-ac53-22ed82eb4a8f 2024-05-24T23:13:00.730442216Z [2024-05-24T23:13:00.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2b08c41-8257-4c0e-ba5d-1aaa38917314 2024-05-24T23:13:01.914389453Z [2024-05-24T23:13:01.913+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:13:01.914965085Z [2024-05-24T23:13:01.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:12:00+00:00, run_id=scheduled__2024-05-24T23:12:00+00:00, run_start_date=2024-05-24 23:13:00.430097+00:00, run_end_date=2024-05-24 23:13:01.914531+00:00, run_duration=1.484434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:12:00+00:00, data_interval_end=2024-05-24 23:13:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:13:01.925805202Z [2024-05-24T23:13:01.925+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:13:00+00:00, run_after=2024-05-24T23:14:00+00:00 2024-05-24T23:13:01.974187712Z [2024-05-24T23:13:01.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:12:00+00:00 exited with status success for try_number 1 2024-05-24T23:13:01.980715941Z [2024-05-24T23:13:01.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:12:00+00:00, map_index=-1, run_start_date=2024-05-24 23:13:01.271347+00:00, run_end_date=2024-05-24 23:13:01.768798+00:00, run_duration=0.497451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:13:00.484824+00:00, queued_by_job_id=1, pid=1077 2024-05-24T23:13:05.213599136Z [2024-05-24T23:13:05.213+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:13:05.213966683Z [2024-05-24T23:13:05.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:12:00+00:00, run_id=scheduled__2024-05-24T23:12:00+00:00, run_start_date=2024-05-24 23:13:00.428535+00:00, run_end_date=2024-05-24 23:13:05.213471+00:00, run_duration=4.784936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:12:00+00:00, data_interval_end=2024-05-24 23:13:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:13:05.222188458Z [2024-05-24T23:13:05.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:13:00+00:00, run_after=2024-05-24T23:14:00+00:00 2024-05-24T23:13:05.228797563Z [2024-05-24T23:13:05.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:13:05.229191779Z [2024-05-24T23:13:05.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:12:00+00:00, run_id=scheduled__2024-05-24T23:12:00+00:00, run_start_date=2024-05-24 23:13:00.431392+00:00, run_end_date=2024-05-24 23:13:05.228676+00:00, run_duration=4.797284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:12:00+00:00, data_interval_end=2024-05-24 23:13:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:13:05.243110388Z [2024-05-24T23:13:05.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:13:00+00:00, run_after=2024-05-24T23:14:00+00:00 2024-05-24T23:13:05.933698829Z [2024-05-24T23:13:05.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:12:00+00:00 exited with status success for try_number 1 2024-05-24T23:13:05.933817294Z [2024-05-24T23:13:05.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:12:00+00:00 exited with status success for try_number 1 2024-05-24T23:13:05.940463282Z [2024-05-24T23:13:05.939+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:12:00+00:00, map_index=-1, run_start_date=2024-05-24 23:13:02.222744+00:00, run_end_date=2024-05-24 23:13:05.141405+00:00, run_duration=2.918661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:13:00.484824+00:00, queued_by_job_id=1, pid=1090 2024-05-24T23:13:05.941073520Z [2024-05-24T23:13:05.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:12:00+00:00, map_index=-1, run_start_date=2024-05-24 23:13:02.550689+00:00, run_end_date=2024-05-24 23:13:05.163421+00:00, run_duration=2.612732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:13:00.484824+00:00, queued_by_job_id=1, pid=1101 2024-05-24T23:14:00.242253236Z [2024-05-24T23:14:00.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:14:00+00:00, run_after=2024-05-24T23:15:00+00:00 2024-05-24T23:14:00.254556848Z [2024-05-24T23:14:00.254+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:14:00.267313700Z [2024-05-24T23:14:00.266+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:14:00.282600060Z [2024-05-24T23:14:00.282+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:14:00+00:00, run_after=2024-05-24T23:15:00+00:00 2024-05-24T23:14:00.394350255Z [2024-05-24T23:14:00.393+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:14:00.394379575Z 2024-05-24T23:14:00.394385121Z 2024-05-24T23:14:00.394416555Z 2024-05-24T23:14:00.394421270Z 2024-05-24T23:14:00.394898604Z [2024-05-24T23:14:00.394+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:14:00.395135743Z [2024-05-24T23:14:00.394+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:14:00.395374913Z [2024-05-24T23:14:00.395+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:14:00.395622425Z [2024-05-24T23:14:00.395+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:14:00.396380860Z [2024-05-24T23:14:00.396+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:14:00.396389959Z 2024-05-24T23:14:00.396393315Z 2024-05-24T23:14:00.396396419Z 2024-05-24T23:14:00.396399434Z 2024-05-24T23:14:00.400568804Z [2024-05-24T23:14:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:14:00.400800901Z [2024-05-24T23:14:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:14:00.401094961Z [2024-05-24T23:14:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:14:00.401322379Z [2024-05-24T23:14:00.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:14:00.401708636Z [2024-05-24T23:14:00.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:14:00.401918199Z [2024-05-24T23:14:00.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:14:00.402226520Z [2024-05-24T23:14:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:14:00.402344407Z [2024-05-24T23:14:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:14:00.940618596Z [2024-05-24T23:14:00.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:12:00+00:00 exited with status queued for try_number 1 2024-05-24T23:14:00.940820111Z [2024-05-24T23:14:00.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:13:00+00:00 exited with status queued for try_number 1 2024-05-24T23:14:00.940989179Z [2024-05-24T23:14:00.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:13:00+00:00 exited with status queued for try_number 1 2024-05-24T23:14:00.941573027Z [2024-05-24T23:14:00.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:13:00+00:00 exited with status queued for try_number 1 2024-05-24T23:14:00.949869421Z [2024-05-24T23:14:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb2822ba-824b-431f-b0c1-094d45497995 2024-05-24T23:14:00.949888733Z [2024-05-24T23:14:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 657bfd35-c289-49a4-8f04-bb83408a50a6 2024-05-24T23:14:00.949951173Z [2024-05-24T23:14:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fcc312d-1ebd-44ce-9a79-52e518158b2c 2024-05-24T23:14:00.950364665Z [2024-05-24T23:14:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68eb8671-8bf2-423e-9cc0-7e1c662f0aed 2024-05-24T23:14:03.198795625Z [2024-05-24T23:14:03.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:14:03.199028726Z [2024-05-24T23:14:03.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:12:00+00:00, run_id=scheduled__2024-05-24T23:12:00+00:00, run_start_date=2024-05-24 23:14:00.295566+00:00, run_end_date=2024-05-24 23:14:03.198693+00:00, run_duration=2.903127, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:12:00+00:00, data_interval_end=2024-05-24 23:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:14:03.208641903Z [2024-05-24T23:14:03.208+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:14:00+00:00, run_after=2024-05-24T23:16:00+00:00 2024-05-24T23:14:03.222573714Z [2024-05-24T23:14:03.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:14:03.222742047Z [2024-05-24T23:14:03.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:13:00+00:00, run_id=scheduled__2024-05-24T23:13:00+00:00, run_start_date=2024-05-24 23:14:00.299392+00:00, run_end_date=2024-05-24 23:14:03.222501+00:00, run_duration=2.923109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:13:00+00:00, data_interval_end=2024-05-24 23:14:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:14:03.243166545Z [2024-05-24T23:14:03.242+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:14:00+00:00, run_after=2024-05-24T23:15:00+00:00 2024-05-24T23:14:03.342397215Z [2024-05-24T23:14:03.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:12:00+00:00 exited with status success for try_number 1 2024-05-24T23:14:03.342441338Z [2024-05-24T23:14:03.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:13:00+00:00 exited with status success for try_number 1 2024-05-24T23:14:03.349198218Z [2024-05-24T23:14:03.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:12:00+00:00, map_index=-1, run_start_date=2024-05-24 23:14:01.659799+00:00, run_end_date=2024-05-24 23:14:02.872101+00:00, run_duration=1.212302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:14:00.397359+00:00, queued_by_job_id=1, pid=1130 2024-05-24T23:14:03.349577131Z [2024-05-24T23:14:03.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:13:00+00:00, map_index=-1, run_start_date=2024-05-24 23:14:01.633102+00:00, run_end_date=2024-05-24 23:14:02.859136+00:00, run_duration=1.226034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:14:00.397359+00:00, queued_by_job_id=1, pid=1129 2024-05-24T23:14:06.423565884Z [2024-05-24T23:14:06.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:14:06.423745664Z [2024-05-24T23:14:06.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:13:00+00:00, run_id=scheduled__2024-05-24T23:13:00+00:00, run_start_date=2024-05-24 23:14:00.297061+00:00, run_end_date=2024-05-24 23:14:06.423455+00:00, run_duration=6.126394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:13:00+00:00, data_interval_end=2024-05-24 23:14:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:14:06.433390396Z [2024-05-24T23:14:06.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:14:00+00:00, run_after=2024-05-24T23:15:00+00:00 2024-05-24T23:14:06.444864757Z [2024-05-24T23:14:06.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:14:06.445055466Z [2024-05-24T23:14:06.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:13:00+00:00, run_id=scheduled__2024-05-24T23:13:00+00:00, run_start_date=2024-05-24 23:14:00.298292+00:00, run_end_date=2024-05-24 23:14:06.444780+00:00, run_duration=6.146488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:13:00+00:00, data_interval_end=2024-05-24 23:14:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:14:06.455899735Z [2024-05-24T23:14:06.455+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:14:00+00:00, run_after=2024-05-24T23:15:00+00:00 2024-05-24T23:14:06.514558538Z [2024-05-24T23:14:06.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:13:00+00:00 exited with status success for try_number 1 2024-05-24T23:14:06.514581633Z [2024-05-24T23:14:06.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:13:00+00:00 exited with status success for try_number 1 2024-05-24T23:14:06.527921987Z [2024-05-24T23:14:06.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:13:00+00:00, map_index=-1, run_start_date=2024-05-24 23:14:03.339634+00:00, run_end_date=2024-05-24 23:14:05.640301+00:00, run_duration=2.300667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:14:00.397359+00:00, queued_by_job_id=1, pid=1159 2024-05-24T23:14:06.527941789Z [2024-05-24T23:14:06.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:13:00+00:00, map_index=-1, run_start_date=2024-05-24 23:14:02.813805+00:00, run_end_date=2024-05-24 23:14:06.010277+00:00, run_duration=3.196472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:14:00.397359+00:00, queued_by_job_id=1, pid=1148 2024-05-24T23:15:00.201154096Z [2024-05-24T23:15:00.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:15:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:15:00.218994897Z [2024-05-24T23:15:00.218+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:15:00+00:00, run_after=2024-05-24T23:16:00+00:00 2024-05-24T23:15:00.227474878Z [2024-05-24T23:15:00.227+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:15:00.240522301Z [2024-05-24T23:15:00.240+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:15:00+00:00, run_after=2024-05-24T23:16:00+00:00 2024-05-24T23:15:00.347332136Z [2024-05-24T23:15:00.346+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:15:00.347362219Z 2024-05-24T23:15:00.347371191Z 2024-05-24T23:15:00.347398658Z 2024-05-24T23:15:00.347403436Z 2024-05-24T23:15:00.347629745Z [2024-05-24T23:15:00.347+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:15:00.347891534Z [2024-05-24T23:15:00.347+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:15:00.348182406Z [2024-05-24T23:15:00.347+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:15:00.348392748Z [2024-05-24T23:15:00.348+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:15:00.349432589Z [2024-05-24T23:15:00.349+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:15:00.349451988Z 2024-05-24T23:15:00.349457734Z 2024-05-24T23:15:00.349462953Z 2024-05-24T23:15:00.349467762Z 2024-05-24T23:15:00.355926654Z [2024-05-24T23:15:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:15:00.356272579Z [2024-05-24T23:15:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:15:00.356774229Z [2024-05-24T23:15:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:15:00.357035939Z [2024-05-24T23:15:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:15:00.357836833Z [2024-05-24T23:15:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:15:00.358295463Z [2024-05-24T23:15:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:15:00.358797243Z [2024-05-24T23:15:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:15:00.359090366Z [2024-05-24T23:15:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:15:00.669827476Z [2024-05-24T23:15:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status queued for try_number 1 2024-05-24T23:15:00.669959793Z [2024-05-24T23:15:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:14:00+00:00 exited with status queued for try_number 1 2024-05-24T23:15:00.670129103Z [2024-05-24T23:15:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:14:00+00:00 exited with status queued for try_number 1 2024-05-24T23:15:00.670223075Z [2024-05-24T23:15:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:14:00+00:00 exited with status queued for try_number 1 2024-05-24T23:15:00.685518945Z [2024-05-24T23:15:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to a60a5c9e-e9bc-49b3-8149-cc4d34c749ed 2024-05-24T23:15:00.685970311Z [2024-05-24T23:15:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 696c5af0-7479-4d30-a0e0-0e23a9cfd202 2024-05-24T23:15:00.686692052Z [2024-05-24T23:15:00.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8634883a-5ba5-45e4-8925-1f83239a466d 2024-05-24T23:15:00.687237202Z [2024-05-24T23:15:00.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad573d67-cd6c-4c1a-90a1-8ddb8703f4bc 2024-05-24T23:15:01.851358926Z [2024-05-24T23:15:01.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:15:01.851766961Z [2024-05-24T23:15:01.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:14:00+00:00, run_id=scheduled__2024-05-24T23:14:00+00:00, run_start_date=2024-05-24 23:15:00.255106+00:00, run_end_date=2024-05-24 23:15:01.851271+00:00, run_duration=1.596165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:14:00+00:00, data_interval_end=2024-05-24 23:15:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:15:01.862161226Z [2024-05-24T23:15:01.861+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:15:00+00:00, run_after=2024-05-24T23:16:00+00:00 2024-05-24T23:15:01.917761678Z [2024-05-24T23:15:01.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:14:00+00:00 exited with status success for try_number 1 2024-05-24T23:15:01.922462488Z [2024-05-24T23:15:01.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:14:00+00:00, map_index=-1, run_start_date=2024-05-24 23:15:01.213072+00:00, run_end_date=2024-05-24 23:15:01.607455+00:00, run_duration=0.394383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:15:00.351065+00:00, queued_by_job_id=1, pid=1187 2024-05-24T23:15:03.236579748Z [2024-05-24T23:15:03.236+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:15:03.236607970Z 2024-05-24T23:15:03.236739674Z [2024-05-24T23:15:03.236+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:15:03.237456023Z [2024-05-24T23:15:03.237+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:15:03.237468163Z 2024-05-24T23:15:03.239789072Z [2024-05-24T23:15:03.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:15:03.240015455Z [2024-05-24T23:15:03.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:15:03.303365727Z [2024-05-24T23:15:03.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status queued for try_number 1 2024-05-24T23:15:03.303560583Z [2024-05-24T23:15:03.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status success for try_number 1 2024-05-24T23:15:03.311756686Z [2024-05-24T23:15:03.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:10:00+00:00, map_index=-1, run_start_date=2024-05-24 23:15:02.468629+00:00, run_end_date=2024-05-24 23:15:02.839545+00:00, run_duration=0.370916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:15:00.351065+00:00, queued_by_job_id=1, pid=1212 2024-05-24T23:15:03.312516718Z [2024-05-24T23:15:03.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7ecb9c9-9300-43e1-94ef-429dcf017b63 2024-05-24T23:15:04.206092031Z [2024-05-24T23:15:04.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:15:04.206281057Z [2024-05-24T23:15:04.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:14:00+00:00, run_id=scheduled__2024-05-24T23:14:00+00:00, run_start_date=2024-05-24 23:15:00.257441+00:00, run_end_date=2024-05-24 23:15:04.205992+00:00, run_duration=3.948551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:14:00+00:00, data_interval_end=2024-05-24 23:15:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:15:04.216538695Z [2024-05-24T23:15:04.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:15:00+00:00, run_after=2024-05-24T23:16:00+00:00 2024-05-24T23:15:04.269802525Z [2024-05-24T23:15:04.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:14:00+00:00 exited with status success for try_number 1 2024-05-24T23:15:04.274944397Z [2024-05-24T23:15:04.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:14:00+00:00, map_index=-1, run_start_date=2024-05-24 23:15:02.409115+00:00, run_end_date=2024-05-24 23:15:03.638655+00:00, run_duration=1.22954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:15:00.351065+00:00, queued_by_job_id=1, pid=1211 2024-05-24T23:15:06.464062515Z [2024-05-24T23:15:06.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:15:06.464461825Z [2024-05-24T23:15:06.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:14:00+00:00, run_id=scheduled__2024-05-24T23:14:00+00:00, run_start_date=2024-05-24 23:15:00.256212+00:00, run_end_date=2024-05-24 23:15:06.463896+00:00, run_duration=6.207684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:14:00+00:00, data_interval_end=2024-05-24 23:15:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:15:06.480514683Z [2024-05-24T23:15:06.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:15:00+00:00, run_after=2024-05-24T23:16:00+00:00 2024-05-24T23:15:06.533316182Z [2024-05-24T23:15:06.528+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:15:06.533337703Z 2024-05-24T23:15:06.533341425Z [2024-05-24T23:15:06.528+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:15:06.533345110Z [2024-05-24T23:15:06.528+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:15:06.533357977Z 2024-05-24T23:15:06.533362238Z [2024-05-24T23:15:06.531+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:15:06.533365465Z [2024-05-24T23:15:06.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:15:06.645606674Z [2024-05-24T23:15:06.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status queued for try_number 1 2024-05-24T23:15:06.645899343Z [2024-05-24T23:15:06.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:14:00+00:00 exited with status success for try_number 1 2024-05-24T23:15:06.646154697Z [2024-05-24T23:15:06.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status success for try_number 1 2024-05-24T23:15:06.653971790Z [2024-05-24T23:15:06.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:14:00+00:00, map_index=-1, run_start_date=2024-05-24 23:15:02.545021+00:00, run_end_date=2024-05-24 23:15:05.337564+00:00, run_duration=2.792543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:15:00.351065+00:00, queued_by_job_id=1, pid=1213 2024-05-24T23:15:06.654371114Z [2024-05-24T23:15:06.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca6bd57c-4acc-43a6-993a-ddbd1efe5782 2024-05-24T23:15:06.654725861Z [2024-05-24T23:15:06.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:10:00+00:00, map_index=-1, run_start_date=2024-05-24 23:15:05.198900+00:00, run_end_date=2024-05-24 23:15:05.679034+00:00, run_duration=0.480134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:15:03.237830+00:00, queued_by_job_id=1, pid=1236 2024-05-24T23:15:10.393386819Z [2024-05-24T23:15:10.392+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:15:10.393430797Z 2024-05-24T23:15:10.393436810Z [2024-05-24T23:15:10.392+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:15:10.394359629Z [2024-05-24T23:15:10.393+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:15:10.394380275Z 2024-05-24T23:15:10.397274798Z [2024-05-24T23:15:10.397+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:15:10.397460820Z [2024-05-24T23:15:10.397+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:15:10.454600333Z [2024-05-24T23:15:10.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status queued for try_number 1 2024-05-24T23:15:10.457817971Z [2024-05-24T23:15:10.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status success for try_number 1 2024-05-24T23:15:10.463032313Z [2024-05-24T23:15:10.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:10:00+00:00, map_index=0, run_start_date=2024-05-24 23:15:08.653448+00:00, run_end_date=2024-05-24 23:15:09.247021+00:00, run_duration=0.593573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:15:06.529320+00:00, queued_by_job_id=1, pid=1253 2024-05-24T23:15:10.463316636Z [2024-05-24T23:15:10.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to e77e0d1f-f1a7-489e-870c-9bde9e217358 2024-05-24T23:15:12.671479310Z [2024-05-24T23:15:12.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:15:12.671772241Z [2024-05-24T23:15:12.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:10:00+00:00, run_id=scheduled__2024-05-24T23:10:00+00:00, run_start_date=2024-05-24 23:15:00.253750+00:00, run_end_date=2024-05-24 23:15:12.671317+00:00, run_duration=12.417567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:10:00+00:00, data_interval_end=2024-05-24 23:15:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-24T23:15:12.678136246Z [2024-05-24T23:15:12.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:15:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:15:12.705831850Z [2024-05-24T23:15:12.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status success for try_number 1 2024-05-24T23:15:12.713267710Z [2024-05-24T23:15:12.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:10:00+00:00, map_index=-1, run_start_date=2024-05-24 23:15:11.920621+00:00, run_end_date=2024-05-24 23:15:12.285689+00:00, run_duration=0.365068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:15:10.395174+00:00, queued_by_job_id=1, pid=1264 2024-05-24T23:15:27.373859492Z [2024-05-24T23:15:27.373+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T23:16:00.080608674Z [2024-05-24T23:16:00.080+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:16:00.105500760Z [2024-05-24T23:16:00.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:16:00+00:00, run_after=2024-05-24T23:17:00+00:00 2024-05-24T23:16:00.113624326Z [2024-05-24T23:16:00.113+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:16:00.128730295Z [2024-05-24T23:16:00.128+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:16:00+00:00, run_after=2024-05-24T23:17:00+00:00 2024-05-24T23:16:00.223700937Z [2024-05-24T23:16:00.223+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:16:00.223732900Z 2024-05-24T23:16:00.223741301Z 2024-05-24T23:16:00.223748240Z 2024-05-24T23:16:00.223754567Z 2024-05-24T23:16:00.224148907Z [2024-05-24T23:16:00.223+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:16:00.224643172Z [2024-05-24T23:16:00.224+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:16:00.225142916Z [2024-05-24T23:16:00.224+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:16:00.225633605Z [2024-05-24T23:16:00.225+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:16:00.227083695Z [2024-05-24T23:16:00.226+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:16:00.227100213Z 2024-05-24T23:16:00.227107814Z 2024-05-24T23:16:00.227114399Z 2024-05-24T23:16:00.227120852Z 2024-05-24T23:16:00.233932473Z [2024-05-24T23:16:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:16:00.234329946Z [2024-05-24T23:16:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:16:00.234829193Z [2024-05-24T23:16:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:16:00.235167989Z [2024-05-24T23:16:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:16:00.235653219Z [2024-05-24T23:16:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:16:00.235904655Z [2024-05-24T23:16:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:16:00.236400644Z [2024-05-24T23:16:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:16:00.236650594Z [2024-05-24T23:16:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:16:00.730483083Z [2024-05-24T23:16:00.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:14:00+00:00 exited with status queued for try_number 1 2024-05-24T23:16:00.730642499Z [2024-05-24T23:16:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status queued for try_number 1 2024-05-24T23:16:00.730751903Z [2024-05-24T23:16:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status queued for try_number 1 2024-05-24T23:16:00.730906384Z [2024-05-24T23:16:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status queued for try_number 1 2024-05-24T23:16:00.749835124Z [2024-05-24T23:16:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28ae591a-d3a4-4fd8-baec-0338ba3fde59 2024-05-24T23:16:00.750027125Z [2024-05-24T23:16:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23f662a2-8d59-4bca-a73f-59885006478f 2024-05-24T23:16:00.750204530Z [2024-05-24T23:16:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc1f73f9-aef5-4ba0-ba06-3f82d2d806ad 2024-05-24T23:16:00.750364217Z [2024-05-24T23:16:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to b29f428c-1170-49d1-ac7a-f60a8ae1f4f9 2024-05-24T23:16:02.089167303Z [2024-05-24T23:16:02.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:16:02.089767965Z [2024-05-24T23:16:02.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:15:00+00:00, run_id=scheduled__2024-05-24T23:15:00+00:00, run_start_date=2024-05-24 23:16:00.150099+00:00, run_end_date=2024-05-24 23:16:02.088927+00:00, run_duration=1.938828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:15:00+00:00, data_interval_end=2024-05-24 23:16:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:16:02.100909295Z [2024-05-24T23:16:02.100+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:16:00+00:00, run_after=2024-05-24T23:17:00+00:00 2024-05-24T23:16:02.110198746Z [2024-05-24T23:16:02.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:16:02.110368337Z [2024-05-24T23:16:02.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:14:00+00:00, run_id=scheduled__2024-05-24T23:14:00+00:00, run_start_date=2024-05-24 23:16:00.144033+00:00, run_end_date=2024-05-24 23:16:02.109976+00:00, run_duration=1.965943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:14:00+00:00, data_interval_end=2024-05-24 23:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:16:02.133887513Z [2024-05-24T23:16:02.133+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:16:00+00:00, run_after=2024-05-24T23:18:00+00:00 2024-05-24T23:16:02.261001772Z [2024-05-24T23:16:02.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:14:00+00:00 exited with status success for try_number 1 2024-05-24T23:16:02.261048481Z [2024-05-24T23:16:02.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status success for try_number 1 2024-05-24T23:16:02.274279571Z [2024-05-24T23:16:02.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:15:00+00:00, map_index=-1, run_start_date=2024-05-24 23:16:01.049153+00:00, run_end_date=2024-05-24 23:16:01.485609+00:00, run_duration=0.436456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:16:00.229485+00:00, queued_by_job_id=1, pid=1274 2024-05-24T23:16:02.275069371Z [2024-05-24T23:16:02.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:14:00+00:00, map_index=-1, run_start_date=2024-05-24 23:16:01.232232+00:00, run_end_date=2024-05-24 23:16:01.707812+00:00, run_duration=0.47558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:16:00.229485+00:00, queued_by_job_id=1, pid=1275 2024-05-24T23:16:04.982990044Z [2024-05-24T23:16:04.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:16:04.983461596Z [2024-05-24T23:16:04.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:15:00+00:00, run_id=scheduled__2024-05-24T23:15:00+00:00, run_start_date=2024-05-24 23:16:00.145611+00:00, run_end_date=2024-05-24 23:16:04.982812+00:00, run_duration=4.837201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:15:00+00:00, data_interval_end=2024-05-24 23:16:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:16:05.006091978Z [2024-05-24T23:16:05.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:16:00+00:00, run_after=2024-05-24T23:17:00+00:00 2024-05-24T23:16:05.014312191Z [2024-05-24T23:16:05.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:16:05.014519635Z [2024-05-24T23:16:05.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:15:00+00:00, run_id=scheduled__2024-05-24T23:15:00+00:00, run_start_date=2024-05-24 23:16:00.148717+00:00, run_end_date=2024-05-24 23:16:05.014229+00:00, run_duration=4.865512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:15:00+00:00, data_interval_end=2024-05-24 23:16:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:16:05.024545182Z [2024-05-24T23:16:05.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:16:00+00:00, run_after=2024-05-24T23:17:00+00:00 2024-05-24T23:16:05.051253898Z [2024-05-24T23:16:05.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status success for try_number 1 2024-05-24T23:16:05.051286498Z [2024-05-24T23:16:05.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status success for try_number 1 2024-05-24T23:16:05.059074411Z [2024-05-24T23:16:05.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:15:00+00:00, map_index=-1, run_start_date=2024-05-24 23:16:02.523704+00:00, run_end_date=2024-05-24 23:16:03.751471+00:00, run_duration=1.227767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:16:00.229485+00:00, queued_by_job_id=1, pid=1299 2024-05-24T23:16:05.059272847Z [2024-05-24T23:16:05.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:15:00+00:00, map_index=-1, run_start_date=2024-05-24 23:16:02.332040+00:00, run_end_date=2024-05-24 23:16:03.963870+00:00, run_duration=1.63183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:16:00.229485+00:00, queued_by_job_id=1, pid=1298 2024-05-24T23:17:00.812799133Z [2024-05-24T23:17:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:17:00+00:00, run_after=2024-05-24T23:18:00+00:00 2024-05-24T23:17:00.826728400Z [2024-05-24T23:17:00.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:17:00+00:00, run_after=2024-05-24T23:18:00+00:00 2024-05-24T23:17:00.842525305Z [2024-05-24T23:17:00.842+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:17:00.936285725Z [2024-05-24T23:17:00.935+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:17:00.936318393Z 2024-05-24T23:17:00.936322086Z 2024-05-24T23:17:00.936325444Z 2024-05-24T23:17:00.936405431Z [2024-05-24T23:17:00.936+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:17:00.936561228Z [2024-05-24T23:17:00.936+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:17:00.936677833Z [2024-05-24T23:17:00.936+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:17:00.937415366Z [2024-05-24T23:17:00.937+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:17:00.937427290Z 2024-05-24T23:17:00.937430574Z 2024-05-24T23:17:00.937433862Z 2024-05-24T23:17:00.941650576Z [2024-05-24T23:17:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:17:00.941871374Z [2024-05-24T23:17:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:17:00.942194360Z [2024-05-24T23:17:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:17:00.942361293Z [2024-05-24T23:17:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:17:00.942700362Z [2024-05-24T23:17:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:17:00.942863004Z [2024-05-24T23:17:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:17:01.275041229Z [2024-05-24T23:17:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:16:00+00:00 exited with status queued for try_number 1 2024-05-24T23:17:01.275207978Z [2024-05-24T23:17:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:16:00+00:00 exited with status queued for try_number 1 2024-05-24T23:17:01.275343100Z [2024-05-24T23:17:01.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:16:00+00:00 exited with status queued for try_number 1 2024-05-24T23:17:01.283267043Z [2024-05-24T23:17:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to a412afcd-4007-4743-ba4f-2dc077049cfe 2024-05-24T23:17:01.283529885Z [2024-05-24T23:17:01.283+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2add8ea-3e35-42e5-901c-4d2e5635c10a 2024-05-24T23:17:01.283797003Z [2024-05-24T23:17:01.283+0000] {scheduler_job.py:635} INFO - Setting external_id for to e86efee5-00d6-44b1-b622-50452e0cb88d 2024-05-24T23:17:02.896295792Z [2024-05-24T23:17:02.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:17:02.896592887Z [2024-05-24T23:17:02.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:16:00+00:00, run_id=scheduled__2024-05-24T23:16:00+00:00, run_start_date=2024-05-24 23:17:00.876557+00:00, run_end_date=2024-05-24 23:17:02.896195+00:00, run_duration=2.019638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:16:00+00:00, data_interval_end=2024-05-24 23:17:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:17:02.912172257Z [2024-05-24T23:17:02.911+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:17:00+00:00, run_after=2024-05-24T23:18:00+00:00 2024-05-24T23:17:02.969069496Z [2024-05-24T23:17:02.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:16:00+00:00 exited with status success for try_number 1 2024-05-24T23:17:02.973583869Z [2024-05-24T23:17:02.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:16:00+00:00, map_index=-1, run_start_date=2024-05-24 23:17:01.786037+00:00, run_end_date=2024-05-24 23:17:02.202477+00:00, run_duration=0.41644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:17:00.938253+00:00, queued_by_job_id=1, pid=1331 2024-05-24T23:17:05.323000957Z [2024-05-24T23:17:05.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:17:05.323306936Z [2024-05-24T23:17:05.322+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:16:00+00:00, run_id=scheduled__2024-05-24T23:16:00+00:00, run_start_date=2024-05-24 23:17:00.875252+00:00, run_end_date=2024-05-24 23:17:05.322892+00:00, run_duration=4.44764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:16:00+00:00, data_interval_end=2024-05-24 23:17:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:17:05.335147552Z [2024-05-24T23:17:05.334+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:17:00+00:00, run_after=2024-05-24T23:18:00+00:00 2024-05-24T23:17:05.341873030Z [2024-05-24T23:17:05.341+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:17:05.342094835Z [2024-05-24T23:17:05.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:16:00+00:00, run_id=scheduled__2024-05-24T23:16:00+00:00, run_start_date=2024-05-24 23:17:00.877686+00:00, run_end_date=2024-05-24 23:17:05.341738+00:00, run_duration=4.464052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:16:00+00:00, data_interval_end=2024-05-24 23:17:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:17:05.351357104Z [2024-05-24T23:17:05.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:17:00+00:00, run_after=2024-05-24T23:18:00+00:00 2024-05-24T23:17:05.391042446Z [2024-05-24T23:17:05.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:16:00+00:00 exited with status success for try_number 1 2024-05-24T23:17:05.396641939Z [2024-05-24T23:17:05.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:16:00+00:00, map_index=-1, run_start_date=2024-05-24 23:17:02.962590+00:00, run_end_date=2024-05-24 23:17:04.835946+00:00, run_duration=1.873356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:17:00.938253+00:00, queued_by_job_id=1, pid=1349 2024-05-24T23:17:06.468138000Z [2024-05-24T23:17:06.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:16:00+00:00 exited with status success for try_number 1 2024-05-24T23:17:06.473705178Z [2024-05-24T23:17:06.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:16:00+00:00, map_index=-1, run_start_date=2024-05-24 23:17:02.994025+00:00, run_end_date=2024-05-24 23:17:05.241047+00:00, run_duration=2.247022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:17:00.938253+00:00, queued_by_job_id=1, pid=1350 2024-05-24T23:18:00.150011375Z [2024-05-24T23:18:00.149+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:18:00.156324888Z [2024-05-24T23:18:00.155+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:18:00.167159418Z [2024-05-24T23:18:00.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:18:00+00:00, run_after=2024-05-24T23:19:00+00:00 2024-05-24T23:18:00.178116412Z [2024-05-24T23:18:00.177+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:18:00+00:00, run_after=2024-05-24T23:19:00+00:00 2024-05-24T23:18:00.252347560Z [2024-05-24T23:18:00.251+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:18:00.252398017Z 2024-05-24T23:18:00.252409483Z 2024-05-24T23:18:00.252419234Z 2024-05-24T23:18:00.252428437Z 2024-05-24T23:18:00.252636859Z [2024-05-24T23:18:00.252+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:18:00.252702890Z [2024-05-24T23:18:00.252+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:18:00.252801619Z [2024-05-24T23:18:00.252+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:18:00.253370384Z [2024-05-24T23:18:00.252+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:18:00.254741836Z [2024-05-24T23:18:00.254+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:18:00.254762196Z 2024-05-24T23:18:00.254772858Z 2024-05-24T23:18:00.254781820Z 2024-05-24T23:18:00.254790477Z 2024-05-24T23:18:00.259608753Z [2024-05-24T23:18:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:18:00.259734704Z [2024-05-24T23:18:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:18:00.260148955Z [2024-05-24T23:18:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:18:00.260436990Z [2024-05-24T23:18:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:18:00.260870687Z [2024-05-24T23:18:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:18:00.261293165Z [2024-05-24T23:18:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:18:00.261595793Z [2024-05-24T23:18:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:18:00.261891468Z [2024-05-24T23:18:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:18:00.682345630Z [2024-05-24T23:18:00.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:16:00+00:00 exited with status queued for try_number 1 2024-05-24T23:18:00.682377296Z [2024-05-24T23:18:00.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:17:00+00:00 exited with status queued for try_number 1 2024-05-24T23:18:00.682408516Z [2024-05-24T23:18:00.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:17:00+00:00 exited with status queued for try_number 1 2024-05-24T23:18:00.682474456Z [2024-05-24T23:18:00.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:17:00+00:00 exited with status queued for try_number 1 2024-05-24T23:18:00.695572379Z [2024-05-24T23:18:00.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cf671fa-1bec-49ca-baee-f4315b2a6678 2024-05-24T23:18:00.695616489Z [2024-05-24T23:18:00.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28bdf595-fe45-406f-87db-117aeb4357a4 2024-05-24T23:18:00.695716124Z [2024-05-24T23:18:00.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9127535d-dfb4-452e-9c50-5197a89cff11 2024-05-24T23:18:00.695820895Z [2024-05-24T23:18:00.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3624c60-4ec3-4e09-8c74-bb726ebfd96d 2024-05-24T23:18:01.911957592Z [2024-05-24T23:18:01.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:18:01.918300907Z [2024-05-24T23:18:01.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:16:00+00:00, run_id=scheduled__2024-05-24T23:16:00+00:00, run_start_date=2024-05-24 23:18:00.186617+00:00, run_end_date=2024-05-24 23:18:01.911927+00:00, run_duration=1.72531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:16:00+00:00, data_interval_end=2024-05-24 23:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:18:01.930323866Z [2024-05-24T23:18:01.929+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:18:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:18:01.958661496Z [2024-05-24T23:18:01.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:18:01.958976056Z [2024-05-24T23:18:01.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:17:00+00:00, run_id=scheduled__2024-05-24T23:17:00+00:00, run_start_date=2024-05-24 23:18:00.189405+00:00, run_end_date=2024-05-24 23:18:01.958645+00:00, run_duration=1.76924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:17:00+00:00, data_interval_end=2024-05-24 23:18:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:18:01.977591968Z [2024-05-24T23:18:01.977+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:18:00+00:00, run_after=2024-05-24T23:19:00+00:00 2024-05-24T23:18:02.040505807Z [2024-05-24T23:18:02.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:16:00+00:00 exited with status success for try_number 1 2024-05-24T23:18:02.040705984Z [2024-05-24T23:18:02.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:17:00+00:00 exited with status success for try_number 1 2024-05-24T23:18:02.047136578Z [2024-05-24T23:18:02.046+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:16:00+00:00, map_index=-1, run_start_date=2024-05-24 23:18:01.120321+00:00, run_end_date=2024-05-24 23:18:01.554581+00:00, run_duration=0.43426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:18:00.255892+00:00, queued_by_job_id=1, pid=1382 2024-05-24T23:18:02.047725649Z [2024-05-24T23:18:02.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:17:00+00:00, map_index=-1, run_start_date=2024-05-24 23:18:01.209722+00:00, run_end_date=2024-05-24 23:18:01.695761+00:00, run_duration=0.486039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:18:00.255892+00:00, queued_by_job_id=1, pid=1383 2024-05-24T23:18:03.792652389Z [2024-05-24T23:18:03.792+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:18:03.793113627Z [2024-05-24T23:18:03.792+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:17:00+00:00, run_id=scheduled__2024-05-24T23:17:00+00:00, run_start_date=2024-05-24 23:18:00.188480+00:00, run_end_date=2024-05-24 23:18:03.792555+00:00, run_duration=3.604075, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:17:00+00:00, data_interval_end=2024-05-24 23:18:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:18:03.804293184Z [2024-05-24T23:18:03.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:18:00+00:00, run_after=2024-05-24T23:19:00+00:00 2024-05-24T23:18:04.507543391Z [2024-05-24T23:18:04.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:18:04.507840279Z [2024-05-24T23:18:04.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:17:00+00:00, run_id=scheduled__2024-05-24T23:17:00+00:00, run_start_date=2024-05-24 23:18:00.187602+00:00, run_end_date=2024-05-24 23:18:04.507443+00:00, run_duration=4.319841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:17:00+00:00, data_interval_end=2024-05-24 23:18:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:18:04.517423860Z [2024-05-24T23:18:04.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:18:00+00:00, run_after=2024-05-24T23:19:00+00:00 2024-05-24T23:18:04.560462045Z [2024-05-24T23:18:04.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:17:00+00:00 exited with status success for try_number 1 2024-05-24T23:18:04.560729802Z [2024-05-24T23:18:04.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:17:00+00:00 exited with status success for try_number 1 2024-05-24T23:18:04.570219925Z [2024-05-24T23:18:04.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:17:00+00:00, map_index=-1, run_start_date=2024-05-24 23:18:02.509111+00:00, run_end_date=2024-05-24 23:18:03.722369+00:00, run_duration=1.213258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:18:00.255892+00:00, queued_by_job_id=1, pid=1407 2024-05-24T23:18:04.570473527Z [2024-05-24T23:18:04.570+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:17:00+00:00, map_index=-1, run_start_date=2024-05-24 23:18:02.479449+00:00, run_end_date=2024-05-24 23:18:04.256233+00:00, run_duration=1.776784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:18:00.255892+00:00, queued_by_job_id=1, pid=1406 2024-05-24T23:18:51.854323956Z [2024-05-24T23:18:51.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:18:00+00:00, run_after=2024-05-24T23:19:00+00:00 2024-05-24T23:18:51.864434839Z [2024-05-24T23:18:51.864+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:18:51.926011207Z [2024-05-24T23:18:51.925+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-24T23:18:51.926030665Z 2024-05-24T23:18:51.926033926Z 2024-05-24T23:18:51.926313102Z [2024-05-24T23:18:51.926+0000] {scheduler_job.py:425} INFO - DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:18:51.926518299Z [2024-05-24T23:18:51.926+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:18:51.927340719Z [2024-05-24T23:18:51.927+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:18:51.927350643Z 2024-05-24T23:18:51.927353522Z 2024-05-24T23:18:51.931122192Z [2024-05-24T23:18:51.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:18:51.931409864Z [2024-05-24T23:18:51.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:18:51.931812480Z [2024-05-24T23:18:51.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:18:51.932081084Z [2024-05-24T23:18:51.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:18:52.083519266Z [2024-05-24T23:18:52.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:17:00+00:00 exited with status queued for try_number 1 2024-05-24T23:18:52.083772738Z [2024-05-24T23:18:52.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:17:00+00:00 exited with status queued for try_number 1 2024-05-24T23:18:52.093973473Z [2024-05-24T23:18:52.093+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9af87557-3c49-489b-9417-9e39c4e018fa 2024-05-24T23:18:52.094573566Z [2024-05-24T23:18:52.094+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42fc2321-ea7d-4e62-8d0e-7b9f55585c0e 2024-05-24T23:18:55.632387006Z [2024-05-24T23:18:55.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:18:55.632570871Z [2024-05-24T23:18:55.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, execution_date=2024-05-24 23:17:00+00:00, run_id=scheduled__2024-05-24T23:17:00+00:00, run_start_date=2024-05-24 23:18:51.876935+00:00, run_end_date=2024-05-24 23:18:55.632243+00:00, run_duration=3.755308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:17:00+00:00, data_interval_end=2024-05-24 23:18:00+00:00, dag_hash=ba6b4825707f2085cd0ebd81d0727ada 2024-05-24T23:18:55.644070955Z [2024-05-24T23:18:55.642+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:18:00+00:00, run_after=2024-05-24T23:19:00+00:00 2024-05-24T23:18:55.649738944Z [2024-05-24T23:18:55.649+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:18:55.649968257Z [2024-05-24T23:18:55.649+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, execution_date=2024-05-24 23:17:00+00:00, run_id=scheduled__2024-05-24T23:17:00+00:00, run_start_date=2024-05-24 23:18:51.877427+00:00, run_end_date=2024-05-24 23:18:55.649611+00:00, run_duration=3.772184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:17:00+00:00, data_interval_end=2024-05-24 23:18:00+00:00, dag_hash=81d1b5a58d1b79125f83f7dc22e0bfe0 2024-05-24T23:18:55.659802980Z [2024-05-24T23:18:55.659+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:18:00+00:00, run_after=2024-05-24T23:19:00+00:00 2024-05-24T23:18:55.691761160Z [2024-05-24T23:18:55.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:17:00+00:00 exited with status success for try_number 1 2024-05-24T23:18:55.691921766Z [2024-05-24T23:18:55.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:17:00+00:00 exited with status success for try_number 1 2024-05-24T23:18:55.699598022Z [2024-05-24T23:18:55.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:17:00+00:00, map_index=-1, run_start_date=2024-05-24 23:18:53.597863+00:00, run_end_date=2024-05-24 23:18:55.159657+00:00, run_duration=1.561794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:18:51.928185+00:00, queued_by_job_id=1, pid=1445 2024-05-24T23:18:55.699878647Z [2024-05-24T23:18:55.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:17:00+00:00, map_index=-1, run_start_date=2024-05-24 23:18:53.676678+00:00, run_end_date=2024-05-24 23:18:54.875743+00:00, run_duration=1.199065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:18:51.928185+00:00, queued_by_job_id=1, pid=1446 2024-05-24T23:19:00.673180743Z [2024-05-24T23:19:00.672+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:19:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:19:00.681531200Z [2024-05-24T23:19:00.681+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:19:00.696230562Z [2024-05-24T23:19:00.695+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:19:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:19:00.705088379Z [2024-05-24T23:19:00.704+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:19:00.716479005Z [2024-05-24T23:19:00.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:19:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:19:00.825991739Z [2024-05-24T23:19:00.825+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T23:19:00.826072060Z 2024-05-24T23:19:00.826082097Z 2024-05-24T23:19:00.826090634Z 2024-05-24T23:19:00.826098951Z 2024-05-24T23:19:00.826108124Z 2024-05-24T23:19:00.826200678Z [2024-05-24T23:19:00.825+0000] {scheduler_job.py:425} INFO - DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:19:00.826263312Z [2024-05-24T23:19:00.825+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:19:00.826473793Z [2024-05-24T23:19:00.826+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:19:00.826718854Z [2024-05-24T23:19:00.826+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:19:00.826874105Z [2024-05-24T23:19:00.826+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:19:00.828322860Z [2024-05-24T23:19:00.827+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:19:00.828347739Z 2024-05-24T23:19:00.828356729Z 2024-05-24T23:19:00.828365274Z 2024-05-24T23:19:00.828374127Z 2024-05-24T23:19:00.828382582Z 2024-05-24T23:19:00.836401812Z [2024-05-24T23:19:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:19:00.836543379Z [2024-05-24T23:19:00.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:19:00.836817487Z [2024-05-24T23:19:00.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:19:00.836989490Z [2024-05-24T23:19:00.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:19:00.837373574Z [2024-05-24T23:19:00.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:19:00.837649540Z [2024-05-24T23:19:00.837+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:19:00.838276024Z [2024-05-24T23:19:00.837+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:19:00.838946024Z [2024-05-24T23:19:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:19:00.839515074Z [2024-05-24T23:19:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:19:00.839878771Z [2024-05-24T23:19:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:19:01.281472999Z [2024-05-24T23:19:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:18:00+00:00 exited with status queued for try_number 1 2024-05-24T23:19:01.283814194Z [2024-05-24T23:19:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:18:00+00:00 exited with status queued for try_number 1 2024-05-24T23:19:01.284006675Z [2024-05-24T23:19:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:18:00+00:00 exited with status queued for try_number 1 2024-05-24T23:19:01.284201580Z [2024-05-24T23:19:01.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:18:00+00:00 exited with status queued for try_number 1 2024-05-24T23:19:01.284356775Z [2024-05-24T23:19:01.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:18:00+00:00 exited with status queued for try_number 1 2024-05-24T23:19:01.292484720Z [2024-05-24T23:19:01.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87fcbd21-4f79-43b7-993c-923aaf7a4419 2024-05-24T23:19:01.292832217Z [2024-05-24T23:19:01.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4749136b-a734-4a9e-aab7-edf6fdf5f20a 2024-05-24T23:19:01.293062623Z [2024-05-24T23:19:01.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2dcdf9f-5491-4da4-8df2-f48bff50b21a 2024-05-24T23:19:01.293269725Z [2024-05-24T23:19:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ede8410-8756-4988-a53d-1636f1a9b474 2024-05-24T23:19:01.293580123Z [2024-05-24T23:19:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce53961f-342b-4ff0-9947-1733426feeea 2024-05-24T23:19:02.485519386Z [2024-05-24T23:19:02.485+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:19:02.487729109Z [2024-05-24T23:19:02.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:18:00+00:00, run_id=scheduled__2024-05-24T23:18:00+00:00, run_start_date=2024-05-24 23:19:00.729365+00:00, run_end_date=2024-05-24 23:19:02.487264+00:00, run_duration=1.757899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:18:00+00:00, data_interval_end=2024-05-24 23:19:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:19:02.501174411Z [2024-05-24T23:19:02.500+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:19:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:19:02.622253004Z [2024-05-24T23:19:02.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:18:00+00:00 exited with status success for try_number 1 2024-05-24T23:19:02.629227610Z [2024-05-24T23:19:02.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:18:00+00:00, map_index=-1, run_start_date=2024-05-24 23:19:01.754247+00:00, run_end_date=2024-05-24 23:19:02.247299+00:00, run_duration=0.493052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:19:00.830806+00:00, queued_by_job_id=1, pid=1467 2024-05-24T23:19:05.894485182Z [2024-05-24T23:19:05.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:19:05.894939092Z [2024-05-24T23:19:05.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, execution_date=2024-05-24 23:18:00+00:00, run_id=scheduled__2024-05-24T23:18:00+00:00, run_start_date=2024-05-24 23:19:00.729793+00:00, run_end_date=2024-05-24 23:19:05.894263+00:00, run_duration=5.16447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:18:00+00:00, data_interval_end=2024-05-24 23:19:00+00:00, dag_hash=81d1b5a58d1b79125f83f7dc22e0bfe0 2024-05-24T23:19:05.911762088Z [2024-05-24T23:19:05.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:19:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:19:05.922452385Z [2024-05-24T23:19:05.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:19:05.922680536Z [2024-05-24T23:19:05.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:18:00+00:00, run_id=scheduled__2024-05-24T23:18:00+00:00, run_start_date=2024-05-24 23:19:00.730890+00:00, run_end_date=2024-05-24 23:19:05.922248+00:00, run_duration=5.191358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:18:00+00:00, data_interval_end=2024-05-24 23:19:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:19:05.940997113Z [2024-05-24T23:19:05.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:19:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:19:05.953884222Z [2024-05-24T23:19:05.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:19:05.954160925Z [2024-05-24T23:19:05.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:18:00+00:00, run_id=scheduled__2024-05-24T23:18:00+00:00, run_start_date=2024-05-24 23:19:00.732271+00:00, run_end_date=2024-05-24 23:19:05.953752+00:00, run_duration=5.221481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:18:00+00:00, data_interval_end=2024-05-24 23:19:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:19:05.968128347Z [2024-05-24T23:19:05.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:19:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:19:05.979319797Z [2024-05-24T23:19:05.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:19:05.979511705Z [2024-05-24T23:19:05.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, execution_date=2024-05-24 23:18:00+00:00, run_id=scheduled__2024-05-24T23:18:00+00:00, run_start_date=2024-05-24 23:19:00.732653+00:00, run_end_date=2024-05-24 23:19:05.978920+00:00, run_duration=5.246267, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:18:00+00:00, data_interval_end=2024-05-24 23:19:00+00:00, dag_hash=ba6b4825707f2085cd0ebd81d0727ada 2024-05-24T23:19:05.997867065Z [2024-05-24T23:19:05.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:19:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:19:06.049371681Z [2024-05-24T23:19:06.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:18:00+00:00 exited with status success for try_number 1 2024-05-24T23:19:06.051698162Z [2024-05-24T23:19:06.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:18:00+00:00 exited with status success for try_number 1 2024-05-24T23:19:06.051715273Z [2024-05-24T23:19:06.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:18:00+00:00 exited with status success for try_number 1 2024-05-24T23:19:06.051719302Z [2024-05-24T23:19:06.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:18:00+00:00 exited with status success for try_number 1 2024-05-24T23:19:06.058929582Z [2024-05-24T23:19:06.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:18:00+00:00, map_index=-1, run_start_date=2024-05-24 23:19:03.166852+00:00, run_end_date=2024-05-24 23:19:05.510511+00:00, run_duration=2.343659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:19:00.830806+00:00, queued_by_job_id=1, pid=1493 2024-05-24T23:19:06.059314259Z [2024-05-24T23:19:06.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:18:00+00:00, map_index=-1, run_start_date=2024-05-24 23:19:03.333812+00:00, run_end_date=2024-05-24 23:19:05.253712+00:00, run_duration=1.9199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:19:00.830806+00:00, queued_by_job_id=1, pid=1494 2024-05-24T23:19:06.060567848Z [2024-05-24T23:19:06.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:18:00+00:00, map_index=-1, run_start_date=2024-05-24 23:19:03.125866+00:00, run_end_date=2024-05-24 23:19:05.250215+00:00, run_duration=2.124349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:19:00.830806+00:00, queued_by_job_id=1, pid=1492 2024-05-24T23:19:06.060579678Z [2024-05-24T23:19:06.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:18:00+00:00, map_index=-1, run_start_date=2024-05-24 23:19:03.551441+00:00, run_end_date=2024-05-24 23:19:05.212527+00:00, run_duration=1.661086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:19:00.830806+00:00, queued_by_job_id=1, pid=1510 2024-05-24T23:19:09.799143647Z [2024-05-24T23:19:09.798+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:15:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:19:09.854796666Z [2024-05-24T23:19:09.854+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:19:09.854838616Z 2024-05-24T23:19:09.854948158Z [2024-05-24T23:19:09.854+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:19:09.855848735Z [2024-05-24T23:19:09.855+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:19:09.855854488Z 2024-05-24T23:19:09.858920412Z [2024-05-24T23:19:09.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:19:09.859110007Z [2024-05-24T23:19:09.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:19:09.916817263Z [2024-05-24T23:19:09.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status queued for try_number 1 2024-05-24T23:19:09.924873291Z [2024-05-24T23:19:09.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bd720ee-2ddd-40b0-8f56-a7d0a5400723 2024-05-24T23:19:12.157516570Z [2024-05-24T23:19:12.152+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:19:12.157565444Z 2024-05-24T23:19:12.157569778Z [2024-05-24T23:19:12.152+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:19:12.157575533Z [2024-05-24T23:19:12.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:19:12.157578834Z 2024-05-24T23:19:12.157583466Z [2024-05-24T23:19:12.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:19:12.157600609Z [2024-05-24T23:19:12.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'split_metrics', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:19:12.282137061Z [2024-05-24T23:19:12.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.split_metrics run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status queued for try_number 1 2024-05-24T23:19:12.282390719Z [2024-05-24T23:19:12.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status success for try_number 1 2024-05-24T23:19:12.288636941Z [2024-05-24T23:19:12.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:10:00+00:00, map_index=-1, run_start_date=2024-05-24 23:19:11.324495+00:00, run_end_date=2024-05-24 23:19:11.704527+00:00, run_duration=0.380032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:19:09.856372+00:00, queued_by_job_id=1, pid=1540 2024-05-24T23:19:12.289109217Z [2024-05-24T23:19:12.288+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9f786de-1f0d-4228-8276-8350b3bbf222 2024-05-24T23:19:14.931694398Z [2024-05-24T23:19:14.930+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:19:14.931871431Z 2024-05-24T23:19:14.931939953Z [2024-05-24T23:19:14.931+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:19:14.932653478Z [2024-05-24T23:19:14.932+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:19:14.932695567Z 2024-05-24T23:19:14.936021388Z [2024-05-24T23:19:14.935+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:19:14.936207778Z [2024-05-24T23:19:14.935+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'collect_metrics', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:19:15.000131109Z [2024-05-24T23:19:14.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.collect_metrics run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status queued for try_number 1 2024-05-24T23:19:15.001054670Z [2024-05-24T23:19:15.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.split_metrics run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status success for try_number 1 2024-05-24T23:19:15.013836414Z [2024-05-24T23:19:15.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7ad6ff8-ad39-4a4b-9ebd-b1df9048aa63 2024-05-24T23:19:15.014006715Z [2024-05-24T23:19:15.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:10:00+00:00, map_index=-1, run_start_date=2024-05-24 23:19:13.820206+00:00, run_end_date=2024-05-24 23:19:14.230087+00:00, run_duration=0.409881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:19:12.153757+00:00, queued_by_job_id=1, pid=1553 2024-05-24T23:19:17.304840863Z [2024-05-24T23:19:17.304+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:19:17.304889325Z 2024-05-24T23:19:17.305425680Z [2024-05-24T23:19:17.304+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:19:17.306579060Z [2024-05-24T23:19:17.306+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:19:17.306608925Z 2024-05-24T23:19:17.310288657Z [2024-05-24T23:19:17.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:19:17.310728210Z [2024-05-24T23:19:17.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'send_prometheus', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:19:17.383308266Z [2024-05-24T23:19:17.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.send_prometheus run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status queued for try_number 1 2024-05-24T23:19:17.387327027Z [2024-05-24T23:19:17.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.collect_metrics run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status success for try_number 1 2024-05-24T23:19:17.396798752Z [2024-05-24T23:19:17.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88214c94-2efb-435c-aa6b-d665db261cb2 2024-05-24T23:19:17.397159114Z [2024-05-24T23:19:17.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:10:00+00:00, map_index=0, run_start_date=2024-05-24 23:19:16.539659+00:00, run_end_date=2024-05-24 23:19:16.883543+00:00, run_duration=0.343884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:19:14.933053+00:00, queued_by_job_id=1, pid=1561 2024-05-24T23:19:19.867760598Z [2024-05-24T23:19:19.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:19:19.868016750Z [2024-05-24T23:19:19.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, execution_date=2024-05-24 23:10:00+00:00, run_id=scheduled__2024-05-24T23:10:00+00:00, run_start_date=2024-05-24 23:19:09.818546+00:00, run_end_date=2024-05-24 23:19:19.867677+00:00, run_duration=10.049131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:10:00+00:00, data_interval_end=2024-05-24 23:15:00+00:00, dag_hash=57f6cacd1dc9047f3d573889f7ef3288 2024-05-24T23:19:19.873323728Z [2024-05-24T23:19:19.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:15:00+00:00, run_after=2024-05-24T23:20:00+00:00 2024-05-24T23:19:19.897532801Z [2024-05-24T23:19:19.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.send_prometheus run_id=scheduled__2024-05-24T23:10:00+00:00 exited with status success for try_number 1 2024-05-24T23:19:19.915382103Z [2024-05-24T23:19:19.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:10:00+00:00, map_index=-1, run_start_date=2024-05-24 23:19:18.868264+00:00, run_end_date=2024-05-24 23:19:19.193104+00:00, run_duration=0.32484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:19:17.307286+00:00, queued_by_job_id=1, pid=1569 2024-05-24T23:20:00.571370668Z [2024-05-24T23:20:00.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:21:00+00:00 2024-05-24T23:20:00.582457127Z [2024-05-24T23:20:00.582+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:21:00+00:00 2024-05-24T23:20:00.588414702Z [2024-05-24T23:20:00.588+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:20:00.598107736Z [2024-05-24T23:20:00.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:25:00+00:00 2024-05-24T23:20:00.603810541Z [2024-05-24T23:20:00.603+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:20:00.614930823Z [2024-05-24T23:20:00.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:21:00+00:00 2024-05-24T23:20:00.621265121Z [2024-05-24T23:20:00.620+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:20:00.630304692Z [2024-05-24T23:20:00.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:25:00+00:00 2024-05-24T23:20:00.747400564Z [2024-05-24T23:20:00.746+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-05-24T23:20:00.747447565Z 2024-05-24T23:20:00.747453680Z 2024-05-24T23:20:00.747458491Z 2024-05-24T23:20:00.747468497Z 2024-05-24T23:20:00.747473332Z 2024-05-24T23:20:00.747477837Z 2024-05-24T23:20:00.747499804Z 2024-05-24T23:20:00.747505399Z 2024-05-24T23:20:00.747815573Z [2024-05-24T23:20:00.747+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:20:00.748087301Z [2024-05-24T23:20:00.747+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:20:00.748339374Z [2024-05-24T23:20:00.748+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:20:00.748560117Z [2024-05-24T23:20:00.748+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:20:00.748807028Z [2024-05-24T23:20:00.748+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:20:00.749012601Z [2024-05-24T23:20:00.748+0000] {scheduler_job.py:425} INFO - DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:20:00.749804878Z [2024-05-24T23:20:00.749+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:20:00.750182674Z [2024-05-24T23:20:00.749+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:20:00.751139827Z [2024-05-24T23:20:00.750+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:20:00.751150070Z 2024-05-24T23:20:00.751152979Z 2024-05-24T23:20:00.751156326Z 2024-05-24T23:20:00.751159390Z 2024-05-24T23:20:00.751161933Z 2024-05-24T23:20:00.751164552Z 2024-05-24T23:20:00.751167234Z 2024-05-24T23:20:00.751169870Z 2024-05-24T23:20:00.757526954Z [2024-05-24T23:20:00.757+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:20:00.757975002Z [2024-05-24T23:20:00.757+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:20:00.758355152Z [2024-05-24T23:20:00.758+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:20:00.758585636Z [2024-05-24T23:20:00.758+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:20:00.758920326Z [2024-05-24T23:20:00.758+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:20:00.759076591Z [2024-05-24T23:20:00.758+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:20:00.759388091Z [2024-05-24T23:20:00.759+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:20:00.759593063Z [2024-05-24T23:20:00.759+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:20:00.759880920Z [2024-05-24T23:20:00.759+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:20:00.760048167Z [2024-05-24T23:20:00.759+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:20:00.760414830Z [2024-05-24T23:20:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:20:00.760502777Z [2024-05-24T23:20:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:20:00.760785960Z [2024-05-24T23:20:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:20:00.760983381Z [2024-05-24T23:20:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:20:00.761291548Z [2024-05-24T23:20:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:20:00.761482599Z [2024-05-24T23:20:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:20:01.696219429Z [2024-05-24T23:20:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:01.696424568Z [2024-05-24T23:20:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:01.696599996Z [2024-05-24T23:20:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:18:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:01.696788515Z [2024-05-24T23:20:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:19:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:01.696957980Z [2024-05-24T23:20:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:19:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:01.697098066Z [2024-05-24T23:20:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:19:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:01.697280668Z [2024-05-24T23:20:01.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:19:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:01.697444039Z [2024-05-24T23:20:01.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:19:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:01.708925304Z [2024-05-24T23:20:01.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to d34ab1a8-24a7-4eda-83d9-0724f8018bc0 2024-05-24T23:20:01.709201062Z [2024-05-24T23:20:01.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88263950-86ee-46b6-98ce-3e9b4d5c7223 2024-05-24T23:20:01.709468709Z [2024-05-24T23:20:01.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc27bf87-eca3-40da-8834-9759082146ff 2024-05-24T23:20:01.709710946Z [2024-05-24T23:20:01.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7cdcf19-2d60-4aed-93c3-b6c5a988408c 2024-05-24T23:20:01.709910695Z [2024-05-24T23:20:01.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62142bbc-b13e-4778-abdb-6fa3dc913467 2024-05-24T23:20:01.710093980Z [2024-05-24T23:20:01.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8686b09-b54e-45ce-88d6-6053a1078fd3 2024-05-24T23:20:01.710317087Z [2024-05-24T23:20:01.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0a0d7a7-c79c-470a-bb4a-f95b0e55f8ad 2024-05-24T23:20:01.710617622Z [2024-05-24T23:20:01.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6987f57b-d8bd-45b6-a7fd-7fca8e1d91fc 2024-05-24T23:20:03.146772391Z [2024-05-24T23:20:03.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:20:03.147017894Z [2024-05-24T23:20:03.146+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:18:00+00:00, run_id=scheduled__2024-05-24T23:18:00+00:00, run_start_date=2024-05-24 23:20:00.640719+00:00, run_end_date=2024-05-24 23:20:03.146692+00:00, run_duration=2.505973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:18:00+00:00, data_interval_end=2024-05-24 23:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:20:03.162286518Z [2024-05-24T23:20:03.161+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:22:00+00:00 2024-05-24T23:20:03.249602921Z [2024-05-24T23:20:03.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:20:03.249776752Z [2024-05-24T23:20:03.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:19:00+00:00, run_id=scheduled__2024-05-24T23:19:00+00:00, run_start_date=2024-05-24 23:20:00.645674+00:00, run_end_date=2024-05-24 23:20:03.249510+00:00, run_duration=2.603836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:19:00+00:00, data_interval_end=2024-05-24 23:20:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:20:03.261449183Z [2024-05-24T23:20:03.261+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:21:00+00:00 2024-05-24T23:20:03.293646003Z [2024-05-24T23:20:03.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:18:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:03.300388984Z [2024-05-24T23:20:03.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:18:00+00:00, map_index=-1, run_start_date=2024-05-24 23:20:02.102026+00:00, run_end_date=2024-05-24 23:20:02.935347+00:00, run_duration=0.833321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:00.753323+00:00, queued_by_job_id=1, pid=1583 2024-05-24T23:20:04.522565217Z [2024-05-24T23:20:04.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:19:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:04.529763015Z [2024-05-24T23:20:04.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:19:00+00:00, map_index=-1, run_start_date=2024-05-24 23:20:02.304670+00:00, run_end_date=2024-05-24 23:20:03.036121+00:00, run_duration=0.731451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:00.753323+00:00, queued_by_job_id=1, pid=1585 2024-05-24T23:20:05.233847096Z [2024-05-24T23:20:05.232+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:20:05.233884092Z 2024-05-24T23:20:05.234225212Z [2024-05-24T23:20:05.233+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:20:05.235073308Z [2024-05-24T23:20:05.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:20:05.235088362Z 2024-05-24T23:20:05.237506437Z [2024-05-24T23:20:05.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:20:05.237716564Z [2024-05-24T23:20:05.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:20:05.310889704Z [2024-05-24T23:20:05.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:05.311116065Z [2024-05-24T23:20:05.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:05.320795448Z [2024-05-24T23:20:05.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to bffa704e-ae36-4953-ab3b-6dadfe7f9536 2024-05-24T23:20:05.321089465Z [2024-05-24T23:20:05.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:15:00+00:00, map_index=-1, run_start_date=2024-05-24 23:20:04.148285+00:00, run_end_date=2024-05-24 23:20:04.694832+00:00, run_duration=0.546547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:00.753323+00:00, queued_by_job_id=1, pid=1617 2024-05-24T23:20:06.563744057Z [2024-05-24T23:20:06.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:20:06.564409035Z [2024-05-24T23:20:06.564+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:19:00+00:00, run_id=scheduled__2024-05-24T23:19:00+00:00, run_start_date=2024-05-24 23:20:00.642850+00:00, run_end_date=2024-05-24 23:20:06.564016+00:00, run_duration=5.921166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:19:00+00:00, data_interval_end=2024-05-24 23:20:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:20:06.575009396Z [2024-05-24T23:20:06.574+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:21:00+00:00 2024-05-24T23:20:06.654593848Z [2024-05-24T23:20:06.654+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:20:06.654620230Z 2024-05-24T23:20:06.655186747Z [2024-05-24T23:20:06.654+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:20:06.656504801Z [2024-05-24T23:20:06.656+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:20:06.656522103Z 2024-05-24T23:20:06.662763652Z [2024-05-24T23:20:06.662+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:20:06.663258940Z [2024-05-24T23:20:06.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'split_metrics', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:20:06.758244036Z [2024-05-24T23:20:06.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.split_metrics run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:06.758549527Z [2024-05-24T23:20:06.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:06.758797800Z [2024-05-24T23:20:06.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:19:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:06.774410344Z [2024-05-24T23:20:06.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:19:00+00:00, map_index=-1, run_start_date=2024-05-24 23:20:04.731403+00:00, run_end_date=2024-05-24 23:20:06.044865+00:00, run_duration=1.313462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:00.753323+00:00, queued_by_job_id=1, pid=1634 2024-05-24T23:20:06.775055863Z [2024-05-24T23:20:06.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:15:00+00:00, map_index=-1, run_start_date=2024-05-24 23:20:05.392674+00:00, run_end_date=2024-05-24 23:20:05.797842+00:00, run_duration=0.405168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:00.753323+00:00, queued_by_job_id=1, pid=1657 2024-05-24T23:20:06.775479781Z [2024-05-24T23:20:06.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to 781b48a1-1a20-4ed9-a401-0e221da4f549 2024-05-24T23:20:06.839779541Z [2024-05-24T23:20:06.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:20:06.840362252Z [2024-05-24T23:20:06.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, execution_date=2024-05-24 23:19:00+00:00, run_id=scheduled__2024-05-24T23:19:00+00:00, run_start_date=2024-05-24 23:20:00.643774+00:00, run_end_date=2024-05-24 23:20:06.839694+00:00, run_duration=6.19592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:19:00+00:00, data_interval_end=2024-05-24 23:20:00+00:00, dag_hash=ba6b4825707f2085cd0ebd81d0727ada 2024-05-24T23:20:06.850958315Z [2024-05-24T23:20:06.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:21:00+00:00 2024-05-24T23:20:06.974654091Z [2024-05-24T23:20:06.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:19:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:06.981344258Z [2024-05-24T23:20:06.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:19:00+00:00, map_index=-1, run_start_date=2024-05-24 23:20:05.120958+00:00, run_end_date=2024-05-24 23:20:06.681097+00:00, run_duration=1.560139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:00.753323+00:00, queued_by_job_id=1, pid=1650 2024-05-24T23:20:08.073358714Z [2024-05-24T23:20:08.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:20:08.073808555Z [2024-05-24T23:20:08.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:19:00+00:00, run_id=scheduled__2024-05-24T23:19:00+00:00, run_start_date=2024-05-24 23:20:00.641954+00:00, run_end_date=2024-05-24 23:20:08.073264+00:00, run_duration=7.43131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:19:00+00:00, data_interval_end=2024-05-24 23:20:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:20:08.089257384Z [2024-05-24T23:20:08.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:21:00+00:00 2024-05-24T23:20:08.100579179Z [2024-05-24T23:20:08.100+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:20:08.101256389Z [2024-05-24T23:20:08.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, execution_date=2024-05-24 23:19:00+00:00, run_id=scheduled__2024-05-24T23:19:00+00:00, run_start_date=2024-05-24 23:20:00.644724+00:00, run_end_date=2024-05-24 23:20:08.100483+00:00, run_duration=7.455759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:19:00+00:00, data_interval_end=2024-05-24 23:20:00+00:00, dag_hash=81d1b5a58d1b79125f83f7dc22e0bfe0 2024-05-24T23:20:08.114000186Z [2024-05-24T23:20:08.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:21:00+00:00 2024-05-24T23:20:08.161880122Z [2024-05-24T23:20:08.161+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:20:08.161892309Z 2024-05-24T23:20:08.162099765Z [2024-05-24T23:20:08.161+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:20:08.162797246Z [2024-05-24T23:20:08.162+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:20:08.162807092Z 2024-05-24T23:20:08.165973886Z [2024-05-24T23:20:08.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:20:08.166203428Z [2024-05-24T23:20:08.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:20:08.230183403Z [2024-05-24T23:20:08.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:08.230326713Z [2024-05-24T23:20:08.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:19:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:08.230542021Z [2024-05-24T23:20:08.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:19:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:08.230708272Z [2024-05-24T23:20:08.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:08.242223745Z [2024-05-24T23:20:08.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:19:00+00:00, map_index=-1, run_start_date=2024-05-24 23:20:04.239048+00:00, run_end_date=2024-05-24 23:20:07.477387+00:00, run_duration=3.238339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:00.753323+00:00, queued_by_job_id=1, pid=1618 2024-05-24T23:20:08.242542916Z [2024-05-24T23:20:08.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:19:00+00:00, map_index=-1, run_start_date=2024-05-24 23:20:04.111383+00:00, run_end_date=2024-05-24 23:20:07.355743+00:00, run_duration=3.24436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:00.753323+00:00, queued_by_job_id=1, pid=1616 2024-05-24T23:20:08.242711994Z [2024-05-24T23:20:08.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:15:00+00:00, map_index=-1, run_start_date=2024-05-24 23:20:06.987154+00:00, run_end_date=2024-05-24 23:20:07.336244+00:00, run_duration=0.34909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:05.235476+00:00, queued_by_job_id=1, pid=1684 2024-05-24T23:20:08.242953596Z [2024-05-24T23:20:08.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fedfca2-5249-4ae2-bb09-55574a229c97 2024-05-24T23:20:09.015152841Z [2024-05-24T23:20:09.014+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:20:09.015207333Z 2024-05-24T23:20:09.015216503Z [2024-05-24T23:20:09.014+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:20:09.015707096Z [2024-05-24T23:20:09.015+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:20:09.015754102Z 2024-05-24T23:20:09.018028246Z [2024-05-24T23:20:09.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:20:09.018094645Z [2024-05-24T23:20:09.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'collect_metrics', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:20:09.073473468Z [2024-05-24T23:20:09.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.collect_metrics run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:09.073528155Z [2024-05-24T23:20:09.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.split_metrics run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:09.081674734Z [2024-05-24T23:20:09.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to e815a585-656e-479a-b1f4-8783c260c79b 2024-05-24T23:20:09.082503694Z [2024-05-24T23:20:09.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:15:00+00:00, map_index=-1, run_start_date=2024-05-24 23:20:08.379555+00:00, run_end_date=2024-05-24 23:20:08.752423+00:00, run_duration=0.372868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:06.658154+00:00, queued_by_job_id=1, pid=1695 2024-05-24T23:20:11.032959325Z [2024-05-24T23:20:11.030+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:20:11.032987020Z 2024-05-24T23:20:11.034300254Z [2024-05-24T23:20:11.034+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:20:11.035361893Z [2024-05-24T23:20:11.035+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:20:11.035393657Z 2024-05-24T23:20:11.040547333Z [2024-05-24T23:20:11.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:20:11.040956539Z [2024-05-24T23:20:11.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:20:11.086171985Z [2024-05-24T23:20:11.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:11.086473270Z [2024-05-24T23:20:11.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:11.091726887Z [2024-05-24T23:20:11.091+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6461aad-80c0-4665-9b02-ba51ffe2d86d 2024-05-24T23:20:11.092220365Z [2024-05-24T23:20:11.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:15:00+00:00, map_index=0, run_start_date=2024-05-24 23:20:09.810015+00:00, run_end_date=2024-05-24 23:20:10.165083+00:00, run_duration=0.355068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:08.163191+00:00, queued_by_job_id=1, pid=1703 2024-05-24T23:20:11.218960087Z [2024-05-24T23:20:11.218+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:20:11.218989130Z 2024-05-24T23:20:11.219121325Z [2024-05-24T23:20:11.218+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:20:11.219686991Z [2024-05-24T23:20:11.219+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:20:11.219696506Z 2024-05-24T23:20:11.222131462Z [2024-05-24T23:20:11.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:20:11.222369340Z [2024-05-24T23:20:11.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'send_prometheus', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:20:11.273665596Z [2024-05-24T23:20:11.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.send_prometheus run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status queued for try_number 1 2024-05-24T23:20:11.273926114Z [2024-05-24T23:20:11.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.collect_metrics run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:11.279201012Z [2024-05-24T23:20:11.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d7d1889-a5cd-4f72-9f7a-d2169250aeb7 2024-05-24T23:20:11.279478679Z [2024-05-24T23:20:11.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:15:00+00:00, map_index=0, run_start_date=2024-05-24 23:20:10.637269+00:00, run_end_date=2024-05-24 23:20:11.026927+00:00, run_duration=0.389658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:09.015958+00:00, queued_by_job_id=1, pid=1710 2024-05-24T23:20:13.535853132Z [2024-05-24T23:20:13.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:20:13.536213501Z [2024-05-24T23:20:13.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, execution_date=2024-05-24 23:15:00+00:00, run_id=scheduled__2024-05-24T23:15:00+00:00, run_start_date=2024-05-24 23:20:00.638670+00:00, run_end_date=2024-05-24 23:20:13.535850+00:00, run_duration=12.89718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:15:00+00:00, data_interval_end=2024-05-24 23:20:00+00:00, dag_hash=57f6cacd1dc9047f3d573889f7ef3288 2024-05-24T23:20:13.543320646Z [2024-05-24T23:20:13.542+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:25:00+00:00 2024-05-24T23:20:13.551959065Z [2024-05-24T23:20:13.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:20:13.552244288Z [2024-05-24T23:20:13.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:15:00+00:00, run_id=scheduled__2024-05-24T23:15:00+00:00, run_start_date=2024-05-24 23:20:00.639696+00:00, run_end_date=2024-05-24 23:20:13.551902+00:00, run_duration=12.912206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:15:00+00:00, data_interval_end=2024-05-24 23:20:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-24T23:20:13.558500609Z [2024-05-24T23:20:13.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:20:00+00:00, run_after=2024-05-24T23:25:00+00:00 2024-05-24T23:20:13.596969276Z [2024-05-24T23:20:13.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:13.609395018Z [2024-05-24T23:20:13.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:15:00+00:00, map_index=-1, run_start_date=2024-05-24 23:20:12.779088+00:00, run_end_date=2024-05-24 23:20:13.253535+00:00, run_duration=0.474447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:11.036376+00:00, queued_by_job_id=1, pid=1720 2024-05-24T23:20:14.695408851Z [2024-05-24T23:20:14.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.send_prometheus run_id=scheduled__2024-05-24T23:15:00+00:00 exited with status success for try_number 1 2024-05-24T23:20:14.706669273Z [2024-05-24T23:20:14.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:15:00+00:00, map_index=-1, run_start_date=2024-05-24 23:20:13.041535+00:00, run_end_date=2024-05-24 23:20:13.497902+00:00, run_duration=0.456367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:20:11.220063+00:00, queued_by_job_id=1, pid=1726 2024-05-24T23:20:27.429792602Z [2024-05-24T23:20:27.429+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T23:21:00.524745472Z [2024-05-24T23:21:00.524+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:21:00+00:00, run_after=2024-05-24T23:22:00+00:00 2024-05-24T23:21:00.553133594Z [2024-05-24T23:21:00.552+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:21:00+00:00, run_after=2024-05-24T23:22:00+00:00 2024-05-24T23:21:00.578037836Z [2024-05-24T23:21:00.577+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:21:00+00:00, run_after=2024-05-24T23:22:00+00:00 2024-05-24T23:21:00.587145002Z [2024-05-24T23:21:00.586+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:21:00.595206785Z [2024-05-24T23:21:00.594+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:21:00.704457974Z [2024-05-24T23:21:00.703+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T23:21:00.704624996Z 2024-05-24T23:21:00.704636441Z 2024-05-24T23:21:00.704645881Z 2024-05-24T23:21:00.704654225Z 2024-05-24T23:21:00.704692984Z 2024-05-24T23:21:00.704702750Z [2024-05-24T23:21:00.704+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:21:00.704728606Z [2024-05-24T23:21:00.704+0000] {scheduler_job.py:425} INFO - DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:21:00.704846348Z [2024-05-24T23:21:00.704+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:21:00.705083113Z [2024-05-24T23:21:00.704+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:21:00.705393372Z [2024-05-24T23:21:00.705+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:21:00.706062278Z [2024-05-24T23:21:00.705+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:21:00.706081242Z 2024-05-24T23:21:00.706090000Z 2024-05-24T23:21:00.706166070Z 2024-05-24T23:21:00.706175599Z 2024-05-24T23:21:00.706210681Z 2024-05-24T23:21:00.711587728Z [2024-05-24T23:21:00.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:21:00.711900417Z [2024-05-24T23:21:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:21:00.712424935Z [2024-05-24T23:21:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:21:00.712621048Z [2024-05-24T23:21:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:21:00.713062681Z [2024-05-24T23:21:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:21:00.713342933Z [2024-05-24T23:21:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:21:00.713732845Z [2024-05-24T23:21:00.713+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:21:00.713907230Z [2024-05-24T23:21:00.713+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:21:00.714357454Z [2024-05-24T23:21:00.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:21:00.714551775Z [2024-05-24T23:21:00.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:21:01.020902325Z [2024-05-24T23:21:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status queued for try_number 1 2024-05-24T23:21:01.022938693Z [2024-05-24T23:21:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status queued for try_number 1 2024-05-24T23:21:01.023052220Z [2024-05-24T23:21:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status queued for try_number 1 2024-05-24T23:21:01.023166942Z [2024-05-24T23:21:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status queued for try_number 1 2024-05-24T23:21:01.023281919Z [2024-05-24T23:21:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status queued for try_number 1 2024-05-24T23:21:01.031200680Z [2024-05-24T23:21:01.030+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93d4ad2e-b3d2-48d1-be33-622bf8e1a7ca 2024-05-24T23:21:01.031339397Z [2024-05-24T23:21:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bc33cc7-4d04-4858-9f06-3f004c3e9007 2024-05-24T23:21:01.031491797Z [2024-05-24T23:21:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 373b260f-2a82-4d60-8f76-0f8efd699e73 2024-05-24T23:21:01.031644366Z [2024-05-24T23:21:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27061e12-57d5-4302-a598-3be54a081f27 2024-05-24T23:21:01.031790526Z [2024-05-24T23:21:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b1b977e-f1fa-40f1-b960-c8990b94c8c9 2024-05-24T23:21:03.494236335Z [2024-05-24T23:21:03.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:21:03.494454800Z [2024-05-24T23:21:03.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:20:00+00:00, run_id=scheduled__2024-05-24T23:20:00+00:00, run_start_date=2024-05-24 23:21:00.610307+00:00, run_end_date=2024-05-24 23:21:03.494136+00:00, run_duration=2.883829, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:20:00+00:00, data_interval_end=2024-05-24 23:21:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:21:03.506078723Z [2024-05-24T23:21:03.505+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:21:00+00:00, run_after=2024-05-24T23:22:00+00:00 2024-05-24T23:21:03.568573220Z [2024-05-24T23:21:03.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status success for try_number 1 2024-05-24T23:21:03.573368973Z [2024-05-24T23:21:03.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:20:00+00:00, map_index=-1, run_start_date=2024-05-24 23:21:01.895455+00:00, run_end_date=2024-05-24 23:21:02.487248+00:00, run_duration=0.591793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:21:00.707189+00:00, queued_by_job_id=1, pid=1738 2024-05-24T23:21:05.588419497Z [2024-05-24T23:21:05.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:21:05.588470912Z [2024-05-24T23:21:05.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, execution_date=2024-05-24 23:20:00+00:00, run_id=scheduled__2024-05-24T23:20:00+00:00, run_start_date=2024-05-24 23:21:00.612844+00:00, run_end_date=2024-05-24 23:21:05.588000+00:00, run_duration=4.975156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:20:00+00:00, data_interval_end=2024-05-24 23:21:00+00:00, dag_hash=ba6b4825707f2085cd0ebd81d0727ada 2024-05-24T23:21:05.599022813Z [2024-05-24T23:21:05.598+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:21:00+00:00, run_after=2024-05-24T23:22:00+00:00 2024-05-24T23:21:05.608627873Z [2024-05-24T23:21:05.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:21:05.608844538Z [2024-05-24T23:21:05.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:20:00+00:00, run_id=scheduled__2024-05-24T23:20:00+00:00, run_start_date=2024-05-24 23:21:00.615271+00:00, run_end_date=2024-05-24 23:21:05.608351+00:00, run_duration=4.99308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:20:00+00:00, data_interval_end=2024-05-24 23:21:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:21:05.618993558Z [2024-05-24T23:21:05.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:21:00+00:00, run_after=2024-05-24T23:22:00+00:00 2024-05-24T23:21:05.627107714Z [2024-05-24T23:21:05.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:21:05.627231962Z [2024-05-24T23:21:05.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:20:00+00:00, run_id=scheduled__2024-05-24T23:20:00+00:00, run_start_date=2024-05-24 23:21:00.619693+00:00, run_end_date=2024-05-24 23:21:05.626785+00:00, run_duration=5.007092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:20:00+00:00, data_interval_end=2024-05-24 23:21:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:21:05.636571868Z [2024-05-24T23:21:05.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:21:00+00:00, run_after=2024-05-24T23:22:00+00:00 2024-05-24T23:21:05.645864953Z [2024-05-24T23:21:05.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:21:05.646088844Z [2024-05-24T23:21:05.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, execution_date=2024-05-24 23:20:00+00:00, run_id=scheduled__2024-05-24T23:20:00+00:00, run_start_date=2024-05-24 23:21:00.617528+00:00, run_end_date=2024-05-24 23:21:05.645690+00:00, run_duration=5.028162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:20:00+00:00, data_interval_end=2024-05-24 23:21:00+00:00, dag_hash=81d1b5a58d1b79125f83f7dc22e0bfe0 2024-05-24T23:21:05.658825064Z [2024-05-24T23:21:05.658+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:21:00+00:00, run_after=2024-05-24T23:22:00+00:00 2024-05-24T23:21:05.699046853Z [2024-05-24T23:21:05.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status success for try_number 1 2024-05-24T23:21:05.699085856Z [2024-05-24T23:21:05.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status success for try_number 1 2024-05-24T23:21:05.699185657Z [2024-05-24T23:21:05.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status success for try_number 1 2024-05-24T23:21:05.699276717Z [2024-05-24T23:21:05.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status success for try_number 1 2024-05-24T23:21:05.707419313Z [2024-05-24T23:21:05.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:20:00+00:00, map_index=-1, run_start_date=2024-05-24 23:21:03.383612+00:00, run_end_date=2024-05-24 23:21:05.028820+00:00, run_duration=1.645208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:21:00.707189+00:00, queued_by_job_id=1, pid=1775 2024-05-24T23:21:05.707896881Z [2024-05-24T23:21:05.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:20:00+00:00, map_index=-1, run_start_date=2024-05-24 23:21:03.314279+00:00, run_end_date=2024-05-24 23:21:04.913838+00:00, run_duration=1.599559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:21:00.707189+00:00, queued_by_job_id=1, pid=1774 2024-05-24T23:21:05.708069953Z [2024-05-24T23:21:05.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:20:00+00:00, map_index=-1, run_start_date=2024-05-24 23:21:02.810971+00:00, run_end_date=2024-05-24 23:21:04.998012+00:00, run_duration=2.187041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:21:00.707189+00:00, queued_by_job_id=1, pid=1752 2024-05-24T23:21:05.708225074Z [2024-05-24T23:21:05.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:20:00+00:00, map_index=-1, run_start_date=2024-05-24 23:21:03.310049+00:00, run_end_date=2024-05-24 23:21:05.230886+00:00, run_duration=1.920837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:21:00.707189+00:00, queued_by_job_id=1, pid=1773 2024-05-24T23:22:00.917151251Z [2024-05-24T23:22:00.916+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:22:00.927955233Z [2024-05-24T23:22:00.927+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:22:00.946322858Z [2024-05-24T23:22:00.945+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:22:00+00:00, run_after=2024-05-24T23:23:00+00:00 2024-05-24T23:22:00.961058693Z [2024-05-24T23:22:00.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:22:00+00:00, run_after=2024-05-24T23:23:00+00:00 2024-05-24T23:22:00.980297699Z [2024-05-24T23:22:00.979+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:22:00+00:00, run_after=2024-05-24T23:23:00+00:00 2024-05-24T23:22:00.988530562Z [2024-05-24T23:22:00.988+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:22:01.106999251Z [2024-05-24T23:22:01.106+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-05-24T23:22:01.107020986Z 2024-05-24T23:22:01.107024983Z 2024-05-24T23:22:01.107027957Z 2024-05-24T23:22:01.107045053Z 2024-05-24T23:22:01.107047987Z 2024-05-24T23:22:01.107050833Z 2024-05-24T23:22:01.107247400Z [2024-05-24T23:22:01.106+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:22:01.107434011Z [2024-05-24T23:22:01.107+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:22:01.107553203Z [2024-05-24T23:22:01.107+0000] {scheduler_job.py:425} INFO - DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:22:01.107646704Z [2024-05-24T23:22:01.107+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:22:01.107809673Z [2024-05-24T23:22:01.107+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:22:01.107953331Z [2024-05-24T23:22:01.107+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:22:01.108626082Z [2024-05-24T23:22:01.108+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:22:01.108637734Z 2024-05-24T23:22:01.108641589Z 2024-05-24T23:22:01.108645059Z 2024-05-24T23:22:01.108648595Z 2024-05-24T23:22:01.108651673Z 2024-05-24T23:22:01.108654733Z 2024-05-24T23:22:01.113378641Z [2024-05-24T23:22:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:22:01.113604152Z [2024-05-24T23:22:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:22:01.113922645Z [2024-05-24T23:22:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:22:01.114102890Z [2024-05-24T23:22:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:22:01.114438814Z [2024-05-24T23:22:01.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:22:01.114562695Z [2024-05-24T23:22:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:22:01.114850849Z [2024-05-24T23:22:01.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:22:01.115055624Z [2024-05-24T23:22:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:22:01.115266913Z [2024-05-24T23:22:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:22:01.115427096Z [2024-05-24T23:22:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:22:01.115663810Z [2024-05-24T23:22:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:22:01.115828160Z [2024-05-24T23:22:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:22:01.674212573Z [2024-05-24T23:22:01.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status queued for try_number 1 2024-05-24T23:22:01.674484652Z [2024-05-24T23:22:01.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status queued for try_number 1 2024-05-24T23:22:01.674645125Z [2024-05-24T23:22:01.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status queued for try_number 1 2024-05-24T23:22:01.674777124Z [2024-05-24T23:22:01.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status queued for try_number 1 2024-05-24T23:22:01.674941548Z [2024-05-24T23:22:01.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status queued for try_number 1 2024-05-24T23:22:01.675064409Z [2024-05-24T23:22:01.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status queued for try_number 1 2024-05-24T23:22:01.718073202Z [2024-05-24T23:22:01.717+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa841f8e-bef0-4d6d-aab9-a332645a2fec 2024-05-24T23:22:01.718134218Z [2024-05-24T23:22:01.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0c7e522-24a7-4ad4-aa56-39adaf40f8a2 2024-05-24T23:22:01.718234807Z [2024-05-24T23:22:01.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 889dacbe-3e34-489d-84e2-484457ed865c 2024-05-24T23:22:01.718333958Z [2024-05-24T23:22:01.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f840a75-9d74-4a5b-8135-702e1b684f05 2024-05-24T23:22:01.718429788Z [2024-05-24T23:22:01.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d8e40fb-fe38-4b00-830a-2cdfb78c780b 2024-05-24T23:22:01.718525382Z [2024-05-24T23:22:01.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71d0edde-c9d7-4439-81e9-fe46e32db058 2024-05-24T23:22:03.166356381Z [2024-05-24T23:22:03.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:22:03.166736409Z [2024-05-24T23:22:03.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:20:00+00:00, run_id=scheduled__2024-05-24T23:20:00+00:00, run_start_date=2024-05-24 23:22:01.012147+00:00, run_end_date=2024-05-24 23:22:03.166270+00:00, run_duration=2.154123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:20:00+00:00, data_interval_end=2024-05-24 23:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:22:03.188962479Z [2024-05-24T23:22:03.188+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:22:00+00:00, run_after=2024-05-24T23:24:00+00:00 2024-05-24T23:22:04.531379373Z [2024-05-24T23:22:04.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:22:04.531490084Z [2024-05-24T23:22:04.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:21:00+00:00, run_id=scheduled__2024-05-24T23:21:00+00:00, run_start_date=2024-05-24 23:22:01.017450+00:00, run_end_date=2024-05-24 23:22:04.531231+00:00, run_duration=3.513781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:21:00+00:00, data_interval_end=2024-05-24 23:22:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:22:04.547284590Z [2024-05-24T23:22:04.546+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:22:00+00:00, run_after=2024-05-24T23:23:00+00:00 2024-05-24T23:22:04.626793540Z [2024-05-24T23:22:04.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status success for try_number 1 2024-05-24T23:22:04.626982365Z [2024-05-24T23:22:04.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status failed for try_number 1 2024-05-24T23:22:04.627157342Z [2024-05-24T23:22:04.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status success for try_number 1 2024-05-24T23:22:04.627252083Z [2024-05-24T23:22:04.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status failed for try_number 1 2024-05-24T23:22:04.642914541Z [2024-05-24T23:22:04.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:20:00+00:00, map_index=-1, run_start_date=2024-05-24 23:22:02.572334+00:00, run_end_date=2024-05-24 23:22:03.103546+00:00, run_duration=0.531212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:22:01.109776+00:00, queued_by_job_id=1, pid=1816 2024-05-24T23:22:04.643042335Z [2024-05-24T23:22:04.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:21:00+00:00, map_index=-1, run_start_date=2024-05-24 23:22:02.994573+00:00, run_end_date=2024-05-24 23:22:03.949941+00:00, run_duration=0.955368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:22:01.109776+00:00, queued_by_job_id=1, pid=1822 2024-05-24T23:22:04.643187628Z [2024-05-24T23:22:04.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:21:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:22:01.109776+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:22:04.643580937Z [2024-05-24T23:22:04.643+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:22:04.647158222Z [2024-05-24T23:22:04.646+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:22:04.674386904Z [2024-05-24T23:22:04.674+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240524T232100, start_date=, end_date=20240524T232204 2024-05-24T23:22:04.690088534Z [2024-05-24T23:22:04.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:21:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:22:01.109776+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:22:04.690608004Z [2024-05-24T23:22:04.690+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:22:04.693680083Z [2024-05-24T23:22:04.693+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:22:04.709443265Z [2024-05-24T23:22:04.709+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240524T232100, start_date=, end_date=20240524T232204 2024-05-24T23:22:07.042774173Z [2024-05-24T23:22:07.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:22:07.044301019Z [2024-05-24T23:22:07.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:21:00+00:00, run_id=scheduled__2024-05-24T23:21:00+00:00, run_start_date=2024-05-24 23:22:01.015136+00:00, run_end_date=2024-05-24 23:22:07.042615+00:00, run_duration=6.027479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:21:00+00:00, data_interval_end=2024-05-24 23:22:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:22:07.056220689Z [2024-05-24T23:22:07.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:22:00+00:00, run_after=2024-05-24T23:23:00+00:00 2024-05-24T23:22:07.064822193Z [2024-05-24T23:22:07.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:22:07.065351459Z [2024-05-24T23:22:07.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:21:00+00:00, run_id=scheduled__2024-05-24T23:21:00+00:00, run_start_date=2024-05-24 23:22:01.018549+00:00, run_end_date=2024-05-24 23:22:07.064736+00:00, run_duration=6.046187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:21:00+00:00, data_interval_end=2024-05-24 23:22:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:22:07.075122842Z [2024-05-24T23:22:07.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:22:00+00:00, run_after=2024-05-24T23:23:00+00:00 2024-05-24T23:22:07.142888841Z [2024-05-24T23:22:07.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status success for try_number 1 2024-05-24T23:22:07.143117067Z [2024-05-24T23:22:07.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status success for try_number 1 2024-05-24T23:22:07.155061107Z [2024-05-24T23:22:07.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:21:00+00:00, map_index=-1, run_start_date=2024-05-24 23:22:04.923358+00:00, run_end_date=2024-05-24 23:22:06.183770+00:00, run_duration=1.260412, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:22:01.109776+00:00, queued_by_job_id=1, pid=1863 2024-05-24T23:22:07.155422312Z [2024-05-24T23:22:07.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:21:00+00:00, map_index=-1, run_start_date=2024-05-24 23:22:04.806846+00:00, run_end_date=2024-05-24 23:22:06.509803+00:00, run_duration=1.702957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:22:01.109776+00:00, queued_by_job_id=1, pid=1862 2024-05-24T23:22:15.458258051Z [2024-05-24T23:22:15.457+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-24T23:22:15.458296827Z 2024-05-24T23:22:15.458302939Z 2024-05-24T23:22:15.458338958Z [2024-05-24T23:22:15.458+0000] {scheduler_job.py:425} INFO - DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:22:15.458350625Z [2024-05-24T23:22:15.458+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 has 0/16 running and queued tasks 2024-05-24T23:22:15.458844588Z [2024-05-24T23:22:15.458+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:22:15.458856773Z 2024-05-24T23:22:15.458864005Z 2024-05-24T23:22:15.461199803Z [2024-05-24T23:22:15.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:21:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:22:15.461346757Z [2024-05-24T23:22:15.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:22:15.461667319Z [2024-05-24T23:22:15.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:21:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:22:15.461812442Z [2024-05-24T23:22:15.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:22:15.639537733Z [2024-05-24T23:22:15.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status queued for try_number 2 2024-05-24T23:22:15.641503133Z [2024-05-24T23:22:15.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status queued for try_number 2 2024-05-24T23:22:15.653732775Z [2024-05-24T23:22:15.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51672fb9-bf81-4526-a52e-921ec2a896b7 2024-05-24T23:22:15.654045315Z [2024-05-24T23:22:15.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8abb8c3-bfbe-40c6-bcc2-b71835c9e0c5 2024-05-24T23:22:17.289826779Z [2024-05-24T23:22:17.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status failed for try_number 2 2024-05-24T23:22:17.289868958Z [2024-05-24T23:22:17.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:21:00+00:00 exited with status failed for try_number 2 2024-05-24T23:22:17.299093135Z [2024-05-24T23:22:17.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:21:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 23:22:04.655205+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:22:15.459266+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:22:17.299634045Z [2024-05-24T23:22:17.299+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:22:17.304137391Z [2024-05-24T23:22:17.302+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:22:17.320436907Z [2024-05-24T23:22:17.320+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240524T232100, start_date=, end_date=20240524T232217 2024-05-24T23:22:17.330311577Z [2024-05-24T23:22:17.329+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:21:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 23:22:04.696066+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:22:15.459266+00:00, queued_by_job_id=1, pid=None 2024-05-24T23:22:17.330758077Z [2024-05-24T23:22:17.330+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:22:17.333384118Z [2024-05-24T23:22:17.333+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T23:22:17.344814823Z [2024-05-24T23:22:17.344+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240524T232100, start_date=, end_date=20240524T232217 2024-05-24T23:22:18.442382770Z [2024-05-24T23:22:18.441+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T23:22:18.443105911Z [2024-05-24T23:22:18.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, execution_date=2024-05-24 23:21:00+00:00, run_id=scheduled__2024-05-24T23:21:00+00:00, run_start_date=2024-05-24 23:22:01.016183+00:00, run_end_date=2024-05-24 23:22:18.442346+00:00, run_duration=17.426163, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:21:00+00:00, data_interval_end=2024-05-24 23:22:00+00:00, dag_hash=ba6b4825707f2085cd0ebd81d0727ada 2024-05-24T23:22:18.456771377Z [2024-05-24T23:22:18.456+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:22:00+00:00, run_after=2024-05-24T23:23:00+00:00 2024-05-24T23:22:18.464728612Z [2024-05-24T23:22:18.464+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T23:22:18.465178985Z [2024-05-24T23:22:18.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3, execution_date=2024-05-24 23:21:00+00:00, run_id=scheduled__2024-05-24T23:21:00+00:00, run_start_date=2024-05-24 23:22:01.013957+00:00, run_end_date=2024-05-24 23:22:18.464874+00:00, run_duration=17.450917, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:21:00+00:00, data_interval_end=2024-05-24 23:22:00+00:00, dag_hash=81d1b5a58d1b79125f83f7dc22e0bfe0 2024-05-24T23:22:18.475525959Z [2024-05-24T23:22:18.475+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 to 2024-05-24T23:22:00+00:00, run_after=2024-05-24T23:23:00+00:00 2024-05-24T23:23:00.139463994Z [2024-05-24T23:23:00.138+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:23:00+00:00, run_after=2024-05-24T23:24:00+00:00 2024-05-24T23:23:00.164885987Z [2024-05-24T23:23:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:23:00+00:00, run_after=2024-05-24T23:24:00+00:00 2024-05-24T23:23:00.176749647Z [2024-05-24T23:23:00.176+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:23:00.255471719Z [2024-05-24T23:23:00.255+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:23:00.255523244Z 2024-05-24T23:23:00.255532049Z 2024-05-24T23:23:00.255539290Z 2024-05-24T23:23:00.255573950Z [2024-05-24T23:23:00.255+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:23:00.255599285Z [2024-05-24T23:23:00.255+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:23:00.255848227Z [2024-05-24T23:23:00.255+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:23:00.256627252Z [2024-05-24T23:23:00.256+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:23:00.256639552Z 2024-05-24T23:23:00.256646980Z 2024-05-24T23:23:00.256681614Z 2024-05-24T23:23:00.260302441Z [2024-05-24T23:23:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:23:00.260677667Z [2024-05-24T23:23:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:23:00.260902707Z [2024-05-24T23:23:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:23:00.261186754Z [2024-05-24T23:23:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:23:00.261626861Z [2024-05-24T23:23:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:23:00.261753776Z [2024-05-24T23:23:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:23:00.485563440Z [2024-05-24T23:23:00.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:22:00+00:00 exited with status queued for try_number 1 2024-05-24T23:23:00.485801583Z [2024-05-24T23:23:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:22:00+00:00 exited with status queued for try_number 1 2024-05-24T23:23:00.485968631Z [2024-05-24T23:23:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:22:00+00:00 exited with status queued for try_number 1 2024-05-24T23:23:00.493017686Z [2024-05-24T23:23:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to a947d047-8c2e-4fb9-9221-d6c261550722 2024-05-24T23:23:00.493248749Z [2024-05-24T23:23:00.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f02086e-4064-4c5b-9a8f-867f740a2722 2024-05-24T23:23:00.493459031Z [2024-05-24T23:23:00.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15abe184-bd11-4042-9435-bdfcef2e6505 2024-05-24T23:23:01.634291357Z [2024-05-24T23:23:01.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:23:01.634660016Z [2024-05-24T23:23:01.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:22:00+00:00, run_id=scheduled__2024-05-24T23:22:00+00:00, run_start_date=2024-05-24 23:23:00.189671+00:00, run_end_date=2024-05-24 23:23:01.634219+00:00, run_duration=1.444548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:22:00+00:00, data_interval_end=2024-05-24 23:23:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:23:01.643432044Z [2024-05-24T23:23:01.643+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:23:00+00:00, run_after=2024-05-24T23:24:00+00:00 2024-05-24T23:23:01.686109893Z [2024-05-24T23:23:01.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:22:00+00:00 exited with status success for try_number 1 2024-05-24T23:23:01.690756775Z [2024-05-24T23:23:01.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:22:00+00:00, map_index=-1, run_start_date=2024-05-24 23:23:01.069491+00:00, run_end_date=2024-05-24 23:23:01.487484+00:00, run_duration=0.417993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:23:00.257388+00:00, queued_by_job_id=1, pid=1920 2024-05-24T23:23:04.230854409Z [2024-05-24T23:23:04.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:23:04.231107095Z [2024-05-24T23:23:04.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:22:00+00:00, run_id=scheduled__2024-05-24T23:22:00+00:00, run_start_date=2024-05-24 23:23:00.192875+00:00, run_end_date=2024-05-24 23:23:04.230752+00:00, run_duration=4.037877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:22:00+00:00, data_interval_end=2024-05-24 23:23:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:23:04.240012649Z [2024-05-24T23:23:04.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:23:00+00:00, run_after=2024-05-24T23:24:00+00:00 2024-05-24T23:23:04.249647860Z [2024-05-24T23:23:04.248+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:23:04.250320095Z [2024-05-24T23:23:04.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:22:00+00:00, run_id=scheduled__2024-05-24T23:22:00+00:00, run_start_date=2024-05-24 23:23:00.195315+00:00, run_end_date=2024-05-24 23:23:04.249797+00:00, run_duration=4.054482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:22:00+00:00, data_interval_end=2024-05-24 23:23:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:23:04.262938081Z [2024-05-24T23:23:04.262+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:23:00+00:00, run_after=2024-05-24T23:24:00+00:00 2024-05-24T23:23:04.299232717Z [2024-05-24T23:23:04.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:22:00+00:00 exited with status success for try_number 1 2024-05-24T23:23:04.299538223Z [2024-05-24T23:23:04.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:22:00+00:00 exited with status success for try_number 1 2024-05-24T23:23:04.310514731Z [2024-05-24T23:23:04.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:22:00+00:00, map_index=-1, run_start_date=2024-05-24 23:23:02.048711+00:00, run_end_date=2024-05-24 23:23:03.357532+00:00, run_duration=1.308821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:23:00.257388+00:00, queued_by_job_id=1, pid=1938 2024-05-24T23:23:04.310935991Z [2024-05-24T23:23:04.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:22:00+00:00, map_index=-1, run_start_date=2024-05-24 23:23:02.078111+00:00, run_end_date=2024-05-24 23:23:03.613821+00:00, run_duration=1.53571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:23:00.257388+00:00, queued_by_job_id=1, pid=1939 2024-05-24T23:24:00.045423103Z [2024-05-24T23:24:00.044+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:24:00.060686940Z [2024-05-24T23:24:00.060+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:24:00+00:00, run_after=2024-05-24T23:25:00+00:00 2024-05-24T23:24:00.067829425Z [2024-05-24T23:24:00.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:24:00.079466664Z [2024-05-24T23:24:00.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:24:00+00:00, run_after=2024-05-24T23:25:00+00:00 2024-05-24T23:24:00.173349978Z [2024-05-24T23:24:00.172+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:24:00.173381973Z 2024-05-24T23:24:00.173390310Z 2024-05-24T23:24:00.173396275Z 2024-05-24T23:24:00.173401980Z 2024-05-24T23:24:00.173691993Z [2024-05-24T23:24:00.173+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:24:00.173915676Z [2024-05-24T23:24:00.173+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:24:00.174214157Z [2024-05-24T23:24:00.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:24:00.174538088Z [2024-05-24T23:24:00.174+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:24:00.175585789Z [2024-05-24T23:24:00.175+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:24:00.175614924Z 2024-05-24T23:24:00.175629089Z 2024-05-24T23:24:00.175641322Z 2024-05-24T23:24:00.175652601Z 2024-05-24T23:24:00.181143226Z [2024-05-24T23:24:00.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:24:00.181486308Z [2024-05-24T23:24:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:24:00.181960912Z [2024-05-24T23:24:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:24:00.182188637Z [2024-05-24T23:24:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:24:00.182608159Z [2024-05-24T23:24:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:24:00.182826127Z [2024-05-24T23:24:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:24:00.183046476Z [2024-05-24T23:24:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:24:00.183071357Z [2024-05-24T23:24:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:24:00.620616001Z [2024-05-24T23:24:00.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:22:00+00:00 exited with status queued for try_number 1 2024-05-24T23:24:00.620909275Z [2024-05-24T23:24:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:23:00+00:00 exited with status queued for try_number 1 2024-05-24T23:24:00.621149278Z [2024-05-24T23:24:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:23:00+00:00 exited with status queued for try_number 1 2024-05-24T23:24:00.621460222Z [2024-05-24T23:24:00.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:23:00+00:00 exited with status queued for try_number 1 2024-05-24T23:24:00.637055096Z [2024-05-24T23:24:00.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to b292d48b-0f66-4d3c-817f-b6ccddcafbc0 2024-05-24T23:24:00.637457265Z [2024-05-24T23:24:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3e9536d-6b8c-4d1d-8423-52e1937e03f0 2024-05-24T23:24:00.637695733Z [2024-05-24T23:24:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbe9ee8b-a6cb-4d0c-8413-cc35d12d0634 2024-05-24T23:24:00.637940283Z [2024-05-24T23:24:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3010b5ab-278d-46ac-8884-f21a259281fc 2024-05-24T23:24:01.991828652Z [2024-05-24T23:24:01.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:24:01.992147076Z [2024-05-24T23:24:01.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:22:00+00:00, run_id=scheduled__2024-05-24T23:22:00+00:00, run_start_date=2024-05-24 23:24:00.094065+00:00, run_end_date=2024-05-24 23:24:01.991784+00:00, run_duration=1.897719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:22:00+00:00, data_interval_end=2024-05-24 23:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:24:01.999511128Z [2024-05-24T23:24:01.999+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:24:00+00:00, run_after=2024-05-24T23:26:00+00:00 2024-05-24T23:24:02.009374953Z [2024-05-24T23:24:02.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:24:02.009552135Z [2024-05-24T23:24:02.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:23:00+00:00, run_id=scheduled__2024-05-24T23:23:00+00:00, run_start_date=2024-05-24 23:24:00.095884+00:00, run_end_date=2024-05-24 23:24:02.009111+00:00, run_duration=1.913227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:23:00+00:00, data_interval_end=2024-05-24 23:24:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:24:02.022274147Z [2024-05-24T23:24:02.021+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:24:00+00:00, run_after=2024-05-24T23:25:00+00:00 2024-05-24T23:24:02.067020939Z [2024-05-24T23:24:02.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:22:00+00:00 exited with status success for try_number 1 2024-05-24T23:24:02.067113324Z [2024-05-24T23:24:02.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:23:00+00:00 exited with status success for try_number 1 2024-05-24T23:24:02.072892753Z [2024-05-24T23:24:02.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:22:00+00:00, map_index=-1, run_start_date=2024-05-24 23:24:00.951833+00:00, run_end_date=2024-05-24 23:24:01.348964+00:00, run_duration=0.397131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:24:00.176612+00:00, queued_by_job_id=1, pid=1972 2024-05-24T23:24:02.073175455Z [2024-05-24T23:24:02.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:23:00+00:00, map_index=-1, run_start_date=2024-05-24 23:24:01.042850+00:00, run_end_date=2024-05-24 23:24:01.513565+00:00, run_duration=0.470715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:24:00.176612+00:00, queued_by_job_id=1, pid=1973 2024-05-24T23:24:04.041679087Z [2024-05-24T23:24:04.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:24:04.042058124Z [2024-05-24T23:24:04.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:23:00+00:00, run_id=scheduled__2024-05-24T23:23:00+00:00, run_start_date=2024-05-24 23:24:00.096945+00:00, run_end_date=2024-05-24 23:24:04.041687+00:00, run_duration=3.944742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:23:00+00:00, data_interval_end=2024-05-24 23:24:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:24:04.051613198Z [2024-05-24T23:24:04.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:24:00+00:00, run_after=2024-05-24T23:25:00+00:00 2024-05-24T23:24:04.057950882Z [2024-05-24T23:24:04.057+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:24:04.058257419Z [2024-05-24T23:24:04.058+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:23:00+00:00, run_id=scheduled__2024-05-24T23:23:00+00:00, run_start_date=2024-05-24 23:24:00.097965+00:00, run_end_date=2024-05-24 23:24:04.057950+00:00, run_duration=3.959985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:23:00+00:00, data_interval_end=2024-05-24 23:24:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:24:04.068993183Z [2024-05-24T23:24:04.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:24:00+00:00, run_after=2024-05-24T23:25:00+00:00 2024-05-24T23:24:04.106444922Z [2024-05-24T23:24:04.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:23:00+00:00 exited with status success for try_number 1 2024-05-24T23:24:04.112878078Z [2024-05-24T23:24:04.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:23:00+00:00, map_index=-1, run_start_date=2024-05-24 23:24:02.161848+00:00, run_end_date=2024-05-24 23:24:03.588009+00:00, run_duration=1.426161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:24:00.176612+00:00, queued_by_job_id=1, pid=1996 2024-05-24T23:24:05.231104768Z [2024-05-24T23:24:05.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:23:00+00:00 exited with status success for try_number 1 2024-05-24T23:24:05.241871411Z [2024-05-24T23:24:05.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:23:00+00:00, map_index=-1, run_start_date=2024-05-24 23:24:02.178765+00:00, run_end_date=2024-05-24 23:24:03.988076+00:00, run_duration=1.809311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:24:00.176612+00:00, queued_by_job_id=1, pid=1997 2024-05-24T23:25:00.990819427Z [2024-05-24T23:25:00.989+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:25:00+00:00, run_after=2024-05-24T23:26:00+00:00 2024-05-24T23:25:01.024404207Z [2024-05-24T23:25:01.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:25:00+00:00, run_after=2024-05-24T23:30:00+00:00 2024-05-24T23:25:01.043674334Z [2024-05-24T23:25:01.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:25:00+00:00, run_after=2024-05-24T23:26:00+00:00 2024-05-24T23:25:01.053903453Z [2024-05-24T23:25:01.053+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:25:01.157963948Z [2024-05-24T23:25:01.157+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:25:01.158043691Z 2024-05-24T23:25:01.158095228Z 2024-05-24T23:25:01.158105339Z 2024-05-24T23:25:01.158113924Z 2024-05-24T23:25:01.158123032Z [2024-05-24T23:25:01.157+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:25:01.158131704Z [2024-05-24T23:25:01.157+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:25:01.158858312Z [2024-05-24T23:25:01.157+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:25:01.159139001Z [2024-05-24T23:25:01.158+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:25:01.160023046Z [2024-05-24T23:25:01.159+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:25:01.160038955Z 2024-05-24T23:25:01.160044164Z 2024-05-24T23:25:01.160048850Z 2024-05-24T23:25:01.160071020Z 2024-05-24T23:25:01.165363836Z [2024-05-24T23:25:01.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:25:01.165807554Z [2024-05-24T23:25:01.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:25:01.166278453Z [2024-05-24T23:25:01.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:25:01.166638845Z [2024-05-24T23:25:01.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:25:01.166950219Z [2024-05-24T23:25:01.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:25:01.167196692Z [2024-05-24T23:25:01.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:25:01.167580564Z [2024-05-24T23:25:01.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:25:01.167814476Z [2024-05-24T23:25:01.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:25:01.730371926Z [2024-05-24T23:25:01.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status queued for try_number 1 2024-05-24T23:25:01.730488210Z [2024-05-24T23:25:01.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:24:00+00:00 exited with status queued for try_number 1 2024-05-24T23:25:01.730502251Z [2024-05-24T23:25:01.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:24:00+00:00 exited with status queued for try_number 1 2024-05-24T23:25:01.730513797Z [2024-05-24T23:25:01.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:24:00+00:00 exited with status queued for try_number 1 2024-05-24T23:25:01.754694719Z [2024-05-24T23:25:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 870f790a-a2f6-4c59-b837-033309d19685 2024-05-24T23:25:01.754818740Z [2024-05-24T23:25:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59dbdcd6-ba37-4d38-adb4-418a16dcacc5 2024-05-24T23:25:01.755039850Z [2024-05-24T23:25:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3da55b4-f029-4bd4-93cb-99ff2c4b4a04 2024-05-24T23:25:01.755159261Z [2024-05-24T23:25:01.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a2701bf-6b38-4dbc-a924-9632316aa7c6 2024-05-24T23:25:02.937327931Z [2024-05-24T23:25:02.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:25:02.937729837Z [2024-05-24T23:25:02.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:24:00+00:00, run_id=scheduled__2024-05-24T23:24:00+00:00, run_start_date=2024-05-24 23:25:01.074205+00:00, run_end_date=2024-05-24 23:25:02.937353+00:00, run_duration=1.863148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:24:00+00:00, data_interval_end=2024-05-24 23:25:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:25:02.947503016Z [2024-05-24T23:25:02.947+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:25:00+00:00, run_after=2024-05-24T23:26:00+00:00 2024-05-24T23:25:03.013910857Z [2024-05-24T23:25:03.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:24:00+00:00 exited with status success for try_number 1 2024-05-24T23:25:03.019290037Z [2024-05-24T23:25:03.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:24:00+00:00, map_index=-1, run_start_date=2024-05-24 23:25:01.984248+00:00, run_end_date=2024-05-24 23:25:02.468650+00:00, run_duration=0.484402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:25:01.161378+00:00, queued_by_job_id=1, pid=2030 2024-05-24T23:25:04.130642810Z [2024-05-24T23:25:04.130+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:25:04.130679756Z 2024-05-24T23:25:04.130747291Z [2024-05-24T23:25:04.130+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:25:04.131438090Z [2024-05-24T23:25:04.131+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:25:04.131464270Z 2024-05-24T23:25:04.134066918Z [2024-05-24T23:25:04.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:25:04.134083052Z [2024-05-24T23:25:04.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:25:04.199872371Z [2024-05-24T23:25:04.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status queued for try_number 1 2024-05-24T23:25:04.200020835Z [2024-05-24T23:25:04.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status success for try_number 1 2024-05-24T23:25:04.207631772Z [2024-05-24T23:25:04.207+0000] {scheduler_job.py:635} INFO - Setting external_id for to e311c999-6883-4fff-9cbf-73b7ffe4540c 2024-05-24T23:25:04.207963701Z [2024-05-24T23:25:04.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:20:00+00:00, map_index=-1, run_start_date=2024-05-24 23:25:03.306116+00:00, run_end_date=2024-05-24 23:25:03.711720+00:00, run_duration=0.405604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:25:01.161378+00:00, queued_by_job_id=1, pid=2055 2024-05-24T23:25:05.001187623Z [2024-05-24T23:25:05.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:25:05.001737528Z [2024-05-24T23:25:05.001+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:24:00+00:00, run_id=scheduled__2024-05-24T23:24:00+00:00, run_start_date=2024-05-24 23:25:01.076162+00:00, run_end_date=2024-05-24 23:25:05.001084+00:00, run_duration=3.924922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:24:00+00:00, data_interval_end=2024-05-24 23:25:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:25:05.014063747Z [2024-05-24T23:25:05.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:25:00+00:00, run_after=2024-05-24T23:26:00+00:00 2024-05-24T23:25:05.023543149Z [2024-05-24T23:25:05.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:25:05.023818115Z [2024-05-24T23:25:05.023+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:24:00+00:00, run_id=scheduled__2024-05-24T23:24:00+00:00, run_start_date=2024-05-24 23:25:01.077719+00:00, run_end_date=2024-05-24 23:25:05.023390+00:00, run_duration=3.945671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:24:00+00:00, data_interval_end=2024-05-24 23:25:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:25:05.033191598Z [2024-05-24T23:25:05.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:25:00+00:00, run_after=2024-05-24T23:26:00+00:00 2024-05-24T23:25:05.093873044Z [2024-05-24T23:25:05.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:24:00+00:00 exited with status success for try_number 1 2024-05-24T23:25:05.094002912Z [2024-05-24T23:25:05.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:24:00+00:00 exited with status success for try_number 1 2024-05-24T23:25:05.105021473Z [2024-05-24T23:25:05.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:24:00+00:00, map_index=-1, run_start_date=2024-05-24 23:25:03.321520+00:00, run_end_date=2024-05-24 23:25:04.526863+00:00, run_duration=1.205343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:25:01.161378+00:00, queued_by_job_id=1, pid=2056 2024-05-24T23:25:05.105417836Z [2024-05-24T23:25:05.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:24:00+00:00, map_index=-1, run_start_date=2024-05-24 23:25:03.106102+00:00, run_end_date=2024-05-24 23:25:04.810653+00:00, run_duration=1.704551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:25:01.161378+00:00, queued_by_job_id=1, pid=2051 2024-05-24T23:25:06.766075404Z [2024-05-24T23:25:06.765+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:25:06.766134643Z 2024-05-24T23:25:06.766149244Z [2024-05-24T23:25:06.765+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:25:06.766478151Z [2024-05-24T23:25:06.766+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:25:06.766498447Z 2024-05-24T23:25:06.768641480Z [2024-05-24T23:25:06.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:25:06.768677733Z [2024-05-24T23:25:06.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:25:06.832311544Z [2024-05-24T23:25:06.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status queued for try_number 1 2024-05-24T23:25:06.832744046Z [2024-05-24T23:25:06.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status success for try_number 1 2024-05-24T23:25:06.840133646Z [2024-05-24T23:25:06.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4180bbdb-b01f-448e-be57-ac040aa3ab77 2024-05-24T23:25:06.840458163Z [2024-05-24T23:25:06.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:20:00+00:00, map_index=-1, run_start_date=2024-05-24 23:25:05.888126+00:00, run_end_date=2024-05-24 23:25:06.254632+00:00, run_duration=0.366506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:25:04.131805+00:00, queued_by_job_id=1, pid=2079 2024-05-24T23:25:09.116610124Z [2024-05-24T23:25:09.116+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:25:09.116641952Z 2024-05-24T23:25:09.116806412Z [2024-05-24T23:25:09.116+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:25:09.117717055Z [2024-05-24T23:25:09.117+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:25:09.117734468Z 2024-05-24T23:25:09.121157550Z [2024-05-24T23:25:09.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:25:09.121687669Z [2024-05-24T23:25:09.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:25:09.190836100Z [2024-05-24T23:25:09.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status queued for try_number 1 2024-05-24T23:25:09.191072875Z [2024-05-24T23:25:09.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status success for try_number 1 2024-05-24T23:25:09.199780504Z [2024-05-24T23:25:09.199+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d52c604-04db-4024-b1ff-1cecccc8c31b 2024-05-24T23:25:09.200040177Z [2024-05-24T23:25:09.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:20:00+00:00, map_index=0, run_start_date=2024-05-24 23:25:08.455212+00:00, run_end_date=2024-05-24 23:25:08.800702+00:00, run_duration=0.34549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:25:06.766669+00:00, queued_by_job_id=1, pid=2101 2024-05-24T23:25:11.840063662Z [2024-05-24T23:25:11.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:25:11.840411541Z [2024-05-24T23:25:11.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:20:00+00:00, run_id=scheduled__2024-05-24T23:20:00+00:00, run_start_date=2024-05-24 23:25:01.071872+00:00, run_end_date=2024-05-24 23:25:11.839912+00:00, run_duration=10.76804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:20:00+00:00, data_interval_end=2024-05-24 23:25:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-24T23:25:11.852029898Z [2024-05-24T23:25:11.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:25:00+00:00, run_after=2024-05-24T23:30:00+00:00 2024-05-24T23:25:11.896090587Z [2024-05-24T23:25:11.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:20:00+00:00 exited with status success for try_number 1 2024-05-24T23:25:11.904620631Z [2024-05-24T23:25:11.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:20:00+00:00, map_index=-1, run_start_date=2024-05-24 23:25:10.897445+00:00, run_end_date=2024-05-24 23:25:11.297807+00:00, run_duration=0.400362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:25:09.118192+00:00, queued_by_job_id=1, pid=2109 2024-05-24T23:25:27.506875966Z [2024-05-24T23:25:27.506+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T23:26:00.101041188Z [2024-05-24T23:26:00.100+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:26:00.115245876Z [2024-05-24T23:26:00.114+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:26:00+00:00, run_after=2024-05-24T23:27:00+00:00 2024-05-24T23:26:00.122220287Z [2024-05-24T23:26:00.121+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:26:00.133923871Z [2024-05-24T23:26:00.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:26:00+00:00, run_after=2024-05-24T23:27:00+00:00 2024-05-24T23:26:00.226984127Z [2024-05-24T23:26:00.226+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:26:00.227022314Z 2024-05-24T23:26:00.227031571Z 2024-05-24T23:26:00.227038651Z 2024-05-24T23:26:00.227045577Z 2024-05-24T23:26:00.227084770Z [2024-05-24T23:26:00.226+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:26:00.227318534Z [2024-05-24T23:26:00.227+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:26:00.227406072Z [2024-05-24T23:26:00.227+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:26:00.227671178Z [2024-05-24T23:26:00.227+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:26:00.228493372Z [2024-05-24T23:26:00.228+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:26:00.228507594Z 2024-05-24T23:26:00.228514726Z 2024-05-24T23:26:00.228521388Z 2024-05-24T23:26:00.228527915Z 2024-05-24T23:26:00.233588884Z [2024-05-24T23:26:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:26:00.234055924Z [2024-05-24T23:26:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:26:00.234496844Z [2024-05-24T23:26:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:26:00.234743413Z [2024-05-24T23:26:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:26:00.235245875Z [2024-05-24T23:26:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:26:00.235537971Z [2024-05-24T23:26:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:26:00.235987548Z [2024-05-24T23:26:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:26:00.236339544Z [2024-05-24T23:26:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:26:00.838375788Z [2024-05-24T23:26:00.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:24:00+00:00 exited with status queued for try_number 1 2024-05-24T23:26:00.838720345Z [2024-05-24T23:26:00.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status queued for try_number 1 2024-05-24T23:26:00.841700462Z [2024-05-24T23:26:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status queued for try_number 1 2024-05-24T23:26:00.841994243Z [2024-05-24T23:26:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status queued for try_number 1 2024-05-24T23:26:00.859490455Z [2024-05-24T23:26:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to 825f09df-c245-4624-924a-abf2e4c4d814 2024-05-24T23:26:00.859845289Z [2024-05-24T23:26:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46d559e7-7eca-48fc-bc3b-9482a66b19e6 2024-05-24T23:26:00.860093000Z [2024-05-24T23:26:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b2bf7ac-838c-4e89-8a45-4186916401ec 2024-05-24T23:26:00.860454772Z [2024-05-24T23:26:00.860+0000] {scheduler_job.py:635} INFO - Setting external_id for to bad0b08a-a178-41d7-9eed-972733d6efb4 2024-05-24T23:26:02.100140867Z [2024-05-24T23:26:02.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:26:02.100841270Z [2024-05-24T23:26:02.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:24:00+00:00, run_id=scheduled__2024-05-24T23:24:00+00:00, run_start_date=2024-05-24 23:26:00.145794+00:00, run_end_date=2024-05-24 23:26:02.100140+00:00, run_duration=1.954346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:24:00+00:00, data_interval_end=2024-05-24 23:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:26:02.109001954Z [2024-05-24T23:26:02.108+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:26:00+00:00, run_after=2024-05-24T23:28:00+00:00 2024-05-24T23:26:02.118172476Z [2024-05-24T23:26:02.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:26:02.118543259Z [2024-05-24T23:26:02.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:25:00+00:00, run_id=scheduled__2024-05-24T23:25:00+00:00, run_start_date=2024-05-24 23:26:00.147162+00:00, run_end_date=2024-05-24 23:26:02.118222+00:00, run_duration=1.97106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:25:00+00:00, data_interval_end=2024-05-24 23:26:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:26:02.131894217Z [2024-05-24T23:26:02.131+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:26:00+00:00, run_after=2024-05-24T23:27:00+00:00 2024-05-24T23:26:02.214542157Z [2024-05-24T23:26:02.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:24:00+00:00 exited with status success for try_number 1 2024-05-24T23:26:02.214572356Z [2024-05-24T23:26:02.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status success for try_number 1 2024-05-24T23:26:02.230416229Z [2024-05-24T23:26:02.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:25:00+00:00, map_index=-1, run_start_date=2024-05-24 23:26:01.516583+00:00, run_end_date=2024-05-24 23:26:01.880024+00:00, run_duration=0.363441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:26:00.229592+00:00, queued_by_job_id=1, pid=2126 2024-05-24T23:26:02.230447162Z [2024-05-24T23:26:02.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:24:00+00:00, map_index=-1, run_start_date=2024-05-24 23:26:00.970009+00:00, run_end_date=2024-05-24 23:26:01.465008+00:00, run_duration=0.494999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:26:00.229592+00:00, queued_by_job_id=1, pid=2114 2024-05-24T23:26:04.400171058Z [2024-05-24T23:26:04.399+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:26:04.400823719Z [2024-05-24T23:26:04.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:25:00+00:00, run_id=scheduled__2024-05-24T23:25:00+00:00, run_start_date=2024-05-24 23:26:00.148661+00:00, run_end_date=2024-05-24 23:26:04.400099+00:00, run_duration=4.251438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:25:00+00:00, data_interval_end=2024-05-24 23:26:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:26:04.413575894Z [2024-05-24T23:26:04.413+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:26:00+00:00, run_after=2024-05-24T23:27:00+00:00 2024-05-24T23:26:04.463744197Z [2024-05-24T23:26:04.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status success for try_number 1 2024-05-24T23:26:04.474852544Z [2024-05-24T23:26:04.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:25:00+00:00, map_index=-1, run_start_date=2024-05-24 23:26:02.371940+00:00, run_end_date=2024-05-24 23:26:03.790824+00:00, run_duration=1.418884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:26:00.229592+00:00, queued_by_job_id=1, pid=2143 2024-05-24T23:26:05.529708770Z [2024-05-24T23:26:05.528+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:26:05.530174572Z [2024-05-24T23:26:05.529+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:25:00+00:00, run_id=scheduled__2024-05-24T23:25:00+00:00, run_start_date=2024-05-24 23:26:00.149990+00:00, run_end_date=2024-05-24 23:26:05.529566+00:00, run_duration=5.379576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:25:00+00:00, data_interval_end=2024-05-24 23:26:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:26:05.544745054Z [2024-05-24T23:26:05.544+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:26:00+00:00, run_after=2024-05-24T23:27:00+00:00 2024-05-24T23:26:05.574285981Z [2024-05-24T23:26:05.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status success for try_number 1 2024-05-24T23:26:05.579800063Z [2024-05-24T23:26:05.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:25:00+00:00, map_index=-1, run_start_date=2024-05-24 23:26:02.500194+00:00, run_end_date=2024-05-24 23:26:04.768368+00:00, run_duration=2.268174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:26:00.229592+00:00, queued_by_job_id=1, pid=2144 2024-05-24T23:27:01.101253684Z [2024-05-24T23:27:01.100+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:27:00+00:00, run_after=2024-05-24T23:28:00+00:00 2024-05-24T23:27:01.117187239Z [2024-05-24T23:27:01.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:27:00+00:00, run_after=2024-05-24T23:28:00+00:00 2024-05-24T23:27:01.125529348Z [2024-05-24T23:27:01.125+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:27:01.206122908Z [2024-05-24T23:27:01.205+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:27:01.206195404Z 2024-05-24T23:27:01.206208676Z 2024-05-24T23:27:01.206217561Z 2024-05-24T23:27:01.206276252Z [2024-05-24T23:27:01.206+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:27:01.206466646Z [2024-05-24T23:27:01.206+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:27:01.206601608Z [2024-05-24T23:27:01.206+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:27:01.207547448Z [2024-05-24T23:27:01.207+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:27:01.207563705Z 2024-05-24T23:27:01.207571850Z 2024-05-24T23:27:01.207579542Z 2024-05-24T23:27:01.213167708Z [2024-05-24T23:27:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:27:01.213519490Z [2024-05-24T23:27:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:27:01.213976497Z [2024-05-24T23:27:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:27:01.214175328Z [2024-05-24T23:27:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:27:01.214625614Z [2024-05-24T23:27:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:27:01.214872216Z [2024-05-24T23:27:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:27:01.509444388Z [2024-05-24T23:27:01.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:26:00+00:00 exited with status queued for try_number 1 2024-05-24T23:27:01.509849698Z [2024-05-24T23:27:01.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:26:00+00:00 exited with status queued for try_number 1 2024-05-24T23:27:01.510139111Z [2024-05-24T23:27:01.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:26:00+00:00 exited with status queued for try_number 1 2024-05-24T23:27:01.527906105Z [2024-05-24T23:27:01.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to d88f838f-ee6e-43ae-999f-2964af6b87ac 2024-05-24T23:27:01.528411155Z [2024-05-24T23:27:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6c11100-f890-4ad1-9238-72498e13c5e7 2024-05-24T23:27:01.528759858Z [2024-05-24T23:27:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cbd3b5b-c1bb-4be4-9dfd-8e0c1138785d 2024-05-24T23:27:03.705143591Z [2024-05-24T23:27:03.704+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:27:03.705473651Z [2024-05-24T23:27:03.705+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:26:00+00:00, run_id=scheduled__2024-05-24T23:26:00+00:00, run_start_date=2024-05-24 23:27:01.137387+00:00, run_end_date=2024-05-24 23:27:03.705022+00:00, run_duration=2.567635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:26:00+00:00, data_interval_end=2024-05-24 23:27:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:27:03.718213862Z [2024-05-24T23:27:03.717+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:27:00+00:00, run_after=2024-05-24T23:28:00+00:00 2024-05-24T23:27:03.786600251Z [2024-05-24T23:27:03.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:26:00+00:00 exited with status success for try_number 1 2024-05-24T23:27:03.799874531Z [2024-05-24T23:27:03.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:26:00+00:00, map_index=-1, run_start_date=2024-05-24 23:27:02.085848+00:00, run_end_date=2024-05-24 23:27:02.581555+00:00, run_duration=0.495707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:27:01.208810+00:00, queued_by_job_id=1, pid=2176 2024-05-24T23:27:05.979791955Z [2024-05-24T23:27:05.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:27:05.980132985Z [2024-05-24T23:27:05.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:26:00+00:00, run_id=scheduled__2024-05-24T23:26:00+00:00, run_start_date=2024-05-24 23:27:01.138798+00:00, run_end_date=2024-05-24 23:27:05.979747+00:00, run_duration=4.840949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:26:00+00:00, data_interval_end=2024-05-24 23:27:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:27:05.989324200Z [2024-05-24T23:27:05.989+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:27:00+00:00, run_after=2024-05-24T23:28:00+00:00 2024-05-24T23:27:05.996333105Z [2024-05-24T23:27:05.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:27:05.996633194Z [2024-05-24T23:27:05.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:26:00+00:00, run_id=scheduled__2024-05-24T23:26:00+00:00, run_start_date=2024-05-24 23:27:01.140010+00:00, run_end_date=2024-05-24 23:27:05.996236+00:00, run_duration=4.856226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:26:00+00:00, data_interval_end=2024-05-24 23:27:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:27:06.012917123Z [2024-05-24T23:27:06.012+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:27:00+00:00, run_after=2024-05-24T23:28:00+00:00 2024-05-24T23:27:06.074896194Z [2024-05-24T23:27:06.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:26:00+00:00 exited with status success for try_number 1 2024-05-24T23:27:06.075063364Z [2024-05-24T23:27:06.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:26:00+00:00 exited with status success for try_number 1 2024-05-24T23:27:06.082268878Z [2024-05-24T23:27:06.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:26:00+00:00, map_index=-1, run_start_date=2024-05-24 23:27:03.335780+00:00, run_end_date=2024-05-24 23:27:05.820352+00:00, run_duration=2.484572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:27:01.208810+00:00, queued_by_job_id=1, pid=2195 2024-05-24T23:27:06.082502707Z [2024-05-24T23:27:06.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:26:00+00:00, map_index=-1, run_start_date=2024-05-24 23:27:03.284776+00:00, run_end_date=2024-05-24 23:27:04.852650+00:00, run_duration=1.567874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:27:01.208810+00:00, queued_by_job_id=1, pid=2194 2024-05-24T23:28:01.075222505Z [2024-05-24T23:28:01.074+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:28:00+00:00, run_after=2024-05-24T23:29:00+00:00 2024-05-24T23:28:01.092133657Z [2024-05-24T23:28:01.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:28:00+00:00, run_after=2024-05-24T23:29:00+00:00 2024-05-24T23:28:01.102933463Z [2024-05-24T23:28:01.102+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:28:01.112439561Z [2024-05-24T23:28:01.111+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:28:01.231725623Z [2024-05-24T23:28:01.230+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:28:01.231789243Z 2024-05-24T23:28:01.231798493Z 2024-05-24T23:28:01.231805064Z 2024-05-24T23:28:01.231827336Z 2024-05-24T23:28:01.231908159Z [2024-05-24T23:28:01.231+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:28:01.232099919Z [2024-05-24T23:28:01.231+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:28:01.232381115Z [2024-05-24T23:28:01.232+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:28:01.232579163Z [2024-05-24T23:28:01.232+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:28:01.233995393Z [2024-05-24T23:28:01.233+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:28:01.234004671Z 2024-05-24T23:28:01.234008608Z 2024-05-24T23:28:01.234012553Z 2024-05-24T23:28:01.234016227Z 2024-05-24T23:28:01.240689580Z [2024-05-24T23:28:01.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:28:01.240850103Z [2024-05-24T23:28:01.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:28:01.241276840Z [2024-05-24T23:28:01.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:28:01.241484512Z [2024-05-24T23:28:01.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:28:01.241837381Z [2024-05-24T23:28:01.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:28:01.241988613Z [2024-05-24T23:28:01.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:28:01.242323618Z [2024-05-24T23:28:01.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:28:01.242455569Z [2024-05-24T23:28:01.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:28:01.641375889Z [2024-05-24T23:28:01.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:26:00+00:00 exited with status queued for try_number 1 2024-05-24T23:28:01.641409116Z [2024-05-24T23:28:01.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:27:00+00:00 exited with status queued for try_number 1 2024-05-24T23:28:01.641414110Z [2024-05-24T23:28:01.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:27:00+00:00 exited with status queued for try_number 1 2024-05-24T23:28:01.641418791Z [2024-05-24T23:28:01.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:27:00+00:00 exited with status queued for try_number 1 2024-05-24T23:28:01.649112324Z [2024-05-24T23:28:01.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1dafc2b6-a988-4b15-a69f-b5ca0d41acbb 2024-05-24T23:28:01.649621759Z [2024-05-24T23:28:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c97f787-9152-44d4-aff2-e383ebb936b5 2024-05-24T23:28:01.649865153Z [2024-05-24T23:28:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 047f1864-83d6-4e06-8a43-3cd8901f8d10 2024-05-24T23:28:01.650091697Z [2024-05-24T23:28:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e016cc5-fbcf-469c-9108-52d37f0bdbd7 2024-05-24T23:28:02.814947547Z [2024-05-24T23:28:02.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:28:02.815468471Z [2024-05-24T23:28:02.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:26:00+00:00, run_id=scheduled__2024-05-24T23:26:00+00:00, run_start_date=2024-05-24 23:28:01.128135+00:00, run_end_date=2024-05-24 23:28:02.814856+00:00, run_duration=1.686721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:26:00+00:00, data_interval_end=2024-05-24 23:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:28:02.824959868Z [2024-05-24T23:28:02.824+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:28:00+00:00, run_after=2024-05-24T23:30:00+00:00 2024-05-24T23:28:02.888421206Z [2024-05-24T23:28:02.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:26:00+00:00 exited with status success for try_number 1 2024-05-24T23:28:02.894987562Z [2024-05-24T23:28:02.894+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:26:00+00:00, map_index=-1, run_start_date=2024-05-24 23:28:02.155521+00:00, run_end_date=2024-05-24 23:28:02.666111+00:00, run_duration=0.51059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:28:01.235519+00:00, queued_by_job_id=1, pid=2228 2024-05-24T23:28:04.151091129Z [2024-05-24T23:28:04.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:28:04.151892078Z [2024-05-24T23:28:04.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:27:00+00:00, run_id=scheduled__2024-05-24T23:27:00+00:00, run_start_date=2024-05-24 23:28:01.129841+00:00, run_end_date=2024-05-24 23:28:04.150973+00:00, run_duration=3.021132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:27:00+00:00, data_interval_end=2024-05-24 23:28:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:28:04.161787515Z [2024-05-24T23:28:04.161+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:28:00+00:00, run_after=2024-05-24T23:29:00+00:00 2024-05-24T23:28:04.219718737Z [2024-05-24T23:28:04.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:27:00+00:00 exited with status success for try_number 1 2024-05-24T23:28:04.225156581Z [2024-05-24T23:28:04.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:27:00+00:00, map_index=-1, run_start_date=2024-05-24 23:28:02.469484+00:00, run_end_date=2024-05-24 23:28:02.942810+00:00, run_duration=0.473326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:28:01.235519+00:00, queued_by_job_id=1, pid=2229 2024-05-24T23:28:05.288527691Z [2024-05-24T23:28:05.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:28:05.289688485Z [2024-05-24T23:28:05.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:27:00+00:00, run_id=scheduled__2024-05-24T23:27:00+00:00, run_start_date=2024-05-24 23:28:01.131223+00:00, run_end_date=2024-05-24 23:28:05.288422+00:00, run_duration=4.157199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:27:00+00:00, data_interval_end=2024-05-24 23:28:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:28:05.308802744Z [2024-05-24T23:28:05.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:28:00+00:00, run_after=2024-05-24T23:29:00+00:00 2024-05-24T23:28:06.441562159Z [2024-05-24T23:28:06.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:28:06.442078959Z [2024-05-24T23:28:06.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:27:00+00:00, run_id=scheduled__2024-05-24T23:27:00+00:00, run_start_date=2024-05-24 23:28:01.132549+00:00, run_end_date=2024-05-24 23:28:06.441477+00:00, run_duration=5.308928, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:27:00+00:00, data_interval_end=2024-05-24 23:28:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:28:06.452556835Z [2024-05-24T23:28:06.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:28:00+00:00, run_after=2024-05-24T23:29:00+00:00 2024-05-24T23:28:06.500503636Z [2024-05-24T23:28:06.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:27:00+00:00 exited with status success for try_number 1 2024-05-24T23:28:06.500576538Z [2024-05-24T23:28:06.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:27:00+00:00 exited with status success for try_number 1 2024-05-24T23:28:06.515717382Z [2024-05-24T23:28:06.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:27:00+00:00, map_index=-1, run_start_date=2024-05-24 23:28:03.649435+00:00, run_end_date=2024-05-24 23:28:05.193682+00:00, run_duration=1.544247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:28:01.235519+00:00, queued_by_job_id=1, pid=2253 2024-05-24T23:28:06.515750089Z [2024-05-24T23:28:06.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:27:00+00:00, map_index=-1, run_start_date=2024-05-24 23:28:03.501740+00:00, run_end_date=2024-05-24 23:28:05.379960+00:00, run_duration=1.87822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:28:01.235519+00:00, queued_by_job_id=1, pid=2252 2024-05-24T23:29:00.870073195Z [2024-05-24T23:29:00.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:29:00+00:00, run_after=2024-05-24T23:30:00+00:00 2024-05-24T23:29:00.880098137Z [2024-05-24T23:29:00.879+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:29:00.894051981Z [2024-05-24T23:29:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:29:00+00:00, run_after=2024-05-24T23:30:00+00:00 2024-05-24T23:29:00.975782942Z [2024-05-24T23:29:00.975+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:29:00.975815112Z 2024-05-24T23:29:00.975834933Z 2024-05-24T23:29:00.975838646Z 2024-05-24T23:29:00.976091356Z [2024-05-24T23:29:00.975+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:29:00.976212288Z [2024-05-24T23:29:00.975+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:29:00.976268820Z [2024-05-24T23:29:00.976+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:29:00.976922284Z [2024-05-24T23:29:00.976+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:29:00.976939226Z 2024-05-24T23:29:00.976944897Z 2024-05-24T23:29:00.976949593Z 2024-05-24T23:29:00.982034925Z [2024-05-24T23:29:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:29:00.982101058Z [2024-05-24T23:29:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:29:00.982517958Z [2024-05-24T23:29:00.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:29:00.982570147Z [2024-05-24T23:29:00.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:29:00.982916041Z [2024-05-24T23:29:00.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:29:00.982942643Z [2024-05-24T23:29:00.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:29:01.233111418Z [2024-05-24T23:29:01.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:28:00+00:00 exited with status queued for try_number 1 2024-05-24T23:29:01.233310043Z [2024-05-24T23:29:01.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:28:00+00:00 exited with status queued for try_number 1 2024-05-24T23:29:01.233467036Z [2024-05-24T23:29:01.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:28:00+00:00 exited with status queued for try_number 1 2024-05-24T23:29:01.240419023Z [2024-05-24T23:29:01.240+0000] {scheduler_job.py:635} INFO - Setting external_id for to c82557df-2e5d-4230-8675-709ebac30d2a 2024-05-24T23:29:01.240712976Z [2024-05-24T23:29:01.240+0000] {scheduler_job.py:635} INFO - Setting external_id for to edff1512-9242-469f-ae7f-384a281c0afd 2024-05-24T23:29:01.240898060Z [2024-05-24T23:29:01.240+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cae7f02-d54a-4e40-a2c4-be9a953c72ca 2024-05-24T23:29:02.374175151Z [2024-05-24T23:29:02.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:29:02.374593201Z [2024-05-24T23:29:02.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:28:00+00:00, run_id=scheduled__2024-05-24T23:28:00+00:00, run_start_date=2024-05-24 23:29:00.907199+00:00, run_end_date=2024-05-24 23:29:02.374084+00:00, run_duration=1.466885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:28:00+00:00, data_interval_end=2024-05-24 23:29:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:29:02.383436527Z [2024-05-24T23:29:02.383+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:29:00+00:00, run_after=2024-05-24T23:30:00+00:00 2024-05-24T23:29:03.442656776Z [2024-05-24T23:29:03.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:28:00+00:00 exited with status success for try_number 1 2024-05-24T23:29:03.447134995Z [2024-05-24T23:29:03.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:28:00+00:00, map_index=-1, run_start_date=2024-05-24 23:29:01.768795+00:00, run_end_date=2024-05-24 23:29:02.242884+00:00, run_duration=0.474089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:29:00.977665+00:00, queued_by_job_id=1, pid=2285 2024-05-24T23:29:04.904274446Z [2024-05-24T23:29:04.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:29:04.904768181Z [2024-05-24T23:29:04.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:28:00+00:00, run_id=scheduled__2024-05-24T23:28:00+00:00, run_start_date=2024-05-24 23:29:00.908599+00:00, run_end_date=2024-05-24 23:29:04.904059+00:00, run_duration=3.99546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:28:00+00:00, data_interval_end=2024-05-24 23:29:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:29:04.915692287Z [2024-05-24T23:29:04.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:29:00+00:00, run_after=2024-05-24T23:30:00+00:00 2024-05-24T23:29:04.946890003Z [2024-05-24T23:29:04.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:29:04.947314704Z [2024-05-24T23:29:04.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:28:00+00:00, run_id=scheduled__2024-05-24T23:28:00+00:00, run_start_date=2024-05-24 23:29:00.910002+00:00, run_end_date=2024-05-24 23:29:04.946755+00:00, run_duration=4.036753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:28:00+00:00, data_interval_end=2024-05-24 23:29:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:29:04.957472608Z [2024-05-24T23:29:04.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:29:00+00:00, run_after=2024-05-24T23:30:00+00:00 2024-05-24T23:29:05.002558868Z [2024-05-24T23:29:05.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:28:00+00:00 exited with status success for try_number 1 2024-05-24T23:29:05.005650026Z [2024-05-24T23:29:05.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:28:00+00:00 exited with status success for try_number 1 2024-05-24T23:29:05.018180393Z [2024-05-24T23:29:05.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:28:00+00:00, map_index=-1, run_start_date=2024-05-24 23:29:03.081816+00:00, run_end_date=2024-05-24 23:29:04.371800+00:00, run_duration=1.289984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:29:00.977665+00:00, queued_by_job_id=1, pid=2304 2024-05-24T23:29:05.018624266Z [2024-05-24T23:29:05.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:28:00+00:00, map_index=-1, run_start_date=2024-05-24 23:29:02.833509+00:00, run_end_date=2024-05-24 23:29:04.484501+00:00, run_duration=1.650992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:29:00.977665+00:00, queued_by_job_id=1, pid=2298 2024-05-24T23:30:00.989352716Z [2024-05-24T23:30:00.988+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:30:00+00:00, run_after=2024-05-24T23:31:00+00:00 2024-05-24T23:30:00.998886510Z [2024-05-24T23:30:00.998+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:30:01.014238338Z [2024-05-24T23:30:01.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:30:00+00:00, run_after=2024-05-24T23:35:00+00:00 2024-05-24T23:30:01.037310601Z [2024-05-24T23:30:01.026+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:30:00+00:00, run_after=2024-05-24T23:31:00+00:00 2024-05-24T23:30:01.077324623Z [2024-05-24T23:30:01.076+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:30:01.356964422Z [2024-05-24T23:30:01.355+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T23:30:01.357000538Z 2024-05-24T23:30:01.357004357Z 2024-05-24T23:30:01.357016589Z 2024-05-24T23:30:01.357020249Z 2024-05-24T23:30:01.357023628Z 2024-05-24T23:30:01.357026828Z [2024-05-24T23:30:01.355+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:30:01.357070395Z [2024-05-24T23:30:01.356+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:30:01.357088378Z [2024-05-24T23:30:01.356+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:30:01.357092190Z [2024-05-24T23:30:01.356+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:30:01.357096104Z [2024-05-24T23:30:01.356+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:30:01.360764696Z [2024-05-24T23:30:01.356+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:30:01.360785787Z 2024-05-24T23:30:01.360789823Z 2024-05-24T23:30:01.360793774Z 2024-05-24T23:30:01.360796982Z 2024-05-24T23:30:01.360800317Z 2024-05-24T23:30:01.386940889Z [2024-05-24T23:30:01.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:30:01.386981672Z [2024-05-24T23:30:01.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:30:01.386986851Z [2024-05-24T23:30:01.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:30:01.386993664Z [2024-05-24T23:30:01.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:30:01.386996919Z [2024-05-24T23:30:01.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:30:01.386999828Z [2024-05-24T23:30:01.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:30:01.387002778Z [2024-05-24T23:30:01.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:30:01.387009155Z [2024-05-24T23:30:01.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:30:01.387012082Z [2024-05-24T23:30:01.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:30:01.387015032Z [2024-05-24T23:30:01.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:30:02.561167462Z [2024-05-24T23:30:02.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status queued for try_number 1 2024-05-24T23:30:02.561366006Z [2024-05-24T23:30:02.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:28:00+00:00 exited with status queued for try_number 1 2024-05-24T23:30:02.561485410Z [2024-05-24T23:30:02.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:29:00+00:00 exited with status queued for try_number 1 2024-05-24T23:30:02.561607435Z [2024-05-24T23:30:02.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:29:00+00:00 exited with status queued for try_number 1 2024-05-24T23:30:02.561743258Z [2024-05-24T23:30:02.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:29:00+00:00 exited with status queued for try_number 1 2024-05-24T23:30:02.601439981Z [2024-05-24T23:30:02.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43901d0f-38ad-48af-8212-3929f70529b8 2024-05-24T23:30:02.604522075Z [2024-05-24T23:30:02.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a933e60-b3b4-421d-bc16-fe0755a8736a 2024-05-24T23:30:02.604712850Z [2024-05-24T23:30:02.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd3c7c86-5489-49f2-82e5-f9cad3013239 2024-05-24T23:30:02.604873710Z [2024-05-24T23:30:02.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to d14f8bb2-2c46-4291-861c-673872904867 2024-05-24T23:30:02.605019747Z [2024-05-24T23:30:02.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7c38316-7809-49a6-97fc-ff9bc72e0125 2024-05-24T23:30:06.578428817Z [2024-05-24T23:30:06.578+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:30:06.580740147Z [2024-05-24T23:30:06.578+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:29:00+00:00, run_id=scheduled__2024-05-24T23:29:00+00:00, run_start_date=2024-05-24 23:30:01.125241+00:00, run_end_date=2024-05-24 23:30:06.578364+00:00, run_duration=5.453123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:29:00+00:00, data_interval_end=2024-05-24 23:30:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:30:06.623592265Z [2024-05-24T23:30:06.623+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:30:00+00:00, run_after=2024-05-24T23:31:00+00:00 2024-05-24T23:30:06.650640743Z [2024-05-24T23:30:06.650+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:30:06.651359810Z [2024-05-24T23:30:06.650+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:28:00+00:00, run_id=scheduled__2024-05-24T23:28:00+00:00, run_start_date=2024-05-24 23:30:01.120285+00:00, run_end_date=2024-05-24 23:30:06.650555+00:00, run_duration=5.53027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:28:00+00:00, data_interval_end=2024-05-24 23:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:30:06.668187208Z [2024-05-24T23:30:06.667+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:30:00+00:00, run_after=2024-05-24T23:32:00+00:00 2024-05-24T23:30:06.951053904Z [2024-05-24T23:30:06.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:28:00+00:00 exited with status success for try_number 1 2024-05-24T23:30:06.957965255Z [2024-05-24T23:30:06.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:29:00+00:00 exited with status success for try_number 1 2024-05-24T23:30:06.974809780Z [2024-05-24T23:30:06.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:29:00+00:00, map_index=-1, run_start_date=2024-05-24 23:30:03.665078+00:00, run_end_date=2024-05-24 23:30:05.024981+00:00, run_duration=1.359903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:30:01.363246+00:00, queued_by_job_id=1, pid=2338 2024-05-24T23:30:06.975205915Z [2024-05-24T23:30:06.975+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:28:00+00:00, map_index=-1, run_start_date=2024-05-24 23:30:05.160570+00:00, run_end_date=2024-05-24 23:30:06.211979+00:00, run_duration=1.051409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:30:01.363246+00:00, queued_by_job_id=1, pid=2344 2024-05-24T23:30:10.602435936Z [2024-05-24T23:30:10.602+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:30:10.602457833Z 2024-05-24T23:30:10.602750231Z [2024-05-24T23:30:10.602+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:30:10.605988624Z [2024-05-24T23:30:10.605+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:30:10.606003271Z 2024-05-24T23:30:10.608908622Z [2024-05-24T23:30:10.608+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:30:10.609043716Z [2024-05-24T23:30:10.608+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:30:10.682869379Z [2024-05-24T23:30:10.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status queued for try_number 1 2024-05-24T23:30:10.683044319Z [2024-05-24T23:30:10.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status success for try_number 1 2024-05-24T23:30:10.689133152Z [2024-05-24T23:30:10.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b14ac73-74ff-43b7-bff7-fa415dead1b5 2024-05-24T23:30:10.689345826Z [2024-05-24T23:30:10.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:25:00+00:00, map_index=-1, run_start_date=2024-05-24 23:30:09.151582+00:00, run_end_date=2024-05-24 23:30:09.746479+00:00, run_duration=0.594897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:30:01.363246+00:00, queued_by_job_id=1, pid=2369 2024-05-24T23:30:11.882493328Z [2024-05-24T23:30:11.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:30:11.882663504Z [2024-05-24T23:30:11.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:29:00+00:00, run_id=scheduled__2024-05-24T23:29:00+00:00, run_start_date=2024-05-24 23:30:01.129528+00:00, run_end_date=2024-05-24 23:30:11.882385+00:00, run_duration=10.752857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:29:00+00:00, data_interval_end=2024-05-24 23:30:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:30:11.898942650Z [2024-05-24T23:30:11.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:30:00+00:00, run_after=2024-05-24T23:31:00+00:00 2024-05-24T23:30:12.007805753Z [2024-05-24T23:30:12.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:29:00+00:00 exited with status success for try_number 1 2024-05-24T23:30:12.018277312Z [2024-05-24T23:30:12.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:29:00+00:00, map_index=-1, run_start_date=2024-05-24 23:30:09.765312+00:00, run_end_date=2024-05-24 23:30:11.465175+00:00, run_duration=1.699863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:30:01.363246+00:00, queued_by_job_id=1, pid=2385 2024-05-24T23:30:13.102985365Z [2024-05-24T23:30:13.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:30:13.103534216Z [2024-05-24T23:30:13.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:29:00+00:00, run_id=scheduled__2024-05-24T23:29:00+00:00, run_start_date=2024-05-24 23:30:01.126756+00:00, run_end_date=2024-05-24 23:30:13.102939+00:00, run_duration=11.976183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:29:00+00:00, data_interval_end=2024-05-24 23:30:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:30:13.120650535Z [2024-05-24T23:30:13.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:30:00+00:00, run_after=2024-05-24T23:31:00+00:00 2024-05-24T23:30:13.222534317Z [2024-05-24T23:30:13.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:29:00+00:00 exited with status success for try_number 1 2024-05-24T23:30:13.234240349Z [2024-05-24T23:30:13.233+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:29:00+00:00, map_index=-1, run_start_date=2024-05-24 23:30:09.880237+00:00, run_end_date=2024-05-24 23:30:12.504188+00:00, run_duration=2.623951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:30:01.363246+00:00, queued_by_job_id=1, pid=2386 2024-05-24T23:30:14.332099184Z [2024-05-24T23:30:14.327+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:30:14.332122695Z 2024-05-24T23:30:14.335280027Z [2024-05-24T23:30:14.332+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:30:14.337193595Z [2024-05-24T23:30:14.336+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:30:14.337220545Z 2024-05-24T23:30:14.340822400Z [2024-05-24T23:30:14.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:30:14.341152900Z [2024-05-24T23:30:14.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:30:14.475022788Z [2024-05-24T23:30:14.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status queued for try_number 1 2024-05-24T23:30:14.475119010Z [2024-05-24T23:30:14.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status success for try_number 1 2024-05-24T23:30:14.521865977Z [2024-05-24T23:30:14.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d54205c-8a4a-4dd5-b35e-5d92c39cec3b 2024-05-24T23:30:14.522084658Z [2024-05-24T23:30:14.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:25:00+00:00, map_index=-1, run_start_date=2024-05-24 23:30:13.424081+00:00, run_end_date=2024-05-24 23:30:14.058581+00:00, run_duration=0.6345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:30:10.606402+00:00, queued_by_job_id=1, pid=2407 2024-05-24T23:30:18.196231120Z [2024-05-24T23:30:18.195+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:30:18.196285910Z 2024-05-24T23:30:18.196333598Z [2024-05-24T23:30:18.196+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:30:18.196865705Z [2024-05-24T23:30:18.196+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:30:18.196879361Z 2024-05-24T23:30:18.199240530Z [2024-05-24T23:30:18.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:30:18.199302893Z [2024-05-24T23:30:18.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:30:18.291342921Z [2024-05-24T23:30:18.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status queued for try_number 1 2024-05-24T23:30:18.291428500Z [2024-05-24T23:30:18.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status success for try_number 1 2024-05-24T23:30:18.346525241Z [2024-05-24T23:30:18.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to aeb755a2-61d5-44b7-b939-79b8caf41b63 2024-05-24T23:30:18.347468879Z [2024-05-24T23:30:18.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:25:00+00:00, map_index=0, run_start_date=2024-05-24 23:30:17.423086+00:00, run_end_date=2024-05-24 23:30:17.773137+00:00, run_duration=0.350051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:30:14.338083+00:00, queued_by_job_id=1, pid=2415 2024-05-24T23:30:20.635432364Z [2024-05-24T23:30:20.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:30:20.635941242Z [2024-05-24T23:30:20.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:25:00+00:00, run_id=scheduled__2024-05-24T23:25:00+00:00, run_start_date=2024-05-24 23:30:01.114567+00:00, run_end_date=2024-05-24 23:30:20.635545+00:00, run_duration=19.520978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:25:00+00:00, data_interval_end=2024-05-24 23:30:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-24T23:30:20.645455939Z [2024-05-24T23:30:20.644+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:30:00+00:00, run_after=2024-05-24T23:35:00+00:00 2024-05-24T23:30:20.685253370Z [2024-05-24T23:30:20.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:25:00+00:00 exited with status success for try_number 1 2024-05-24T23:30:20.698811346Z [2024-05-24T23:30:20.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:25:00+00:00, map_index=-1, run_start_date=2024-05-24 23:30:20.081266+00:00, run_end_date=2024-05-24 23:30:20.490719+00:00, run_duration=0.409453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:30:18.197366+00:00, queued_by_job_id=1, pid=2423 2024-05-24T23:30:27.605618605Z [2024-05-24T23:30:27.604+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T23:31:00.756856237Z [2024-05-24T23:31:00.756+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:31:00.770128976Z [2024-05-24T23:31:00.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:31:00+00:00, run_after=2024-05-24T23:32:00+00:00 2024-05-24T23:31:00.783661457Z [2024-05-24T23:31:00.783+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:31:00+00:00, run_after=2024-05-24T23:32:00+00:00 2024-05-24T23:31:00.843795160Z [2024-05-24T23:31:00.843+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:31:00.843824699Z 2024-05-24T23:31:00.843830118Z 2024-05-24T23:31:00.843834466Z 2024-05-24T23:31:00.844027748Z [2024-05-24T23:31:00.843+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:31:00.844389177Z [2024-05-24T23:31:00.844+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:31:00.844474500Z [2024-05-24T23:31:00.844+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:31:00.845042063Z [2024-05-24T23:31:00.844+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:31:00.845062044Z 2024-05-24T23:31:00.845067277Z 2024-05-24T23:31:00.845072008Z 2024-05-24T23:31:00.847842998Z [2024-05-24T23:31:00.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:31:00.848078377Z [2024-05-24T23:31:00.847+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:31:00.848495299Z [2024-05-24T23:31:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:31:00.848735088Z [2024-05-24T23:31:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:31:00.849271044Z [2024-05-24T23:31:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:31:00.849476656Z [2024-05-24T23:31:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:31:01.073352070Z [2024-05-24T23:31:01.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status queued for try_number 1 2024-05-24T23:31:01.075393022Z [2024-05-24T23:31:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status queued for try_number 1 2024-05-24T23:31:01.075489512Z [2024-05-24T23:31:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status queued for try_number 1 2024-05-24T23:31:01.083351490Z [2024-05-24T23:31:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6dab3721-62ac-47ab-bc5d-0302de55a308 2024-05-24T23:31:01.083406206Z [2024-05-24T23:31:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to a058a274-3391-429f-9b55-f6468e369e0e 2024-05-24T23:31:01.083523747Z [2024-05-24T23:31:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0830608a-019b-4df7-a9d0-1893eefafc34 2024-05-24T23:31:02.790888932Z [2024-05-24T23:31:02.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:31:02.791411260Z [2024-05-24T23:31:02.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:30:00+00:00, run_id=scheduled__2024-05-24T23:30:00+00:00, run_start_date=2024-05-24 23:31:00.797028+00:00, run_end_date=2024-05-24 23:31:02.790714+00:00, run_duration=1.993686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:30:00+00:00, data_interval_end=2024-05-24 23:31:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:31:02.805171915Z [2024-05-24T23:31:02.804+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:31:00+00:00, run_after=2024-05-24T23:32:00+00:00 2024-05-24T23:31:02.875353376Z [2024-05-24T23:31:02.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status success for try_number 1 2024-05-24T23:31:02.893256391Z [2024-05-24T23:31:02.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:30:00+00:00, map_index=-1, run_start_date=2024-05-24 23:31:01.634138+00:00, run_end_date=2024-05-24 23:31:02.057245+00:00, run_duration=0.423107, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:31:00.845725+00:00, queued_by_job_id=1, pid=2432 2024-05-24T23:31:05.098087575Z [2024-05-24T23:31:05.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:31:05.098109272Z [2024-05-24T23:31:05.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:30:00+00:00, run_id=scheduled__2024-05-24T23:30:00+00:00, run_start_date=2024-05-24 23:31:00.798418+00:00, run_end_date=2024-05-24 23:31:05.097129+00:00, run_duration=4.298711, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:30:00+00:00, data_interval_end=2024-05-24 23:31:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:31:05.118725825Z [2024-05-24T23:31:05.115+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:31:00+00:00, run_after=2024-05-24T23:32:00+00:00 2024-05-24T23:31:05.128318993Z [2024-05-24T23:31:05.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:31:05.128664769Z [2024-05-24T23:31:05.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:30:00+00:00, run_id=scheduled__2024-05-24T23:30:00+00:00, run_start_date=2024-05-24 23:31:00.799572+00:00, run_end_date=2024-05-24 23:31:05.128302+00:00, run_duration=4.32873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:30:00+00:00, data_interval_end=2024-05-24 23:31:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:31:05.139836096Z [2024-05-24T23:31:05.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:31:00+00:00, run_after=2024-05-24T23:32:00+00:00 2024-05-24T23:31:05.169844992Z [2024-05-24T23:31:05.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status success for try_number 1 2024-05-24T23:31:05.169989148Z [2024-05-24T23:31:05.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status success for try_number 1 2024-05-24T23:31:05.176998993Z [2024-05-24T23:31:05.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:30:00+00:00, map_index=-1, run_start_date=2024-05-24 23:31:02.819974+00:00, run_end_date=2024-05-24 23:31:04.109055+00:00, run_duration=1.289081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:31:00.845725+00:00, queued_by_job_id=1, pid=2450 2024-05-24T23:31:05.177498516Z [2024-05-24T23:31:05.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:30:00+00:00, map_index=-1, run_start_date=2024-05-24 23:31:02.838733+00:00, run_end_date=2024-05-24 23:31:04.464406+00:00, run_duration=1.625673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:31:00.845725+00:00, queued_by_job_id=1, pid=2451 2024-05-24T23:32:00.720965441Z [2024-05-24T23:32:00.720+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:32:00+00:00, run_after=2024-05-24T23:33:00+00:00 2024-05-24T23:32:00.732067963Z [2024-05-24T23:32:00.731+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:32:00.745892167Z [2024-05-24T23:32:00.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:32:00+00:00, run_after=2024-05-24T23:33:00+00:00 2024-05-24T23:32:00.753458092Z [2024-05-24T23:32:00.753+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:32:00.851226859Z [2024-05-24T23:32:00.850+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:32:00.851249937Z 2024-05-24T23:32:00.851253947Z 2024-05-24T23:32:00.851257354Z 2024-05-24T23:32:00.851260279Z 2024-05-24T23:32:00.851371492Z [2024-05-24T23:32:00.851+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:32:00.851559026Z [2024-05-24T23:32:00.851+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:32:00.851746955Z [2024-05-24T23:32:00.851+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:32:00.851913826Z [2024-05-24T23:32:00.851+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:32:00.852559479Z [2024-05-24T23:32:00.852+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:32:00.852574446Z 2024-05-24T23:32:00.852595755Z 2024-05-24T23:32:00.852599014Z 2024-05-24T23:32:00.852602069Z 2024-05-24T23:32:00.857335769Z [2024-05-24T23:32:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:32:00.857587235Z [2024-05-24T23:32:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:32:00.857898971Z [2024-05-24T23:32:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:32:00.858052036Z [2024-05-24T23:32:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:32:00.858344697Z [2024-05-24T23:32:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:32:00.858494746Z [2024-05-24T23:32:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:32:00.858767669Z [2024-05-24T23:32:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:32:00.858930284Z [2024-05-24T23:32:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:32:01.299800273Z [2024-05-24T23:32:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status queued for try_number 1 2024-05-24T23:32:01.301493074Z [2024-05-24T23:32:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:31:00+00:00 exited with status queued for try_number 1 2024-05-24T23:32:01.301655794Z [2024-05-24T23:32:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:31:00+00:00 exited with status queued for try_number 1 2024-05-24T23:32:01.301813577Z [2024-05-24T23:32:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:31:00+00:00 exited with status queued for try_number 1 2024-05-24T23:32:01.321156041Z [2024-05-24T23:32:01.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1945bd9-378d-4e8f-8322-c19f8f0e8b87 2024-05-24T23:32:01.321486346Z [2024-05-24T23:32:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a8ba8bb-1d54-48a1-8714-b413d164a01f 2024-05-24T23:32:01.321760545Z [2024-05-24T23:32:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84fad15b-6f2a-4e41-8569-934961701c80 2024-05-24T23:32:01.321989290Z [2024-05-24T23:32:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to d17f8372-6851-46d8-889a-17e18a44c716 2024-05-24T23:32:02.549262896Z [2024-05-24T23:32:02.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:32:02.550102877Z [2024-05-24T23:32:02.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:30:00+00:00, run_id=scheduled__2024-05-24T23:30:00+00:00, run_start_date=2024-05-24 23:32:00.766875+00:00, run_end_date=2024-05-24 23:32:02.549525+00:00, run_duration=1.78265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:30:00+00:00, data_interval_end=2024-05-24 23:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:32:02.559592836Z [2024-05-24T23:32:02.559+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:32:00+00:00, run_after=2024-05-24T23:34:00+00:00 2024-05-24T23:32:02.669042753Z [2024-05-24T23:32:02.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status success for try_number 1 2024-05-24T23:32:02.682400346Z [2024-05-24T23:32:02.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:30:00+00:00, map_index=-1, run_start_date=2024-05-24 23:32:02.016892+00:00, run_end_date=2024-05-24 23:32:02.408296+00:00, run_duration=0.391404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:32:00.853627+00:00, queued_by_job_id=1, pid=2484 2024-05-24T23:32:03.744684951Z [2024-05-24T23:32:03.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:32:03.744975737Z [2024-05-24T23:32:03.744+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:31:00+00:00, run_id=scheduled__2024-05-24T23:31:00+00:00, run_start_date=2024-05-24 23:32:00.768679+00:00, run_end_date=2024-05-24 23:32:03.744676+00:00, run_duration=2.975997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:31:00+00:00, data_interval_end=2024-05-24 23:32:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:32:03.754804926Z [2024-05-24T23:32:03.754+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:32:00+00:00, run_after=2024-05-24T23:33:00+00:00 2024-05-24T23:32:03.802456651Z [2024-05-24T23:32:03.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:31:00+00:00 exited with status success for try_number 1 2024-05-24T23:32:03.809651021Z [2024-05-24T23:32:03.809+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:31:00+00:00, map_index=-1, run_start_date=2024-05-24 23:32:02.032573+00:00, run_end_date=2024-05-24 23:32:02.572966+00:00, run_duration=0.540393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:32:00.853627+00:00, queued_by_job_id=1, pid=2485 2024-05-24T23:32:04.875409212Z [2024-05-24T23:32:04.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:32:04.875751151Z [2024-05-24T23:32:04.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:31:00+00:00, run_id=scheduled__2024-05-24T23:31:00+00:00, run_start_date=2024-05-24 23:32:00.769984+00:00, run_end_date=2024-05-24 23:32:04.875189+00:00, run_duration=4.105205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:31:00+00:00, data_interval_end=2024-05-24 23:32:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:32:04.892338205Z [2024-05-24T23:32:04.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:32:00+00:00, run_after=2024-05-24T23:33:00+00:00 2024-05-24T23:32:04.945419640Z [2024-05-24T23:32:04.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:31:00+00:00 exited with status success for try_number 1 2024-05-24T23:32:04.954321543Z [2024-05-24T23:32:04.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:31:00+00:00, map_index=-1, run_start_date=2024-05-24 23:32:02.956807+00:00, run_end_date=2024-05-24 23:32:04.617474+00:00, run_duration=1.660667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:32:00.853627+00:00, queued_by_job_id=1, pid=2502 2024-05-24T23:32:06.732998103Z [2024-05-24T23:32:06.732+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:32:06.733241340Z [2024-05-24T23:32:06.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:31:00+00:00, run_id=scheduled__2024-05-24T23:31:00+00:00, run_start_date=2024-05-24 23:32:00.771168+00:00, run_end_date=2024-05-24 23:32:06.732901+00:00, run_duration=5.961733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:31:00+00:00, data_interval_end=2024-05-24 23:32:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:32:06.776062400Z [2024-05-24T23:32:06.775+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:32:00+00:00, run_after=2024-05-24T23:33:00+00:00 2024-05-24T23:32:06.885966745Z [2024-05-24T23:32:06.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:31:00+00:00 exited with status success for try_number 1 2024-05-24T23:32:06.905259812Z [2024-05-24T23:32:06.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:31:00+00:00, map_index=-1, run_start_date=2024-05-24 23:32:03.371008+00:00, run_end_date=2024-05-24 23:32:05.599912+00:00, run_duration=2.228904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:32:00.853627+00:00, queued_by_job_id=1, pid=2513 2024-05-24T23:33:00.676716002Z [2024-05-24T23:33:00.676+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:33:00+00:00, run_after=2024-05-24T23:34:00+00:00 2024-05-24T23:33:00.685882735Z [2024-05-24T23:33:00.685+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:33:00.697786885Z [2024-05-24T23:33:00.697+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:33:00+00:00, run_after=2024-05-24T23:34:00+00:00 2024-05-24T23:33:00.778310747Z [2024-05-24T23:33:00.777+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:33:00.778347018Z 2024-05-24T23:33:00.778354426Z 2024-05-24T23:33:00.778382804Z 2024-05-24T23:33:00.779170084Z [2024-05-24T23:33:00.778+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:33:00.779190684Z [2024-05-24T23:33:00.778+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:33:00.779612781Z [2024-05-24T23:33:00.779+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:33:00.780548772Z [2024-05-24T23:33:00.780+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:33:00.780564888Z 2024-05-24T23:33:00.780571780Z 2024-05-24T23:33:00.780578751Z 2024-05-24T23:33:00.784912204Z [2024-05-24T23:33:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:33:00.785239421Z [2024-05-24T23:33:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:33:00.785724692Z [2024-05-24T23:33:00.785+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:33:00.786136688Z [2024-05-24T23:33:00.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:33:00.786576374Z [2024-05-24T23:33:00.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:33:00.786869141Z [2024-05-24T23:33:00.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:33:01.043642958Z [2024-05-24T23:33:01.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:32:00+00:00 exited with status queued for try_number 1 2024-05-24T23:33:01.043751838Z [2024-05-24T23:33:01.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:32:00+00:00 exited with status queued for try_number 1 2024-05-24T23:33:01.043908150Z [2024-05-24T23:33:01.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:32:00+00:00 exited with status queued for try_number 1 2024-05-24T23:33:01.053725407Z [2024-05-24T23:33:01.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to 375c8325-32bb-4622-89f4-e7835a94f347 2024-05-24T23:33:01.053934826Z [2024-05-24T23:33:01.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1723806a-ab17-4a23-9a7d-afe48a375c01 2024-05-24T23:33:01.054126942Z [2024-05-24T23:33:01.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3824bc2-e098-42c0-b0bb-ac5e721218f3 2024-05-24T23:33:02.432889419Z [2024-05-24T23:33:02.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:33:02.433900548Z [2024-05-24T23:33:02.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:32:00+00:00, run_id=scheduled__2024-05-24T23:32:00+00:00, run_start_date=2024-05-24 23:33:00.710014+00:00, run_end_date=2024-05-24 23:33:02.433047+00:00, run_duration=1.723033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:32:00+00:00, data_interval_end=2024-05-24 23:33:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:33:02.443673930Z [2024-05-24T23:33:02.443+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:33:00+00:00, run_after=2024-05-24T23:34:00+00:00 2024-05-24T23:33:02.492618671Z [2024-05-24T23:33:02.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:32:00+00:00 exited with status success for try_number 1 2024-05-24T23:33:02.498445912Z [2024-05-24T23:33:02.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:32:00+00:00, map_index=-1, run_start_date=2024-05-24 23:33:01.667584+00:00, run_end_date=2024-05-24 23:33:02.052972+00:00, run_duration=0.385388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:33:00.781502+00:00, queued_by_job_id=1, pid=2540 2024-05-24T23:33:05.811574822Z [2024-05-24T23:33:05.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:33:05.811923246Z [2024-05-24T23:33:05.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:32:00+00:00, run_id=scheduled__2024-05-24T23:32:00+00:00, run_start_date=2024-05-24 23:33:00.711499+00:00, run_end_date=2024-05-24 23:33:05.811531+00:00, run_duration=5.100032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:32:00+00:00, data_interval_end=2024-05-24 23:33:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:33:05.824700353Z [2024-05-24T23:33:05.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:33:00+00:00, run_after=2024-05-24T23:34:00+00:00 2024-05-24T23:33:05.883824445Z [2024-05-24T23:33:05.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:32:00+00:00 exited with status success for try_number 1 2024-05-24T23:33:05.894779224Z [2024-05-24T23:33:05.894+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:32:00+00:00, map_index=-1, run_start_date=2024-05-24 23:33:03.031940+00:00, run_end_date=2024-05-24 23:33:04.955109+00:00, run_duration=1.923169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:33:00.781502+00:00, queued_by_job_id=1, pid=2559 2024-05-24T23:33:07.065764215Z [2024-05-24T23:33:07.065+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:33:07.066024961Z [2024-05-24T23:33:07.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:32:00+00:00, run_id=scheduled__2024-05-24T23:32:00+00:00, run_start_date=2024-05-24 23:33:00.712985+00:00, run_end_date=2024-05-24 23:33:07.065659+00:00, run_duration=6.352674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:32:00+00:00, data_interval_end=2024-05-24 23:33:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:33:07.076033373Z [2024-05-24T23:33:07.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:33:00+00:00, run_after=2024-05-24T23:34:00+00:00 2024-05-24T23:33:07.111524091Z [2024-05-24T23:33:07.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:32:00+00:00 exited with status success for try_number 1 2024-05-24T23:33:07.116343974Z [2024-05-24T23:33:07.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:32:00+00:00, map_index=-1, run_start_date=2024-05-24 23:33:02.875951+00:00, run_end_date=2024-05-24 23:33:06.319468+00:00, run_duration=3.443517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:33:00.781502+00:00, queued_by_job_id=1, pid=2558 2024-05-24T23:34:00.554084024Z [2024-05-24T23:34:00.553+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:34:00+00:00, run_after=2024-05-24T23:35:00+00:00 2024-05-24T23:34:00.567073757Z [2024-05-24T23:34:00.566+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:34:00.583377193Z [2024-05-24T23:34:00.582+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:34:00.604616876Z [2024-05-24T23:34:00.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:34:00+00:00, run_after=2024-05-24T23:35:00+00:00 2024-05-24T23:34:00.704741053Z [2024-05-24T23:34:00.704+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:34:00.704767261Z 2024-05-24T23:34:00.704777534Z 2024-05-24T23:34:00.704782173Z 2024-05-24T23:34:00.704786863Z 2024-05-24T23:34:00.705441524Z [2024-05-24T23:34:00.705+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:34:00.705756054Z [2024-05-24T23:34:00.705+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:34:00.706093532Z [2024-05-24T23:34:00.705+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:34:00.706439545Z [2024-05-24T23:34:00.706+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:34:00.707125728Z [2024-05-24T23:34:00.706+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:34:00.707136642Z 2024-05-24T23:34:00.707140060Z 2024-05-24T23:34:00.707143063Z 2024-05-24T23:34:00.707145845Z 2024-05-24T23:34:00.710912154Z [2024-05-24T23:34:00.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:34:00.711195817Z [2024-05-24T23:34:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:34:00.711614156Z [2024-05-24T23:34:00.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:34:00.711824569Z [2024-05-24T23:34:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:34:00.712115752Z [2024-05-24T23:34:00.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:34:00.712351083Z [2024-05-24T23:34:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:34:00.712678831Z [2024-05-24T23:34:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:34:00.712893286Z [2024-05-24T23:34:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:34:01.007837038Z [2024-05-24T23:34:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:32:00+00:00 exited with status queued for try_number 1 2024-05-24T23:34:01.007912826Z [2024-05-24T23:34:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:33:00+00:00 exited with status queued for try_number 1 2024-05-24T23:34:01.007929419Z [2024-05-24T23:34:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:33:00+00:00 exited with status queued for try_number 1 2024-05-24T23:34:01.007934403Z [2024-05-24T23:34:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:33:00+00:00 exited with status queued for try_number 1 2024-05-24T23:34:01.026569281Z [2024-05-24T23:34:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1541bd8-2ab1-4c8b-851b-110dc9579a82 2024-05-24T23:34:01.026600683Z [2024-05-24T23:34:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d061708-0b75-49f1-a3e4-cc75344b45c5 2024-05-24T23:34:01.026686424Z [2024-05-24T23:34:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to d419417a-d6a1-4786-965e-0fdb6370bd09 2024-05-24T23:34:01.026783404Z [2024-05-24T23:34:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e4ac67e-01d1-46ee-8c85-b43b58e2da0c 2024-05-24T23:34:02.451899948Z [2024-05-24T23:34:02.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:32:00+00:00 exited with status success for try_number 1 2024-05-24T23:34:02.457467529Z [2024-05-24T23:34:02.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:32:00+00:00, map_index=-1, run_start_date=2024-05-24 23:34:01.700525+00:00, run_end_date=2024-05-24 23:34:02.243387+00:00, run_duration=0.542862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:34:00.708015+00:00, queued_by_job_id=1, pid=2592 2024-05-24T23:34:03.498428915Z [2024-05-24T23:34:03.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:34:03.498826575Z [2024-05-24T23:34:03.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:33:00+00:00, run_id=scheduled__2024-05-24T23:33:00+00:00, run_start_date=2024-05-24 23:34:00.620529+00:00, run_end_date=2024-05-24 23:34:03.498352+00:00, run_duration=2.877823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:33:00+00:00, data_interval_end=2024-05-24 23:34:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:34:03.510573256Z [2024-05-24T23:34:03.510+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:34:00+00:00, run_after=2024-05-24T23:35:00+00:00 2024-05-24T23:34:03.520476019Z [2024-05-24T23:34:03.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:34:03.520816965Z [2024-05-24T23:34:03.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:32:00+00:00, run_id=scheduled__2024-05-24T23:32:00+00:00, run_start_date=2024-05-24 23:34:00.619176+00:00, run_end_date=2024-05-24 23:34:03.520458+00:00, run_duration=2.901282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:32:00+00:00, data_interval_end=2024-05-24 23:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:34:03.528279833Z [2024-05-24T23:34:03.527+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:34:00+00:00, run_after=2024-05-24T23:36:00+00:00 2024-05-24T23:34:03.580389321Z [2024-05-24T23:34:03.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:33:00+00:00 exited with status success for try_number 1 2024-05-24T23:34:03.585489434Z [2024-05-24T23:34:03.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:33:00+00:00, map_index=-1, run_start_date=2024-05-24 23:34:01.915988+00:00, run_end_date=2024-05-24 23:34:02.488736+00:00, run_duration=0.572748, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:34:00.708015+00:00, queued_by_job_id=1, pid=2593 2024-05-24T23:34:05.663903543Z [2024-05-24T23:34:05.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:34:05.664208553Z [2024-05-24T23:34:05.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:33:00+00:00, run_id=scheduled__2024-05-24T23:33:00+00:00, run_start_date=2024-05-24 23:34:00.621689+00:00, run_end_date=2024-05-24 23:34:05.663638+00:00, run_duration=5.041949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:33:00+00:00, data_interval_end=2024-05-24 23:34:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:34:05.678112115Z [2024-05-24T23:34:05.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:34:00+00:00, run_after=2024-05-24T23:35:00+00:00 2024-05-24T23:34:05.689143753Z [2024-05-24T23:34:05.688+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:34:05.689614854Z [2024-05-24T23:34:05.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:33:00+00:00, run_id=scheduled__2024-05-24T23:33:00+00:00, run_start_date=2024-05-24 23:34:00.622777+00:00, run_end_date=2024-05-24 23:34:05.688986+00:00, run_duration=5.066209, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:33:00+00:00, data_interval_end=2024-05-24 23:34:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:34:05.704318108Z [2024-05-24T23:34:05.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:34:00+00:00, run_after=2024-05-24T23:35:00+00:00 2024-05-24T23:34:05.741060096Z [2024-05-24T23:34:05.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:33:00+00:00 exited with status success for try_number 1 2024-05-24T23:34:05.741265407Z [2024-05-24T23:34:05.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:33:00+00:00 exited with status success for try_number 1 2024-05-24T23:34:05.750544426Z [2024-05-24T23:34:05.749+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:33:00+00:00, map_index=-1, run_start_date=2024-05-24 23:34:03.142573+00:00, run_end_date=2024-05-24 23:34:04.535351+00:00, run_duration=1.392778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:34:00.708015+00:00, queued_by_job_id=1, pid=2616 2024-05-24T23:34:05.750884369Z [2024-05-24T23:34:05.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:33:00+00:00, map_index=-1, run_start_date=2024-05-24 23:34:03.159225+00:00, run_end_date=2024-05-24 23:34:04.893400+00:00, run_duration=1.734175, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:34:00.708015+00:00, queued_by_job_id=1, pid=2617 2024-05-24T23:35:00.503962261Z [2024-05-24T23:35:00.503+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:35:00+00:00, run_after=2024-05-24T23:36:00+00:00 2024-05-24T23:35:00.510460281Z [2024-05-24T23:35:00.510+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:35:00.522552006Z [2024-05-24T23:35:00.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:35:00+00:00, run_after=2024-05-24T23:36:00+00:00 2024-05-24T23:35:00.534406631Z [2024-05-24T23:35:00.534+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:35:00+00:00, run_after=2024-05-24T23:40:00+00:00 2024-05-24T23:35:00.646055255Z [2024-05-24T23:35:00.645+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:35:00.646133088Z 2024-05-24T23:35:00.646143483Z 2024-05-24T23:35:00.646181715Z 2024-05-24T23:35:00.646191679Z 2024-05-24T23:35:00.646452531Z [2024-05-24T23:35:00.645+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:35:00.647168331Z [2024-05-24T23:35:00.646+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:35:00.647795837Z [2024-05-24T23:35:00.647+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:35:00.648146998Z [2024-05-24T23:35:00.647+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:35:00.649741398Z [2024-05-24T23:35:00.649+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:35:00.649762506Z 2024-05-24T23:35:00.649769304Z 2024-05-24T23:35:00.649775375Z 2024-05-24T23:35:00.649799705Z 2024-05-24T23:35:00.656231108Z [2024-05-24T23:35:00.655+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:35:00.656603945Z [2024-05-24T23:35:00.656+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:35:00.657033428Z [2024-05-24T23:35:00.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:35:00.657465397Z [2024-05-24T23:35:00.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:35:00.657931326Z [2024-05-24T23:35:00.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:35:00.658293771Z [2024-05-24T23:35:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:35:00.658729481Z [2024-05-24T23:35:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:35:00.659027882Z [2024-05-24T23:35:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:35:01.051952259Z [2024-05-24T23:35:01.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status queued for try_number 1 2024-05-24T23:35:01.052210811Z [2024-05-24T23:35:01.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:34:00+00:00 exited with status queued for try_number 1 2024-05-24T23:35:01.052379132Z [2024-05-24T23:35:01.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:34:00+00:00 exited with status queued for try_number 1 2024-05-24T23:35:01.052499151Z [2024-05-24T23:35:01.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:34:00+00:00 exited with status queued for try_number 1 2024-05-24T23:35:01.061065179Z [2024-05-24T23:35:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8330f2ee-add5-4eb7-9b48-f06f745ffb25 2024-05-24T23:35:01.061372744Z [2024-05-24T23:35:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f93d8f2-c807-450d-bf5b-5d01673e989f 2024-05-24T23:35:01.062076676Z [2024-05-24T23:35:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0855bbf8-ce30-4712-89f8-cd4730cd6637 2024-05-24T23:35:01.062362135Z [2024-05-24T23:35:01.062+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d81b596-cabe-4ffb-bd08-16d82bb480fd 2024-05-24T23:35:02.318727225Z [2024-05-24T23:35:02.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:35:02.319062655Z [2024-05-24T23:35:02.318+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:34:00+00:00, run_id=scheduled__2024-05-24T23:34:00+00:00, run_start_date=2024-05-24 23:35:00.550067+00:00, run_end_date=2024-05-24 23:35:02.318715+00:00, run_duration=1.768648, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:34:00+00:00, data_interval_end=2024-05-24 23:35:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:35:02.351291036Z [2024-05-24T23:35:02.350+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:35:00+00:00, run_after=2024-05-24T23:36:00+00:00 2024-05-24T23:35:02.418598209Z [2024-05-24T23:35:02.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:34:00+00:00 exited with status success for try_number 1 2024-05-24T23:35:02.427650926Z [2024-05-24T23:35:02.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:34:00+00:00, map_index=-1, run_start_date=2024-05-24 23:35:01.600949+00:00, run_end_date=2024-05-24 23:35:02.134485+00:00, run_duration=0.533536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:35:00.651722+00:00, queued_by_job_id=1, pid=2650 2024-05-24T23:35:03.517344046Z [2024-05-24T23:35:03.515+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:35:03.517378993Z 2024-05-24T23:35:03.517384236Z [2024-05-24T23:35:03.516+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:35:03.520135746Z [2024-05-24T23:35:03.519+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:35:03.520146176Z 2024-05-24T23:35:03.528229986Z [2024-05-24T23:35:03.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:35:03.529866370Z [2024-05-24T23:35:03.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:35:03.609984741Z [2024-05-24T23:35:03.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status queued for try_number 1 2024-05-24T23:35:03.610388512Z [2024-05-24T23:35:03.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status success for try_number 1 2024-05-24T23:35:03.619091728Z [2024-05-24T23:35:03.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4a564b8-7afd-4ba1-8bd3-41116544f895 2024-05-24T23:35:03.619703474Z [2024-05-24T23:35:03.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:30:00+00:00, map_index=-1, run_start_date=2024-05-24 23:35:02.879442+00:00, run_end_date=2024-05-24 23:35:03.375861+00:00, run_duration=0.496419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:35:00.651722+00:00, queued_by_job_id=1, pid=2669 2024-05-24T23:35:04.796462076Z [2024-05-24T23:35:04.795+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:35:04.797281611Z [2024-05-24T23:35:04.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:34:00+00:00, run_id=scheduled__2024-05-24T23:34:00+00:00, run_start_date=2024-05-24 23:35:00.551273+00:00, run_end_date=2024-05-24 23:35:04.796662+00:00, run_duration=4.245389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:34:00+00:00, data_interval_end=2024-05-24 23:35:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:35:04.811540521Z [2024-05-24T23:35:04.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:35:00+00:00, run_after=2024-05-24T23:36:00+00:00 2024-05-24T23:35:04.824477061Z [2024-05-24T23:35:04.824+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:35:04.825145894Z [2024-05-24T23:35:04.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:34:00+00:00, run_id=scheduled__2024-05-24T23:34:00+00:00, run_start_date=2024-05-24 23:35:00.552440+00:00, run_end_date=2024-05-24 23:35:04.824688+00:00, run_duration=4.272248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:34:00+00:00, data_interval_end=2024-05-24 23:35:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:35:04.842651328Z [2024-05-24T23:35:04.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:35:00+00:00, run_after=2024-05-24T23:36:00+00:00 2024-05-24T23:35:04.908400762Z [2024-05-24T23:35:04.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:34:00+00:00 exited with status success for try_number 1 2024-05-24T23:35:04.908447817Z [2024-05-24T23:35:04.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:34:00+00:00 exited with status success for try_number 1 2024-05-24T23:35:04.914700349Z [2024-05-24T23:35:04.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:34:00+00:00, map_index=-1, run_start_date=2024-05-24 23:35:02.914333+00:00, run_end_date=2024-05-24 23:35:04.554930+00:00, run_duration=1.640597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:35:00.651722+00:00, queued_by_job_id=1, pid=2675 2024-05-24T23:35:04.914831017Z [2024-05-24T23:35:04.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:34:00+00:00, map_index=-1, run_start_date=2024-05-24 23:35:03.147985+00:00, run_end_date=2024-05-24 23:35:04.439345+00:00, run_duration=1.29136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:35:00.651722+00:00, queued_by_job_id=1, pid=2676 2024-05-24T23:35:06.152559813Z [2024-05-24T23:35:06.152+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:35:06.152586516Z 2024-05-24T23:35:06.152756720Z [2024-05-24T23:35:06.152+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:35:06.153284820Z [2024-05-24T23:35:06.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:35:06.153302917Z 2024-05-24T23:35:06.155526318Z [2024-05-24T23:35:06.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:35:06.155659510Z [2024-05-24T23:35:06.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:35:06.214700389Z [2024-05-24T23:35:06.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status queued for try_number 1 2024-05-24T23:35:06.214848530Z [2024-05-24T23:35:06.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status success for try_number 1 2024-05-24T23:35:06.221489378Z [2024-05-24T23:35:06.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c2f54f0-aa72-4523-b40a-c39ee7d1e69c 2024-05-24T23:35:06.221823721Z [2024-05-24T23:35:06.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:30:00+00:00, map_index=-1, run_start_date=2024-05-24 23:35:05.480140+00:00, run_end_date=2024-05-24 23:35:05.899969+00:00, run_duration=0.419829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:35:03.521016+00:00, queued_by_job_id=1, pid=2699 2024-05-24T23:35:08.985077126Z [2024-05-24T23:35:08.984+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:35:08.985274631Z 2024-05-24T23:35:08.985283748Z [2024-05-24T23:35:08.984+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:35:08.985659947Z [2024-05-24T23:35:08.985+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:35:08.985688317Z 2024-05-24T23:35:08.988613302Z [2024-05-24T23:35:08.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:35:08.988753129Z [2024-05-24T23:35:08.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:35:09.048399277Z [2024-05-24T23:35:09.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status queued for try_number 1 2024-05-24T23:35:09.049016842Z [2024-05-24T23:35:09.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status success for try_number 1 2024-05-24T23:35:09.058835246Z [2024-05-24T23:35:09.058+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc47f9fe-eb3e-4173-bf09-4fceb7af21fe 2024-05-24T23:35:09.059730105Z [2024-05-24T23:35:09.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:30:00+00:00, map_index=0, run_start_date=2024-05-24 23:35:07.861996+00:00, run_end_date=2024-05-24 23:35:08.219123+00:00, run_duration=0.357127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:35:06.153659+00:00, queued_by_job_id=1, pid=2717 2024-05-24T23:35:11.288211478Z [2024-05-24T23:35:11.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:35:11.288389649Z [2024-05-24T23:35:11.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:30:00+00:00, run_id=scheduled__2024-05-24T23:30:00+00:00, run_start_date=2024-05-24 23:35:00.548687+00:00, run_end_date=2024-05-24 23:35:11.287748+00:00, run_duration=10.739061, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:30:00+00:00, data_interval_end=2024-05-24 23:35:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-24T23:35:11.297119578Z [2024-05-24T23:35:11.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:35:00+00:00, run_after=2024-05-24T23:40:00+00:00 2024-05-24T23:35:11.338438993Z [2024-05-24T23:35:11.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:30:00+00:00 exited with status success for try_number 1 2024-05-24T23:35:11.346834703Z [2024-05-24T23:35:11.346+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:30:00+00:00, map_index=-1, run_start_date=2024-05-24 23:35:10.735769+00:00, run_end_date=2024-05-24 23:35:11.116603+00:00, run_duration=0.380834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:35:08.985904+00:00, queued_by_job_id=1, pid=2728 2024-05-24T23:35:27.680926938Z [2024-05-24T23:35:27.680+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T23:36:00.401995891Z [2024-05-24T23:36:00.400+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:36:00.415456612Z [2024-05-24T23:36:00.415+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:36:00.431649894Z [2024-05-24T23:36:00.431+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:36:00+00:00, run_after=2024-05-24T23:37:00+00:00 2024-05-24T23:36:00.444165070Z [2024-05-24T23:36:00.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:36:00+00:00, run_after=2024-05-24T23:37:00+00:00 2024-05-24T23:36:00.547184861Z [2024-05-24T23:36:00.546+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:36:00.547230999Z 2024-05-24T23:36:00.547237105Z 2024-05-24T23:36:00.547241923Z 2024-05-24T23:36:00.547246421Z 2024-05-24T23:36:00.547641896Z [2024-05-24T23:36:00.547+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:36:00.547979035Z [2024-05-24T23:36:00.547+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:36:00.548299081Z [2024-05-24T23:36:00.548+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:36:00.548621662Z [2024-05-24T23:36:00.548+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:36:00.549591875Z [2024-05-24T23:36:00.549+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:36:00.549606388Z 2024-05-24T23:36:00.549611099Z 2024-05-24T23:36:00.549615447Z 2024-05-24T23:36:00.549620130Z 2024-05-24T23:36:00.555100434Z [2024-05-24T23:36:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:36:00.555455604Z [2024-05-24T23:36:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:36:00.555956033Z [2024-05-24T23:36:00.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:36:00.556318028Z [2024-05-24T23:36:00.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:36:00.556862082Z [2024-05-24T23:36:00.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:36:00.557179353Z [2024-05-24T23:36:00.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:36:00.557647006Z [2024-05-24T23:36:00.557+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:36:00.557901700Z [2024-05-24T23:36:00.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:36:00.869527147Z [2024-05-24T23:36:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:34:00+00:00 exited with status queued for try_number 1 2024-05-24T23:36:00.869659320Z [2024-05-24T23:36:00.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status queued for try_number 1 2024-05-24T23:36:00.869665103Z [2024-05-24T23:36:00.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status queued for try_number 1 2024-05-24T23:36:00.869676487Z [2024-05-24T23:36:00.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status queued for try_number 1 2024-05-24T23:36:00.879469420Z [2024-05-24T23:36:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7420d0f-5e07-4271-b73e-ccf2fcc46a16 2024-05-24T23:36:00.879512432Z [2024-05-24T23:36:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e9cbbf4-ad40-4f78-a6a4-7318f4208f25 2024-05-24T23:36:00.879577054Z [2024-05-24T23:36:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14308431-793a-4467-923b-1ddd5e3b0647 2024-05-24T23:36:00.879688436Z [2024-05-24T23:36:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13227af1-40da-4e65-ae10-73f82530297a 2024-05-24T23:36:02.106437505Z [2024-05-24T23:36:02.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:36:02.106626815Z [2024-05-24T23:36:02.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:34:00+00:00, run_id=scheduled__2024-05-24T23:34:00+00:00, run_start_date=2024-05-24 23:36:00.466820+00:00, run_end_date=2024-05-24 23:36:02.106307+00:00, run_duration=1.639487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:34:00+00:00, data_interval_end=2024-05-24 23:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:36:02.114427882Z [2024-05-24T23:36:02.114+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:36:00+00:00, run_after=2024-05-24T23:38:00+00:00 2024-05-24T23:36:02.123004387Z [2024-05-24T23:36:02.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:36:02.123112059Z [2024-05-24T23:36:02.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:35:00+00:00, run_id=scheduled__2024-05-24T23:35:00+00:00, run_start_date=2024-05-24 23:36:00.468730+00:00, run_end_date=2024-05-24 23:36:02.122887+00:00, run_duration=1.654157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:35:00+00:00, data_interval_end=2024-05-24 23:36:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:36:02.136033917Z [2024-05-24T23:36:02.135+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:36:00+00:00, run_after=2024-05-24T23:37:00+00:00 2024-05-24T23:36:02.208028227Z [2024-05-24T23:36:02.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:34:00+00:00 exited with status success for try_number 1 2024-05-24T23:36:02.208057518Z [2024-05-24T23:36:02.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status success for try_number 1 2024-05-24T23:36:02.214731837Z [2024-05-24T23:36:02.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:35:00+00:00, map_index=-1, run_start_date=2024-05-24 23:36:01.506936+00:00, run_end_date=2024-05-24 23:36:01.892896+00:00, run_duration=0.38596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:36:00.550997+00:00, queued_by_job_id=1, pid=2738 2024-05-24T23:36:02.214766967Z [2024-05-24T23:36:02.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:34:00+00:00, map_index=-1, run_start_date=2024-05-24 23:36:01.547438+00:00, run_end_date=2024-05-24 23:36:01.950610+00:00, run_duration=0.403172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:36:00.550997+00:00, queued_by_job_id=1, pid=2739 2024-05-24T23:36:04.412563037Z [2024-05-24T23:36:04.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:36:04.412874124Z [2024-05-24T23:36:04.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:35:00+00:00, run_id=scheduled__2024-05-24T23:35:00+00:00, run_start_date=2024-05-24 23:36:00.470474+00:00, run_end_date=2024-05-24 23:36:04.412325+00:00, run_duration=3.941851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:35:00+00:00, data_interval_end=2024-05-24 23:36:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:36:04.424071169Z [2024-05-24T23:36:04.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:36:00+00:00, run_after=2024-05-24T23:37:00+00:00 2024-05-24T23:36:04.478185423Z [2024-05-24T23:36:04.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status success for try_number 1 2024-05-24T23:36:04.486958231Z [2024-05-24T23:36:04.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:35:00+00:00, map_index=-1, run_start_date=2024-05-24 23:36:02.443304+00:00, run_end_date=2024-05-24 23:36:03.711971+00:00, run_duration=1.268667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:36:00.550997+00:00, queued_by_job_id=1, pid=2762 2024-05-24T23:36:05.536079836Z [2024-05-24T23:36:05.534+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:36:05.536788278Z [2024-05-24T23:36:05.536+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:35:00+00:00, run_id=scheduled__2024-05-24T23:35:00+00:00, run_start_date=2024-05-24 23:36:00.472059+00:00, run_end_date=2024-05-24 23:36:05.536095+00:00, run_duration=5.064036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:35:00+00:00, data_interval_end=2024-05-24 23:36:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:36:05.552441146Z [2024-05-24T23:36:05.552+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:36:00+00:00, run_after=2024-05-24T23:37:00+00:00 2024-05-24T23:36:05.594837381Z [2024-05-24T23:36:05.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status success for try_number 1 2024-05-24T23:36:05.601862859Z [2024-05-24T23:36:05.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:35:00+00:00, map_index=-1, run_start_date=2024-05-24 23:36:02.654267+00:00, run_end_date=2024-05-24 23:36:04.542805+00:00, run_duration=1.888538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:36:00.550997+00:00, queued_by_job_id=1, pid=2763 2024-05-24T23:37:00.205798644Z [2024-05-24T23:37:00.205+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:37:00+00:00, run_after=2024-05-24T23:38:00+00:00 2024-05-24T23:37:00.221431710Z [2024-05-24T23:37:00.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:37:00+00:00, run_after=2024-05-24T23:38:00+00:00 2024-05-24T23:37:00.229716183Z [2024-05-24T23:37:00.229+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:37:00.301409434Z [2024-05-24T23:37:00.301+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:37:00.301434939Z 2024-05-24T23:37:00.301438568Z 2024-05-24T23:37:00.301441794Z 2024-05-24T23:37:00.301694030Z [2024-05-24T23:37:00.301+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:37:00.301908693Z [2024-05-24T23:37:00.301+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:37:00.302095096Z [2024-05-24T23:37:00.301+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:37:00.302921746Z [2024-05-24T23:37:00.302+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:37:00.302929122Z 2024-05-24T23:37:00.302932376Z 2024-05-24T23:37:00.302935522Z 2024-05-24T23:37:00.307444074Z [2024-05-24T23:37:00.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:37:00.307646020Z [2024-05-24T23:37:00.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:37:00.308021676Z [2024-05-24T23:37:00.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:37:00.308297196Z [2024-05-24T23:37:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:37:00.308669311Z [2024-05-24T23:37:00.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:37:00.308886855Z [2024-05-24T23:37:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:37:00.529733190Z [2024-05-24T23:37:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:36:00+00:00 exited with status queued for try_number 1 2024-05-24T23:37:00.529793934Z [2024-05-24T23:37:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:36:00+00:00 exited with status queued for try_number 1 2024-05-24T23:37:00.529992366Z [2024-05-24T23:37:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:36:00+00:00 exited with status queued for try_number 1 2024-05-24T23:37:00.536325107Z [2024-05-24T23:37:00.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18d69fba-0271-4f79-9703-4d87d26b1753 2024-05-24T23:37:00.536397602Z [2024-05-24T23:37:00.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d540a85-e9ae-4e8a-8cc3-69427d1c81af 2024-05-24T23:37:00.536617004Z [2024-05-24T23:37:00.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1312b2f-a439-495a-a31c-66c53c57567f 2024-05-24T23:37:01.671778195Z [2024-05-24T23:37:01.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:37:01.675666796Z [2024-05-24T23:37:01.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:36:00+00:00, run_id=scheduled__2024-05-24T23:36:00+00:00, run_start_date=2024-05-24 23:37:00.240785+00:00, run_end_date=2024-05-24 23:37:01.671704+00:00, run_duration=1.430919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:36:00+00:00, data_interval_end=2024-05-24 23:37:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:37:01.699591347Z [2024-05-24T23:37:01.699+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:37:00+00:00, run_after=2024-05-24T23:38:00+00:00 2024-05-24T23:37:01.818986262Z [2024-05-24T23:37:01.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:36:00+00:00 exited with status success for try_number 1 2024-05-24T23:37:01.830486757Z [2024-05-24T23:37:01.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:36:00+00:00, map_index=-1, run_start_date=2024-05-24 23:37:01.047374+00:00, run_end_date=2024-05-24 23:37:01.491214+00:00, run_duration=0.44384, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:37:00.303891+00:00, queued_by_job_id=1, pid=2795 2024-05-24T23:37:04.231484638Z [2024-05-24T23:37:04.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:37:04.231887033Z [2024-05-24T23:37:04.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:36:00+00:00, run_id=scheduled__2024-05-24T23:36:00+00:00, run_start_date=2024-05-24 23:37:00.242098+00:00, run_end_date=2024-05-24 23:37:04.231402+00:00, run_duration=3.989304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:36:00+00:00, data_interval_end=2024-05-24 23:37:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:37:04.242167848Z [2024-05-24T23:37:04.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:37:00+00:00, run_after=2024-05-24T23:38:00+00:00 2024-05-24T23:37:04.250438197Z [2024-05-24T23:37:04.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:37:04.250922912Z [2024-05-24T23:37:04.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:36:00+00:00, run_id=scheduled__2024-05-24T23:36:00+00:00, run_start_date=2024-05-24 23:37:00.243202+00:00, run_end_date=2024-05-24 23:37:04.250531+00:00, run_duration=4.007329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:36:00+00:00, data_interval_end=2024-05-24 23:37:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:37:04.260550089Z [2024-05-24T23:37:04.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:37:00+00:00, run_after=2024-05-24T23:38:00+00:00 2024-05-24T23:37:04.297364358Z [2024-05-24T23:37:04.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:36:00+00:00 exited with status success for try_number 1 2024-05-24T23:37:04.297546116Z [2024-05-24T23:37:04.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:36:00+00:00 exited with status success for try_number 1 2024-05-24T23:37:04.308670604Z [2024-05-24T23:37:04.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:36:00+00:00, map_index=-1, run_start_date=2024-05-24 23:37:01.966465+00:00, run_end_date=2024-05-24 23:37:03.234524+00:00, run_duration=1.268059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:37:00.303891+00:00, queued_by_job_id=1, pid=2808 2024-05-24T23:37:04.308909884Z [2024-05-24T23:37:04.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:36:00+00:00, map_index=-1, run_start_date=2024-05-24 23:37:02.353490+00:00, run_end_date=2024-05-24 23:37:04.008798+00:00, run_duration=1.655308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:37:00.303891+00:00, queued_by_job_id=1, pid=2819 2024-05-24T23:38:00.054236486Z [2024-05-24T23:38:00.053+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:38:00.062928157Z [2024-05-24T23:38:00.062+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:38:00.073708491Z [2024-05-24T23:38:00.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:38:00+00:00, run_after=2024-05-24T23:39:00+00:00 2024-05-24T23:38:00.084676040Z [2024-05-24T23:38:00.084+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:38:00+00:00, run_after=2024-05-24T23:39:00+00:00 2024-05-24T23:38:00.155101320Z [2024-05-24T23:38:00.154+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:38:00.155140087Z 2024-05-24T23:38:00.155144521Z 2024-05-24T23:38:00.155147517Z 2024-05-24T23:38:00.155150463Z 2024-05-24T23:38:00.155497645Z [2024-05-24T23:38:00.155+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:38:00.155714681Z [2024-05-24T23:38:00.155+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:38:00.155919345Z [2024-05-24T23:38:00.155+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:38:00.156222684Z [2024-05-24T23:38:00.156+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:38:00.156912693Z [2024-05-24T23:38:00.156+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:38:00.156924375Z 2024-05-24T23:38:00.156927969Z 2024-05-24T23:38:00.156931095Z 2024-05-24T23:38:00.156934672Z 2024-05-24T23:38:00.162724250Z [2024-05-24T23:38:00.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:38:00.163345361Z [2024-05-24T23:38:00.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:38:00.172572401Z [2024-05-24T23:38:00.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:38:00.176499530Z [2024-05-24T23:38:00.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:38:00.177605686Z [2024-05-24T23:38:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:38:00.177805383Z [2024-05-24T23:38:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:38:00.178284972Z [2024-05-24T23:38:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:38:00.179773016Z [2024-05-24T23:38:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:38:00.608556195Z [2024-05-24T23:38:00.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:36:00+00:00 exited with status queued for try_number 1 2024-05-24T23:38:00.608614414Z [2024-05-24T23:38:00.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:37:00+00:00 exited with status queued for try_number 1 2024-05-24T23:38:00.608619184Z [2024-05-24T23:38:00.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:37:00+00:00 exited with status queued for try_number 1 2024-05-24T23:38:00.608684147Z [2024-05-24T23:38:00.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:37:00+00:00 exited with status queued for try_number 1 2024-05-24T23:38:00.622812113Z [2024-05-24T23:38:00.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11798772-b44e-433e-a246-2ca8bc099949 2024-05-24T23:38:00.622920830Z [2024-05-24T23:38:00.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to e76d26f4-78d8-4ea2-823a-53364ee49aba 2024-05-24T23:38:00.623057381Z [2024-05-24T23:38:00.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31617379-5ff2-4e73-bd36-a6bb0a614dfc 2024-05-24T23:38:00.623181004Z [2024-05-24T23:38:00.623+0000] {scheduler_job.py:635} INFO - Setting external_id for to 134e0191-ddf7-4cc7-b8e8-f0412d57a436 2024-05-24T23:38:01.915284286Z [2024-05-24T23:38:01.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:38:01.915637277Z [2024-05-24T23:38:01.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:36:00+00:00, run_id=scheduled__2024-05-24T23:36:00+00:00, run_start_date=2024-05-24 23:38:00.094632+00:00, run_end_date=2024-05-24 23:38:01.915205+00:00, run_duration=1.820573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:36:00+00:00, data_interval_end=2024-05-24 23:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:38:01.924192559Z [2024-05-24T23:38:01.923+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:38:00+00:00, run_after=2024-05-24T23:40:00+00:00 2024-05-24T23:38:01.930725791Z [2024-05-24T23:38:01.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:38:01.930853728Z [2024-05-24T23:38:01.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:37:00+00:00, run_id=scheduled__2024-05-24T23:37:00+00:00, run_start_date=2024-05-24 23:38:00.095965+00:00, run_end_date=2024-05-24 23:38:01.930637+00:00, run_duration=1.834672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:37:00+00:00, data_interval_end=2024-05-24 23:38:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:38:01.939885500Z [2024-05-24T23:38:01.939+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:38:00+00:00, run_after=2024-05-24T23:39:00+00:00 2024-05-24T23:38:01.983925842Z [2024-05-24T23:38:01.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:36:00+00:00 exited with status success for try_number 1 2024-05-24T23:38:01.984021048Z [2024-05-24T23:38:01.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:37:00+00:00 exited with status success for try_number 1 2024-05-24T23:38:01.993045070Z [2024-05-24T23:38:01.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:37:00+00:00, map_index=-1, run_start_date=2024-05-24 23:38:01.230538+00:00, run_end_date=2024-05-24 23:38:01.656730+00:00, run_duration=0.426192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:38:00.157944+00:00, queued_by_job_id=1, pid=2849 2024-05-24T23:38:01.993452213Z [2024-05-24T23:38:01.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:36:00+00:00, map_index=-1, run_start_date=2024-05-24 23:38:01.194003+00:00, run_end_date=2024-05-24 23:38:01.660715+00:00, run_duration=0.466712, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:38:00.157944+00:00, queued_by_job_id=1, pid=2848 2024-05-24T23:38:04.082799363Z [2024-05-24T23:38:04.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:38:04.083231252Z [2024-05-24T23:38:04.082+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:37:00+00:00, run_id=scheduled__2024-05-24T23:37:00+00:00, run_start_date=2024-05-24 23:38:00.097288+00:00, run_end_date=2024-05-24 23:38:04.082473+00:00, run_duration=3.985185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:37:00+00:00, data_interval_end=2024-05-24 23:38:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:38:04.105482440Z [2024-05-24T23:38:04.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:38:00+00:00, run_after=2024-05-24T23:39:00+00:00 2024-05-24T23:38:04.150425091Z [2024-05-24T23:38:04.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:37:00+00:00 exited with status success for try_number 1 2024-05-24T23:38:04.160236114Z [2024-05-24T23:38:04.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:37:00+00:00, map_index=-1, run_start_date=2024-05-24 23:38:02.240350+00:00, run_end_date=2024-05-24 23:38:03.589821+00:00, run_duration=1.349471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:38:00.157944+00:00, queued_by_job_id=1, pid=2872 2024-05-24T23:38:05.242862128Z [2024-05-24T23:38:05.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:38:05.243147766Z [2024-05-24T23:38:05.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:37:00+00:00, run_id=scheduled__2024-05-24T23:37:00+00:00, run_start_date=2024-05-24 23:38:00.098838+00:00, run_end_date=2024-05-24 23:38:05.242712+00:00, run_duration=5.143874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:37:00+00:00, data_interval_end=2024-05-24 23:38:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:38:05.252769134Z [2024-05-24T23:38:05.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:38:00+00:00, run_after=2024-05-24T23:39:00+00:00 2024-05-24T23:38:05.285167654Z [2024-05-24T23:38:05.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:37:00+00:00 exited with status success for try_number 1 2024-05-24T23:38:05.291836508Z [2024-05-24T23:38:05.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:37:00+00:00, map_index=-1, run_start_date=2024-05-24 23:38:02.455878+00:00, run_end_date=2024-05-24 23:38:04.301454+00:00, run_duration=1.845576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:38:00.157944+00:00, queued_by_job_id=1, pid=2873 2024-05-24T23:39:00.097508934Z [2024-05-24T23:39:00.096+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:39:00+00:00, run_after=2024-05-24T23:40:00+00:00 2024-05-24T23:39:00.108178237Z [2024-05-24T23:39:00.107+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:39:00.119935850Z [2024-05-24T23:39:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:39:00+00:00, run_after=2024-05-24T23:40:00+00:00 2024-05-24T23:39:00.188376538Z [2024-05-24T23:39:00.187+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:39:00.188453615Z 2024-05-24T23:39:00.188465136Z 2024-05-24T23:39:00.188473964Z 2024-05-24T23:39:00.188531280Z [2024-05-24T23:39:00.188+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:39:00.188541773Z [2024-05-24T23:39:00.188+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:39:00.188702920Z [2024-05-24T23:39:00.188+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:39:00.189544521Z [2024-05-24T23:39:00.189+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:39:00.189569469Z 2024-05-24T23:39:00.189578958Z 2024-05-24T23:39:00.189587620Z 2024-05-24T23:39:00.193337099Z [2024-05-24T23:39:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:39:00.193457903Z [2024-05-24T23:39:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:39:00.193820708Z [2024-05-24T23:39:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:39:00.193969333Z [2024-05-24T23:39:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:39:00.194373287Z [2024-05-24T23:39:00.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:39:00.194532988Z [2024-05-24T23:39:00.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:39:00.470327040Z [2024-05-24T23:39:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:38:00+00:00 exited with status queued for try_number 1 2024-05-24T23:39:00.472365342Z [2024-05-24T23:39:00.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:38:00+00:00 exited with status queued for try_number 1 2024-05-24T23:39:00.472508548Z [2024-05-24T23:39:00.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:38:00+00:00 exited with status queued for try_number 1 2024-05-24T23:39:00.479262837Z [2024-05-24T23:39:00.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to fecc2166-8fa3-4515-93fb-48be8e58b7a2 2024-05-24T23:39:00.479444347Z [2024-05-24T23:39:00.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f9a9dae-e381-4cf9-a050-0b63c4018dac 2024-05-24T23:39:00.479619160Z [2024-05-24T23:39:00.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d237eee-e2be-4a0b-8233-8a1c40a61772 2024-05-24T23:39:01.627392559Z [2024-05-24T23:39:01.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:39:01.627698695Z [2024-05-24T23:39:01.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:38:00+00:00, run_id=scheduled__2024-05-24T23:38:00+00:00, run_start_date=2024-05-24 23:39:00.129834+00:00, run_end_date=2024-05-24 23:39:01.627289+00:00, run_duration=1.497455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:38:00+00:00, data_interval_end=2024-05-24 23:39:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:39:01.641572735Z [2024-05-24T23:39:01.641+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:39:00+00:00, run_after=2024-05-24T23:40:00+00:00 2024-05-24T23:39:01.684804125Z [2024-05-24T23:39:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:38:00+00:00 exited with status success for try_number 1 2024-05-24T23:39:01.695749763Z [2024-05-24T23:39:01.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:38:00+00:00, map_index=-1, run_start_date=2024-05-24 23:39:01.023768+00:00, run_end_date=2024-05-24 23:39:01.485622+00:00, run_duration=0.461854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:39:00.190282+00:00, queued_by_job_id=1, pid=2905 2024-05-24T23:39:03.860020370Z [2024-05-24T23:39:03.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:39:03.860112105Z [2024-05-24T23:39:03.859+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:38:00+00:00, run_id=scheduled__2024-05-24T23:38:00+00:00, run_start_date=2024-05-24 23:39:00.131096+00:00, run_end_date=2024-05-24 23:39:03.859528+00:00, run_duration=3.728432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:38:00+00:00, data_interval_end=2024-05-24 23:39:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:39:03.889534417Z [2024-05-24T23:39:03.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:39:00+00:00, run_after=2024-05-24T23:40:00+00:00 2024-05-24T23:39:03.959647997Z [2024-05-24T23:39:03.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:38:00+00:00 exited with status success for try_number 1 2024-05-24T23:39:03.965596815Z [2024-05-24T23:39:03.965+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:38:00+00:00, map_index=-1, run_start_date=2024-05-24 23:39:02.289752+00:00, run_end_date=2024-05-24 23:39:03.718697+00:00, run_duration=1.428945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:39:00.190282+00:00, queued_by_job_id=1, pid=2924 2024-05-24T23:39:05.031997811Z [2024-05-24T23:39:05.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:39:05.032267165Z [2024-05-24T23:39:05.032+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:38:00+00:00, run_id=scheduled__2024-05-24T23:38:00+00:00, run_start_date=2024-05-24 23:39:00.132098+00:00, run_end_date=2024-05-24 23:39:05.031962+00:00, run_duration=4.899864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:38:00+00:00, data_interval_end=2024-05-24 23:39:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:39:05.040696239Z [2024-05-24T23:39:05.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:39:00+00:00, run_after=2024-05-24T23:40:00+00:00 2024-05-24T23:39:05.072582215Z [2024-05-24T23:39:05.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:38:00+00:00 exited with status success for try_number 1 2024-05-24T23:39:05.077530516Z [2024-05-24T23:39:05.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:38:00+00:00, map_index=-1, run_start_date=2024-05-24 23:39:02.275786+00:00, run_end_date=2024-05-24 23:39:04.840822+00:00, run_duration=2.565036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:39:00.190282+00:00, queued_by_job_id=1, pid=2923 2024-05-24T23:40:01.010994930Z [2024-05-24T23:40:01.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:40:00+00:00, run_after=2024-05-24T23:41:00+00:00 2024-05-24T23:40:01.030338699Z [2024-05-24T23:40:01.029+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:40:00+00:00, run_after=2024-05-24T23:41:00+00:00 2024-05-24T23:40:01.038930758Z [2024-05-24T23:40:01.038+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:40:01.051648834Z [2024-05-24T23:40:01.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:40:00+00:00, run_after=2024-05-24T23:45:00+00:00 2024-05-24T23:40:01.059379666Z [2024-05-24T23:40:01.059+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:40:01.165741864Z [2024-05-24T23:40:01.165+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T23:40:01.165768472Z 2024-05-24T23:40:01.165772095Z 2024-05-24T23:40:01.165777213Z 2024-05-24T23:40:01.165780546Z 2024-05-24T23:40:01.165783811Z 2024-05-24T23:40:01.165931119Z [2024-05-24T23:40:01.165+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:40:01.166132925Z [2024-05-24T23:40:01.165+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:40:01.166300383Z [2024-05-24T23:40:01.166+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:40:01.166488428Z [2024-05-24T23:40:01.166+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:40:01.166658294Z [2024-05-24T23:40:01.166+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:40:01.167305168Z [2024-05-24T23:40:01.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:40:01.167331656Z 2024-05-24T23:40:01.167335246Z 2024-05-24T23:40:01.167338499Z 2024-05-24T23:40:01.167341382Z 2024-05-24T23:40:01.167344526Z 2024-05-24T23:40:01.171612393Z [2024-05-24T23:40:01.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:40:01.171825608Z [2024-05-24T23:40:01.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:40:01.172133293Z [2024-05-24T23:40:01.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:40:01.172357894Z [2024-05-24T23:40:01.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:40:01.172642935Z [2024-05-24T23:40:01.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:40:01.172810878Z [2024-05-24T23:40:01.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:40:01.173085962Z [2024-05-24T23:40:01.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:40:01.173275849Z [2024-05-24T23:40:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:40:01.173595366Z [2024-05-24T23:40:01.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:40:01.173770132Z [2024-05-24T23:40:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:40:01.725519433Z [2024-05-24T23:40:01.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status queued for try_number 1 2024-05-24T23:40:01.728813883Z [2024-05-24T23:40:01.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:38:00+00:00 exited with status queued for try_number 1 2024-05-24T23:40:01.728982668Z [2024-05-24T23:40:01.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:39:00+00:00 exited with status queued for try_number 1 2024-05-24T23:40:01.729965776Z [2024-05-24T23:40:01.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:39:00+00:00 exited with status queued for try_number 1 2024-05-24T23:40:01.730100471Z [2024-05-24T23:40:01.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:39:00+00:00 exited with status queued for try_number 1 2024-05-24T23:40:01.739493755Z [2024-05-24T23:40:01.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9e2e279-6de2-4b07-914d-5b6e644d5bb4 2024-05-24T23:40:01.739653510Z [2024-05-24T23:40:01.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 176186e3-e012-428d-9743-fe33fd949279 2024-05-24T23:40:01.739809155Z [2024-05-24T23:40:01.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 907fb707-09a1-49d8-9252-6d15aaf5f09c 2024-05-24T23:40:01.739959802Z [2024-05-24T23:40:01.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to df02d26f-2523-4583-898e-619ca67119e9 2024-05-24T23:40:01.740109600Z [2024-05-24T23:40:01.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to fda45551-0a16-40fc-919e-93a352194e26 2024-05-24T23:40:02.998978984Z [2024-05-24T23:40:02.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:40:03.000122647Z [2024-05-24T23:40:02.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:39:00+00:00, run_id=scheduled__2024-05-24T23:39:00+00:00, run_start_date=2024-05-24 23:40:01.081239+00:00, run_end_date=2024-05-24 23:40:02.999679+00:00, run_duration=1.91844, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:39:00+00:00, data_interval_end=2024-05-24 23:40:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:40:03.026769636Z [2024-05-24T23:40:03.026+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:40:00+00:00, run_after=2024-05-24T23:41:00+00:00 2024-05-24T23:40:03.195335278Z [2024-05-24T23:40:03.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:39:00+00:00 exited with status success for try_number 1 2024-05-24T23:40:03.213604865Z [2024-05-24T23:40:03.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:39:00+00:00, map_index=-1, run_start_date=2024-05-24 23:40:02.225153+00:00, run_end_date=2024-05-24 23:40:02.952288+00:00, run_duration=0.727135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:40:01.168449+00:00, queued_by_job_id=1, pid=2958 2024-05-24T23:40:04.283611154Z [2024-05-24T23:40:04.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:40:04.283936979Z [2024-05-24T23:40:04.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:38:00+00:00, run_id=scheduled__2024-05-24T23:38:00+00:00, run_start_date=2024-05-24 23:40:01.080145+00:00, run_end_date=2024-05-24 23:40:04.283419+00:00, run_duration=3.203274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:38:00+00:00, data_interval_end=2024-05-24 23:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:40:04.293953978Z [2024-05-24T23:40:04.293+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:40:00+00:00, run_after=2024-05-24T23:42:00+00:00 2024-05-24T23:40:04.363758903Z [2024-05-24T23:40:04.363+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:40:04.363850067Z 2024-05-24T23:40:04.363891334Z [2024-05-24T23:40:04.363+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:40:04.364692216Z [2024-05-24T23:40:04.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:40:04.364711554Z 2024-05-24T23:40:04.367894348Z [2024-05-24T23:40:04.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:40:04.368073052Z [2024-05-24T23:40:04.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:40:04.466266050Z [2024-05-24T23:40:04.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status queued for try_number 1 2024-05-24T23:40:04.466297341Z [2024-05-24T23:40:04.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:38:00+00:00 exited with status success for try_number 1 2024-05-24T23:40:04.472505559Z [2024-05-24T23:40:04.472+0000] {scheduler_job.py:635} INFO - Setting external_id for to fba989c9-ed51-4bcb-8ce0-3dc76f619794 2024-05-24T23:40:04.472655607Z [2024-05-24T23:40:04.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:38:00+00:00, map_index=-1, run_start_date=2024-05-24 23:40:02.394664+00:00, run_end_date=2024-05-24 23:40:03.119284+00:00, run_duration=0.72462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:40:01.168449+00:00, queued_by_job_id=1, pid=2959 2024-05-24T23:40:04.586682013Z [2024-05-24T23:40:04.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status success for try_number 1 2024-05-24T23:40:04.596502587Z [2024-05-24T23:40:04.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:35:00+00:00, map_index=-1, run_start_date=2024-05-24 23:40:03.802150+00:00, run_end_date=2024-05-24 23:40:04.220757+00:00, run_duration=0.418607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:40:01.168449+00:00, queued_by_job_id=1, pid=2984 2024-05-24T23:40:05.645808378Z [2024-05-24T23:40:05.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:40:05.646614074Z [2024-05-24T23:40:05.646+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:39:00+00:00, run_id=scheduled__2024-05-24T23:39:00+00:00, run_start_date=2024-05-24 23:40:01.083194+00:00, run_end_date=2024-05-24 23:40:05.645950+00:00, run_duration=4.562756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:39:00+00:00, data_interval_end=2024-05-24 23:40:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:40:05.662887370Z [2024-05-24T23:40:05.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:40:00+00:00, run_after=2024-05-24T23:41:00+00:00 2024-05-24T23:40:05.669920414Z [2024-05-24T23:40:05.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:40:05.670188804Z [2024-05-24T23:40:05.670+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:39:00+00:00, run_id=scheduled__2024-05-24T23:39:00+00:00, run_start_date=2024-05-24 23:40:01.082258+00:00, run_end_date=2024-05-24 23:40:05.669918+00:00, run_duration=4.58766, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:39:00+00:00, data_interval_end=2024-05-24 23:40:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:40:05.680769963Z [2024-05-24T23:40:05.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:40:00+00:00, run_after=2024-05-24T23:41:00+00:00 2024-05-24T23:40:05.734096294Z [2024-05-24T23:40:05.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:39:00+00:00 exited with status success for try_number 1 2024-05-24T23:40:05.743240825Z [2024-05-24T23:40:05.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:39:00+00:00, map_index=-1, run_start_date=2024-05-24 23:40:03.634164+00:00, run_end_date=2024-05-24 23:40:05.461662+00:00, run_duration=1.827498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:40:01.168449+00:00, queued_by_job_id=1, pid=2983 2024-05-24T23:40:06.811481558Z [2024-05-24T23:40:06.811+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:40:06.811513052Z 2024-05-24T23:40:06.811526617Z [2024-05-24T23:40:06.811+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:40:06.812369998Z [2024-05-24T23:40:06.811+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:40:06.812381764Z 2024-05-24T23:40:06.814409159Z [2024-05-24T23:40:06.814+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:40:06.814591981Z [2024-05-24T23:40:06.814+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:40:06.897131721Z [2024-05-24T23:40:06.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status queued for try_number 1 2024-05-24T23:40:06.897498578Z [2024-05-24T23:40:06.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:39:00+00:00 exited with status success for try_number 1 2024-05-24T23:40:06.897769156Z [2024-05-24T23:40:06.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status success for try_number 1 2024-05-24T23:40:06.906976279Z [2024-05-24T23:40:06.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:35:00+00:00, map_index=-1, run_start_date=2024-05-24 23:40:06.075058+00:00, run_end_date=2024-05-24 23:40:06.481886+00:00, run_duration=0.406828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:40:04.365191+00:00, queued_by_job_id=1, pid=3020 2024-05-24T23:40:06.907392039Z [2024-05-24T23:40:06.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6928ad4-4c87-499b-b1e1-bb3de278e0db 2024-05-24T23:40:06.907851021Z [2024-05-24T23:40:06.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:39:00+00:00, map_index=-1, run_start_date=2024-05-24 23:40:04.265539+00:00, run_end_date=2024-05-24 23:40:05.614750+00:00, run_duration=1.349211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:40:01.168449+00:00, queued_by_job_id=1, pid=3000 2024-05-24T23:40:10.061703064Z [2024-05-24T23:40:10.061+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:40:10.061742324Z 2024-05-24T23:40:10.061908671Z [2024-05-24T23:40:10.061+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:40:10.062647073Z [2024-05-24T23:40:10.062+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:40:10.062652895Z 2024-05-24T23:40:10.065505526Z [2024-05-24T23:40:10.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:40:10.065860160Z [2024-05-24T23:40:10.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:40:10.137044961Z [2024-05-24T23:40:10.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status queued for try_number 1 2024-05-24T23:40:10.137072551Z [2024-05-24T23:40:10.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status success for try_number 1 2024-05-24T23:40:10.143321551Z [2024-05-24T23:40:10.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ca059fe-016b-4af3-a365-0c443046af78 2024-05-24T23:40:10.143437941Z [2024-05-24T23:40:10.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:35:00+00:00, map_index=0, run_start_date=2024-05-24 23:40:08.567795+00:00, run_end_date=2024-05-24 23:40:08.994883+00:00, run_duration=0.427088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:40:06.812668+00:00, queued_by_job_id=1, pid=3034 2024-05-24T23:40:13.069387757Z [2024-05-24T23:40:13.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:40:13.069722135Z [2024-05-24T23:40:13.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:35:00+00:00, run_id=scheduled__2024-05-24T23:35:00+00:00, run_start_date=2024-05-24 23:40:01.078891+00:00, run_end_date=2024-05-24 23:40:13.069154+00:00, run_duration=11.990263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:35:00+00:00, data_interval_end=2024-05-24 23:40:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-24T23:40:13.084047254Z [2024-05-24T23:40:13.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:40:00+00:00, run_after=2024-05-24T23:45:00+00:00 2024-05-24T23:40:13.149441101Z [2024-05-24T23:40:13.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:35:00+00:00 exited with status success for try_number 1 2024-05-24T23:40:13.154023533Z [2024-05-24T23:40:13.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:35:00+00:00, map_index=-1, run_start_date=2024-05-24 23:40:11.642572+00:00, run_end_date=2024-05-24 23:40:12.060605+00:00, run_duration=0.418033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:40:10.063098+00:00, queued_by_job_id=1, pid=3042 2024-05-24T23:40:27.754376838Z [2024-05-24T23:40:27.753+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T23:41:00.401794831Z [2024-05-24T23:41:00.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:41:00+00:00, run_after=2024-05-24T23:42:00+00:00 2024-05-24T23:41:00.411388643Z [2024-05-24T23:41:00.411+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:41:00.425960368Z [2024-05-24T23:41:00.425+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:41:00+00:00, run_after=2024-05-24T23:42:00+00:00 2024-05-24T23:41:00.507442531Z [2024-05-24T23:41:00.506+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:41:00.507514799Z 2024-05-24T23:41:00.507526362Z 2024-05-24T23:41:00.507534958Z 2024-05-24T23:41:00.507975497Z [2024-05-24T23:41:00.507+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:41:00.508392275Z [2024-05-24T23:41:00.507+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:41:00.508729650Z [2024-05-24T23:41:00.508+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:41:00.510288117Z [2024-05-24T23:41:00.509+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:41:00.510320219Z 2024-05-24T23:41:00.510356467Z 2024-05-24T23:41:00.510365294Z 2024-05-24T23:41:00.516501330Z [2024-05-24T23:41:00.515+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:41:00.516929589Z [2024-05-24T23:41:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:41:00.517649433Z [2024-05-24T23:41:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:41:00.518038498Z [2024-05-24T23:41:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:41:00.518510622Z [2024-05-24T23:41:00.518+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:41:00.518748406Z [2024-05-24T23:41:00.518+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:41:00.778121002Z [2024-05-24T23:41:00.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status queued for try_number 1 2024-05-24T23:41:00.780998122Z [2024-05-24T23:41:00.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status queued for try_number 1 2024-05-24T23:41:00.781308569Z [2024-05-24T23:41:00.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status queued for try_number 1 2024-05-24T23:41:00.788560666Z [2024-05-24T23:41:00.788+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38414ec2-48dd-4367-b030-f1eb95040598 2024-05-24T23:41:00.788791435Z [2024-05-24T23:41:00.788+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1444f760-3b56-41f1-8c7d-ea2c5f1d16c8 2024-05-24T23:41:00.789103354Z [2024-05-24T23:41:00.788+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f46a9fe-5fdc-41e4-9d0c-ae1124da6a0a 2024-05-24T23:41:01.958029109Z [2024-05-24T23:41:01.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:41:01.958510774Z [2024-05-24T23:41:01.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:40:00+00:00, run_id=scheduled__2024-05-24T23:40:00+00:00, run_start_date=2024-05-24 23:41:00.438631+00:00, run_end_date=2024-05-24 23:41:01.958076+00:00, run_duration=1.519445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:40:00+00:00, data_interval_end=2024-05-24 23:41:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:41:01.967981410Z [2024-05-24T23:41:01.967+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:41:00+00:00, run_after=2024-05-24T23:42:00+00:00 2024-05-24T23:41:02.049411489Z [2024-05-24T23:41:02.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status success for try_number 1 2024-05-24T23:41:02.057946885Z [2024-05-24T23:41:02.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:40:00+00:00, map_index=-1, run_start_date=2024-05-24 23:41:01.340511+00:00, run_end_date=2024-05-24 23:41:01.800370+00:00, run_duration=0.459859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:41:00.512088+00:00, queued_by_job_id=1, pid=3051 2024-05-24T23:41:03.966505103Z [2024-05-24T23:41:03.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:41:03.969197827Z [2024-05-24T23:41:03.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:40:00+00:00, run_id=scheduled__2024-05-24T23:40:00+00:00, run_start_date=2024-05-24 23:41:00.439954+00:00, run_end_date=2024-05-24 23:41:03.966232+00:00, run_duration=3.526278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:40:00+00:00, data_interval_end=2024-05-24 23:41:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:41:03.981862767Z [2024-05-24T23:41:03.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:41:00+00:00, run_after=2024-05-24T23:42:00+00:00 2024-05-24T23:41:04.028395481Z [2024-05-24T23:41:04.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status success for try_number 1 2024-05-24T23:41:04.033196192Z [2024-05-24T23:41:04.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:40:00+00:00, map_index=-1, run_start_date=2024-05-24 23:41:02.419509+00:00, run_end_date=2024-05-24 23:41:03.704465+00:00, run_duration=1.284956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:41:00.512088+00:00, queued_by_job_id=1, pid=3069 2024-05-24T23:41:05.105873918Z [2024-05-24T23:41:05.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:41:05.106248494Z [2024-05-24T23:41:05.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:40:00+00:00, run_id=scheduled__2024-05-24T23:40:00+00:00, run_start_date=2024-05-24 23:41:00.446470+00:00, run_end_date=2024-05-24 23:41:05.105932+00:00, run_duration=4.659462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:40:00+00:00, data_interval_end=2024-05-24 23:41:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:41:05.115834080Z [2024-05-24T23:41:05.115+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:41:00+00:00, run_after=2024-05-24T23:42:00+00:00 2024-05-24T23:41:05.157791196Z [2024-05-24T23:41:05.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status success for try_number 1 2024-05-24T23:41:05.167174685Z [2024-05-24T23:41:05.166+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:40:00+00:00, map_index=-1, run_start_date=2024-05-24 23:41:02.570644+00:00, run_end_date=2024-05-24 23:41:04.133940+00:00, run_duration=1.563296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:41:00.512088+00:00, queued_by_job_id=1, pid=3070 2024-05-24T23:42:00.728655854Z [2024-05-24T23:42:00.727+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:42:00.748119804Z [2024-05-24T23:42:00.747+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:42:00+00:00, run_after=2024-05-24T23:43:00+00:00 2024-05-24T23:42:00.764287108Z [2024-05-24T23:42:00.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:42:00+00:00, run_after=2024-05-24T23:43:00+00:00 2024-05-24T23:42:00.772324225Z [2024-05-24T23:42:00.772+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:42:00.871773032Z [2024-05-24T23:42:00.871+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:42:00.871817337Z 2024-05-24T23:42:00.871828894Z 2024-05-24T23:42:00.871837607Z 2024-05-24T23:42:00.871846078Z 2024-05-24T23:42:00.872445116Z [2024-05-24T23:42:00.872+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:42:00.872941819Z [2024-05-24T23:42:00.872+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:42:00.873176521Z [2024-05-24T23:42:00.872+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:42:00.873551323Z [2024-05-24T23:42:00.873+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:42:00.875074659Z [2024-05-24T23:42:00.874+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:42:00.875100392Z 2024-05-24T23:42:00.875110119Z 2024-05-24T23:42:00.875118145Z 2024-05-24T23:42:00.875126210Z 2024-05-24T23:42:00.883553463Z [2024-05-24T23:42:00.883+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:42:00.884000964Z [2024-05-24T23:42:00.883+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:42:00.884613380Z [2024-05-24T23:42:00.884+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:42:00.885431771Z [2024-05-24T23:42:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:42:00.886026728Z [2024-05-24T23:42:00.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:42:00.886548828Z [2024-05-24T23:42:00.886+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:42:00.887153788Z [2024-05-24T23:42:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:42:00.887529458Z [2024-05-24T23:42:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:42:01.213975382Z [2024-05-24T23:42:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status queued for try_number 1 2024-05-24T23:42:01.214114318Z [2024-05-24T23:42:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:41:00+00:00 exited with status queued for try_number 1 2024-05-24T23:42:01.214262898Z [2024-05-24T23:42:01.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:41:00+00:00 exited with status queued for try_number 1 2024-05-24T23:42:01.214394585Z [2024-05-24T23:42:01.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:41:00+00:00 exited with status queued for try_number 1 2024-05-24T23:42:01.239379831Z [2024-05-24T23:42:01.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5254bad0-06b1-495a-9e66-53e3ceea71ac 2024-05-24T23:42:01.239523853Z [2024-05-24T23:42:01.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to f282cff0-1f59-4320-889f-b2fe12998358 2024-05-24T23:42:01.241655784Z [2024-05-24T23:42:01.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b958568-6a96-4ffb-814c-e4bd7fd333ac 2024-05-24T23:42:01.241951123Z [2024-05-24T23:42:01.241+0000] {scheduler_job.py:635} INFO - Setting external_id for to a63749fa-44a7-40ca-a3c9-271200d2a43c 2024-05-24T23:42:03.566557397Z [2024-05-24T23:42:03.566+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:42:03.566894740Z [2024-05-24T23:42:03.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:41:00+00:00, run_id=scheduled__2024-05-24T23:41:00+00:00, run_start_date=2024-05-24 23:42:00.785087+00:00, run_end_date=2024-05-24 23:42:03.566412+00:00, run_duration=2.781325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:41:00+00:00, data_interval_end=2024-05-24 23:42:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:42:03.575918577Z [2024-05-24T23:42:03.575+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:42:00+00:00, run_after=2024-05-24T23:43:00+00:00 2024-05-24T23:42:03.583012150Z [2024-05-24T23:42:03.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:42:03.583298354Z [2024-05-24T23:42:03.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:40:00+00:00, run_id=scheduled__2024-05-24T23:40:00+00:00, run_start_date=2024-05-24 23:42:00.783881+00:00, run_end_date=2024-05-24 23:42:03.582971+00:00, run_duration=2.79909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:40:00+00:00, data_interval_end=2024-05-24 23:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:42:03.591232592Z [2024-05-24T23:42:03.590+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:42:00+00:00, run_after=2024-05-24T23:44:00+00:00 2024-05-24T23:42:03.638612356Z [2024-05-24T23:42:03.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status success for try_number 1 2024-05-24T23:42:03.640576821Z [2024-05-24T23:42:03.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:41:00+00:00 exited with status success for try_number 1 2024-05-24T23:42:03.650057375Z [2024-05-24T23:42:03.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:40:00+00:00, map_index=-1, run_start_date=2024-05-24 23:42:01.756209+00:00, run_end_date=2024-05-24 23:42:02.472910+00:00, run_duration=0.716701, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:42:00.877352+00:00, queued_by_job_id=1, pid=3099 2024-05-24T23:42:03.650593945Z [2024-05-24T23:42:03.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:41:00+00:00, map_index=-1, run_start_date=2024-05-24 23:42:02.139888+00:00, run_end_date=2024-05-24 23:42:02.789808+00:00, run_duration=0.64992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:42:00.877352+00:00, queued_by_job_id=1, pid=3104 2024-05-24T23:42:06.009002837Z [2024-05-24T23:42:06.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:42:06.010079221Z [2024-05-24T23:42:06.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:41:00+00:00, run_id=scheduled__2024-05-24T23:41:00+00:00, run_start_date=2024-05-24 23:42:00.786148+00:00, run_end_date=2024-05-24 23:42:06.009334+00:00, run_duration=5.223186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:41:00+00:00, data_interval_end=2024-05-24 23:42:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:42:06.027905298Z [2024-05-24T23:42:06.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:42:00+00:00, run_after=2024-05-24T23:43:00+00:00 2024-05-24T23:42:06.039415201Z [2024-05-24T23:42:06.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:42:06.039458114Z [2024-05-24T23:42:06.037+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:41:00+00:00, run_id=scheduled__2024-05-24T23:41:00+00:00, run_start_date=2024-05-24 23:42:00.787240+00:00, run_end_date=2024-05-24 23:42:06.037301+00:00, run_duration=5.250061, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:41:00+00:00, data_interval_end=2024-05-24 23:42:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:42:06.048005477Z [2024-05-24T23:42:06.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:42:00+00:00, run_after=2024-05-24T23:43:00+00:00 2024-05-24T23:42:06.098719549Z [2024-05-24T23:42:06.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:41:00+00:00 exited with status success for try_number 1 2024-05-24T23:42:06.098739485Z [2024-05-24T23:42:06.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:41:00+00:00 exited with status success for try_number 1 2024-05-24T23:42:06.106273583Z [2024-05-24T23:42:06.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:41:00+00:00, map_index=-1, run_start_date=2024-05-24 23:42:03.771625+00:00, run_end_date=2024-05-24 23:42:05.053255+00:00, run_duration=1.28163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:42:00.877352+00:00, queued_by_job_id=1, pid=3133 2024-05-24T23:42:06.106582974Z [2024-05-24T23:42:06.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:41:00+00:00, map_index=-1, run_start_date=2024-05-24 23:42:03.332147+00:00, run_end_date=2024-05-24 23:42:04.997751+00:00, run_duration=1.665604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:42:00.877352+00:00, queued_by_job_id=1, pid=3122 2024-05-24T23:43:00.108126092Z [2024-05-24T23:43:00.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:43:00+00:00, run_after=2024-05-24T23:44:00+00:00 2024-05-24T23:43:00.124269891Z [2024-05-24T23:43:00.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:43:00+00:00, run_after=2024-05-24T23:44:00+00:00 2024-05-24T23:43:00.134067724Z [2024-05-24T23:43:00.133+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:43:00.224690779Z [2024-05-24T23:43:00.224+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:43:00.224762553Z 2024-05-24T23:43:00.224769242Z 2024-05-24T23:43:00.224774419Z 2024-05-24T23:43:00.225177575Z [2024-05-24T23:43:00.224+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:43:00.225637710Z [2024-05-24T23:43:00.225+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:43:00.225916595Z [2024-05-24T23:43:00.225+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:43:00.226880019Z [2024-05-24T23:43:00.226+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:43:00.226895642Z 2024-05-24T23:43:00.226900730Z 2024-05-24T23:43:00.226905478Z 2024-05-24T23:43:00.231436236Z [2024-05-24T23:43:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:43:00.231754508Z [2024-05-24T23:43:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:43:00.232185188Z [2024-05-24T23:43:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:43:00.232433235Z [2024-05-24T23:43:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:43:00.232826989Z [2024-05-24T23:43:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:43:00.233754621Z [2024-05-24T23:43:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:43:00.510589719Z [2024-05-24T23:43:00.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:42:00+00:00 exited with status queued for try_number 1 2024-05-24T23:43:00.512891631Z [2024-05-24T23:43:00.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:42:00+00:00 exited with status queued for try_number 1 2024-05-24T23:43:00.513191058Z [2024-05-24T23:43:00.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:42:00+00:00 exited with status queued for try_number 1 2024-05-24T23:43:00.530456578Z [2024-05-24T23:43:00.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to b32bd2be-958e-4729-b5e0-59fa167ada30 2024-05-24T23:43:00.530604233Z [2024-05-24T23:43:00.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4852b545-42de-4c6b-81f2-26646c4251b9 2024-05-24T23:43:00.530743029Z [2024-05-24T23:43:00.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1df7b77f-2e51-4a26-a5a7-8bfa4641f8c3 2024-05-24T23:43:02.774687779Z [2024-05-24T23:43:02.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:43:02.775742918Z [2024-05-24T23:43:02.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:42:00+00:00, run_id=scheduled__2024-05-24T23:42:00+00:00, run_start_date=2024-05-24 23:43:00.158577+00:00, run_end_date=2024-05-24 23:43:02.774389+00:00, run_duration=2.615812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:42:00+00:00, data_interval_end=2024-05-24 23:43:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:43:02.788941569Z [2024-05-24T23:43:02.788+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:43:00+00:00, run_after=2024-05-24T23:44:00+00:00 2024-05-24T23:43:02.838502562Z [2024-05-24T23:43:02.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:42:00+00:00 exited with status success for try_number 1 2024-05-24T23:43:02.846133157Z [2024-05-24T23:43:02.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:42:00+00:00, map_index=-1, run_start_date=2024-05-24 23:43:01.075283+00:00, run_end_date=2024-05-24 23:43:01.585705+00:00, run_duration=0.510422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:43:00.228031+00:00, queued_by_job_id=1, pid=3160 2024-05-24T23:43:04.803745739Z [2024-05-24T23:43:04.803+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:43:04.803969013Z [2024-05-24T23:43:04.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:42:00+00:00, run_id=scheduled__2024-05-24T23:42:00+00:00, run_start_date=2024-05-24 23:43:00.160082+00:00, run_end_date=2024-05-24 23:43:04.803571+00:00, run_duration=4.643489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:42:00+00:00, data_interval_end=2024-05-24 23:43:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:43:04.816414398Z [2024-05-24T23:43:04.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:43:00+00:00, run_after=2024-05-24T23:44:00+00:00 2024-05-24T23:43:04.820488153Z [2024-05-24T23:43:04.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:43:04.820901253Z [2024-05-24T23:43:04.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:42:00+00:00, run_id=scheduled__2024-05-24T23:42:00+00:00, run_start_date=2024-05-24 23:43:00.161186+00:00, run_end_date=2024-05-24 23:43:04.820367+00:00, run_duration=4.659181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:42:00+00:00, data_interval_end=2024-05-24 23:43:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:43:04.830433238Z [2024-05-24T23:43:04.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:43:00+00:00, run_after=2024-05-24T23:44:00+00:00 2024-05-24T23:43:04.876948770Z [2024-05-24T23:43:04.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:42:00+00:00 exited with status success for try_number 1 2024-05-24T23:43:04.890734884Z [2024-05-24T23:43:04.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:42:00+00:00 exited with status success for try_number 1 2024-05-24T23:43:04.903791785Z [2024-05-24T23:43:04.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:42:00+00:00, map_index=-1, run_start_date=2024-05-24 23:43:02.375424+00:00, run_end_date=2024-05-24 23:43:04.132811+00:00, run_duration=1.757387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:43:00.228031+00:00, queued_by_job_id=1, pid=3179 2024-05-24T23:43:04.904265541Z [2024-05-24T23:43:04.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:42:00+00:00, map_index=-1, run_start_date=2024-05-24 23:43:02.192169+00:00, run_end_date=2024-05-24 23:43:04.465710+00:00, run_duration=2.273541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:43:00.228031+00:00, queued_by_job_id=1, pid=3178 2024-05-24T23:44:00.050892113Z [2024-05-24T23:44:00.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:44:00+00:00, run_after=2024-05-24T23:45:00+00:00 2024-05-24T23:44:00.060381680Z [2024-05-24T23:44:00.059+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:44:00.084185977Z [2024-05-24T23:44:00.083+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:44:00+00:00, run_after=2024-05-24T23:45:00+00:00 2024-05-24T23:44:00.094722367Z [2024-05-24T23:44:00.094+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:44:00.212063346Z [2024-05-24T23:44:00.211+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:44:00.212102536Z 2024-05-24T23:44:00.212111716Z 2024-05-24T23:44:00.212119143Z 2024-05-24T23:44:00.212126527Z 2024-05-24T23:44:00.212510915Z [2024-05-24T23:44:00.211+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:44:00.212902224Z [2024-05-24T23:44:00.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:44:00.213161163Z [2024-05-24T23:44:00.212+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:44:00.213653374Z [2024-05-24T23:44:00.213+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:44:00.215003496Z [2024-05-24T23:44:00.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:44:00.215032264Z 2024-05-24T23:44:00.215044843Z 2024-05-24T23:44:00.215055248Z 2024-05-24T23:44:00.215063248Z 2024-05-24T23:44:00.222688238Z [2024-05-24T23:44:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:44:00.223173918Z [2024-05-24T23:44:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:44:00.223806798Z [2024-05-24T23:44:00.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:44:00.224091254Z [2024-05-24T23:44:00.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:44:00.224516005Z [2024-05-24T23:44:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:44:00.224670951Z [2024-05-24T23:44:00.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:44:00.225055291Z [2024-05-24T23:44:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:44:00.225173676Z [2024-05-24T23:44:00.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:44:00.687081335Z [2024-05-24T23:44:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:42:00+00:00 exited with status queued for try_number 1 2024-05-24T23:44:00.687314846Z [2024-05-24T23:44:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:43:00+00:00 exited with status queued for try_number 1 2024-05-24T23:44:00.687459349Z [2024-05-24T23:44:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:43:00+00:00 exited with status queued for try_number 1 2024-05-24T23:44:00.687600414Z [2024-05-24T23:44:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:43:00+00:00 exited with status queued for try_number 1 2024-05-24T23:44:00.698730028Z [2024-05-24T23:44:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48e31ddf-e77c-4725-a2ab-663c74a57374 2024-05-24T23:44:00.701600532Z [2024-05-24T23:44:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe2b3c26-5259-4bde-9fd5-7bf0c077fc1f 2024-05-24T23:44:00.701812429Z [2024-05-24T23:44:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a2f70d3-1684-49ea-8a5a-bb2f0202db44 2024-05-24T23:44:00.702008644Z [2024-05-24T23:44:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to e18b70d4-7227-401d-90a1-909d80f036f2 2024-05-24T23:44:01.960778164Z [2024-05-24T23:44:01.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:44:01.961609710Z [2024-05-24T23:44:01.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:42:00+00:00, run_id=scheduled__2024-05-24T23:42:00+00:00, run_start_date=2024-05-24 23:44:00.109375+00:00, run_end_date=2024-05-24 23:44:01.960687+00:00, run_duration=1.851312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:42:00+00:00, data_interval_end=2024-05-24 23:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:44:01.970095411Z [2024-05-24T23:44:01.969+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:44:00+00:00, run_after=2024-05-24T23:46:00+00:00 2024-05-24T23:44:01.976783895Z [2024-05-24T23:44:01.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:44:01.977127462Z [2024-05-24T23:44:01.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:43:00+00:00, run_id=scheduled__2024-05-24T23:43:00+00:00, run_start_date=2024-05-24 23:44:00.111065+00:00, run_end_date=2024-05-24 23:44:01.976790+00:00, run_duration=1.865725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:43:00+00:00, data_interval_end=2024-05-24 23:44:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:44:01.988688082Z [2024-05-24T23:44:01.988+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:44:00+00:00, run_after=2024-05-24T23:45:00+00:00 2024-05-24T23:44:02.045806164Z [2024-05-24T23:44:02.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:42:00+00:00 exited with status success for try_number 1 2024-05-24T23:44:02.046411159Z [2024-05-24T23:44:02.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:43:00+00:00 exited with status success for try_number 1 2024-05-24T23:44:02.053610090Z [2024-05-24T23:44:02.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:42:00+00:00, map_index=-1, run_start_date=2024-05-24 23:44:01.065815+00:00, run_end_date=2024-05-24 23:44:01.549627+00:00, run_duration=0.483812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:44:00.217054+00:00, queued_by_job_id=1, pid=3212 2024-05-24T23:44:02.053898639Z [2024-05-24T23:44:02.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:43:00+00:00, map_index=-1, run_start_date=2024-05-24 23:44:01.177053+00:00, run_end_date=2024-05-24 23:44:01.643614+00:00, run_duration=0.466561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:44:00.217054+00:00, queued_by_job_id=1, pid=3213 2024-05-24T23:44:04.196779178Z [2024-05-24T23:44:04.196+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:44:04.197460646Z [2024-05-24T23:44:04.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:43:00+00:00, run_id=scheduled__2024-05-24T23:43:00+00:00, run_start_date=2024-05-24 23:44:00.112421+00:00, run_end_date=2024-05-24 23:44:04.196838+00:00, run_duration=4.084417, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:43:00+00:00, data_interval_end=2024-05-24 23:44:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:44:04.209694935Z [2024-05-24T23:44:04.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:44:00+00:00, run_after=2024-05-24T23:45:00+00:00 2024-05-24T23:44:04.217783570Z [2024-05-24T23:44:04.217+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:44:04.218156817Z [2024-05-24T23:44:04.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:43:00+00:00, run_id=scheduled__2024-05-24T23:43:00+00:00, run_start_date=2024-05-24 23:44:00.113892+00:00, run_end_date=2024-05-24 23:44:04.217810+00:00, run_duration=4.103918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:43:00+00:00, data_interval_end=2024-05-24 23:44:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:44:04.229434148Z [2024-05-24T23:44:04.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:44:00+00:00, run_after=2024-05-24T23:45:00+00:00 2024-05-24T23:44:04.271379872Z [2024-05-24T23:44:04.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:43:00+00:00 exited with status success for try_number 1 2024-05-24T23:44:04.271715254Z [2024-05-24T23:44:04.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:43:00+00:00 exited with status success for try_number 1 2024-05-24T23:44:04.293007727Z [2024-05-24T23:44:04.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:43:00+00:00, map_index=-1, run_start_date=2024-05-24 23:44:02.579554+00:00, run_end_date=2024-05-24 23:44:03.927943+00:00, run_duration=1.348389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:44:00.217054+00:00, queued_by_job_id=1, pid=3237 2024-05-24T23:44:04.293110441Z [2024-05-24T23:44:04.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:43:00+00:00, map_index=-1, run_start_date=2024-05-24 23:44:02.433035+00:00, run_end_date=2024-05-24 23:44:04.051679+00:00, run_duration=1.618644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:44:00.217054+00:00, queued_by_job_id=1, pid=3236 2024-05-24T23:45:00.315017868Z [2024-05-24T23:45:00.314+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:45:00.336808351Z [2024-05-24T23:45:00.336+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:45:00+00:00, run_after=2024-05-24T23:46:00+00:00 2024-05-24T23:45:00.363002888Z [2024-05-24T23:45:00.362+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:45:00+00:00, run_after=2024-05-24T23:50:00+00:00 2024-05-24T23:45:00.388575976Z [2024-05-24T23:45:00.388+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:45:00+00:00, run_after=2024-05-24T23:46:00+00:00 2024-05-24T23:45:00.502931626Z [2024-05-24T23:45:00.502+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:45:00.503012738Z 2024-05-24T23:45:00.503017688Z 2024-05-24T23:45:00.503020984Z 2024-05-24T23:45:00.503024145Z 2024-05-24T23:45:00.503303208Z [2024-05-24T23:45:00.502+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:45:00.503667875Z [2024-05-24T23:45:00.503+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:45:00.504054459Z [2024-05-24T23:45:00.503+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:45:00.504357071Z [2024-05-24T23:45:00.504+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:45:00.506066485Z [2024-05-24T23:45:00.505+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:45:00.506076451Z 2024-05-24T23:45:00.506079897Z 2024-05-24T23:45:00.506083450Z 2024-05-24T23:45:00.506086783Z 2024-05-24T23:45:00.512197358Z [2024-05-24T23:45:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:45:00.512445940Z [2024-05-24T23:45:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:45:00.512836796Z [2024-05-24T23:45:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:45:00.513072109Z [2024-05-24T23:45:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:45:00.513513946Z [2024-05-24T23:45:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:45:00.513738048Z [2024-05-24T23:45:00.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:45:00.514089366Z [2024-05-24T23:45:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:45:00.514406102Z [2024-05-24T23:45:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:45:00.873596195Z [2024-05-24T23:45:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status queued for try_number 1 2024-05-24T23:45:00.874261641Z [2024-05-24T23:45:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:44:00+00:00 exited with status queued for try_number 1 2024-05-24T23:45:00.874436386Z [2024-05-24T23:45:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:44:00+00:00 exited with status queued for try_number 1 2024-05-24T23:45:00.874755352Z [2024-05-24T23:45:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:44:00+00:00 exited with status queued for try_number 1 2024-05-24T23:45:00.884123459Z [2024-05-24T23:45:00.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0db8b4d-8c49-4cd1-8208-a1a8b5ba0665 2024-05-24T23:45:00.884453503Z [2024-05-24T23:45:00.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0400b42a-06b2-4656-934f-3839411c1576 2024-05-24T23:45:00.884764449Z [2024-05-24T23:45:00.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ff1989f-437f-4199-82bf-5fc447ca2d1d 2024-05-24T23:45:00.885045290Z [2024-05-24T23:45:00.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 819d5642-b826-4526-b8fd-d4621481db82 2024-05-24T23:45:03.068960280Z [2024-05-24T23:45:03.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:45:03.071444679Z [2024-05-24T23:45:03.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:44:00+00:00, run_id=scheduled__2024-05-24T23:44:00+00:00, run_start_date=2024-05-24 23:45:00.408887+00:00, run_end_date=2024-05-24 23:45:03.070936+00:00, run_duration=2.662049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:44:00+00:00, data_interval_end=2024-05-24 23:45:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:45:03.090331248Z [2024-05-24T23:45:03.090+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:45:00+00:00, run_after=2024-05-24T23:46:00+00:00 2024-05-24T23:45:03.200208185Z [2024-05-24T23:45:03.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:44:00+00:00 exited with status success for try_number 1 2024-05-24T23:45:03.209172003Z [2024-05-24T23:45:03.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:44:00+00:00, map_index=-1, run_start_date=2024-05-24 23:45:01.509327+00:00, run_end_date=2024-05-24 23:45:02.006799+00:00, run_duration=0.497472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:45:00.507946+00:00, queued_by_job_id=1, pid=3270 2024-05-24T23:45:04.314198626Z [2024-05-24T23:45:04.313+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:45:04.314225360Z 2024-05-24T23:45:04.314327112Z [2024-05-24T23:45:04.314+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:45:04.314865853Z [2024-05-24T23:45:04.314+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:45:04.314876878Z 2024-05-24T23:45:04.317700067Z [2024-05-24T23:45:04.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:45:04.317789592Z [2024-05-24T23:45:04.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:45:04.384645691Z [2024-05-24T23:45:04.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status queued for try_number 1 2024-05-24T23:45:04.384805987Z [2024-05-24T23:45:04.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status success for try_number 1 2024-05-24T23:45:04.397894639Z [2024-05-24T23:45:04.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to c69e183b-631d-4793-ac6b-ba1f0bb0aa3a 2024-05-24T23:45:04.400766547Z [2024-05-24T23:45:04.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:40:00+00:00, map_index=-1, run_start_date=2024-05-24 23:45:02.860656+00:00, run_end_date=2024-05-24 23:45:03.268835+00:00, run_duration=0.408179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:45:00.507946+00:00, queued_by_job_id=1, pid=3294 2024-05-24T23:45:04.459693021Z [2024-05-24T23:45:04.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:45:04.459860002Z [2024-05-24T23:45:04.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:44:00+00:00, run_id=scheduled__2024-05-24T23:44:00+00:00, run_start_date=2024-05-24 23:45:00.410544+00:00, run_end_date=2024-05-24 23:45:04.459528+00:00, run_duration=4.048984, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:44:00+00:00, data_interval_end=2024-05-24 23:45:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:45:04.468060450Z [2024-05-24T23:45:04.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:45:00+00:00, run_after=2024-05-24T23:46:00+00:00 2024-05-24T23:45:04.518963391Z [2024-05-24T23:45:04.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:44:00+00:00 exited with status success for try_number 1 2024-05-24T23:45:04.524840131Z [2024-05-24T23:45:04.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:44:00+00:00, map_index=-1, run_start_date=2024-05-24 23:45:02.908328+00:00, run_end_date=2024-05-24 23:45:04.326972+00:00, run_duration=1.418644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:45:00.507946+00:00, queued_by_job_id=1, pid=3295 2024-05-24T23:45:05.587076920Z [2024-05-24T23:45:05.586+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:45:05.587826658Z [2024-05-24T23:45:05.587+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:44:00+00:00, run_id=scheduled__2024-05-24T23:44:00+00:00, run_start_date=2024-05-24 23:45:00.412093+00:00, run_end_date=2024-05-24 23:45:05.587387+00:00, run_duration=5.175294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:44:00+00:00, data_interval_end=2024-05-24 23:45:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:45:05.600109143Z [2024-05-24T23:45:05.599+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:45:00+00:00, run_after=2024-05-24T23:46:00+00:00 2024-05-24T23:45:06.772304880Z [2024-05-24T23:45:06.771+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:45:06.772355734Z 2024-05-24T23:45:06.772692828Z [2024-05-24T23:45:06.772+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:45:06.773392531Z [2024-05-24T23:45:06.773+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:45:06.773404821Z 2024-05-24T23:45:06.775748347Z [2024-05-24T23:45:06.775+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:45:06.776052166Z [2024-05-24T23:45:06.775+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:45:06.844514555Z [2024-05-24T23:45:06.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status queued for try_number 1 2024-05-24T23:45:06.844896493Z [2024-05-24T23:45:06.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:44:00+00:00 exited with status success for try_number 1 2024-05-24T23:45:06.845169316Z [2024-05-24T23:45:06.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status success for try_number 1 2024-05-24T23:45:06.858039155Z [2024-05-24T23:45:06.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:44:00+00:00, map_index=-1, run_start_date=2024-05-24 23:45:03.084220+00:00, run_end_date=2024-05-24 23:45:05.562727+00:00, run_duration=2.478507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:45:00.507946+00:00, queued_by_job_id=1, pid=3296 2024-05-24T23:45:06.858549921Z [2024-05-24T23:45:06.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:40:00+00:00, map_index=-1, run_start_date=2024-05-24 23:45:06.018410+00:00, run_end_date=2024-05-24 23:45:06.488957+00:00, run_duration=0.470547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:45:04.315342+00:00, queued_by_job_id=1, pid=3325 2024-05-24T23:45:06.858951279Z [2024-05-24T23:45:06.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to e456789a-bc34-4726-afd3-6c11b6c7d70f 2024-05-24T23:45:12.239677037Z [2024-05-24T23:45:12.239+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:45:12.239712614Z 2024-05-24T23:45:12.239718918Z [2024-05-24T23:45:12.239+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:45:12.242366423Z [2024-05-24T23:45:12.240+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:45:12.242390824Z 2024-05-24T23:45:12.245749062Z [2024-05-24T23:45:12.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:45:12.245768846Z [2024-05-24T23:45:12.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:45:12.297884852Z [2024-05-24T23:45:12.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status queued for try_number 1 2024-05-24T23:45:12.298062929Z [2024-05-24T23:45:12.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status success for try_number 1 2024-05-24T23:45:12.304937827Z [2024-05-24T23:45:12.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 086a62b0-c4e1-44ae-838c-3b5f2b910f94 2024-05-24T23:45:12.305502589Z [2024-05-24T23:45:12.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:40:00+00:00, map_index=0, run_start_date=2024-05-24 23:45:08.743488+00:00, run_end_date=2024-05-24 23:45:11.709491+00:00, run_duration=2.966003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:45:06.773984+00:00, queued_by_job_id=1, pid=3340 2024-05-24T23:45:15.725776308Z [2024-05-24T23:45:15.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:45:15.726129492Z [2024-05-24T23:45:15.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:40:00+00:00, run_id=scheduled__2024-05-24T23:40:00+00:00, run_start_date=2024-05-24 23:45:00.407158+00:00, run_end_date=2024-05-24 23:45:15.725622+00:00, run_duration=15.318464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:40:00+00:00, data_interval_end=2024-05-24 23:45:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-24T23:45:15.736071325Z [2024-05-24T23:45:15.735+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:45:00+00:00, run_after=2024-05-24T23:50:00+00:00 2024-05-24T23:45:15.779157746Z [2024-05-24T23:45:15.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:40:00+00:00 exited with status success for try_number 1 2024-05-24T23:45:15.791017194Z [2024-05-24T23:45:15.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:40:00+00:00, map_index=-1, run_start_date=2024-05-24 23:45:14.319398+00:00, run_end_date=2024-05-24 23:45:14.715844+00:00, run_duration=0.396446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:45:12.241518+00:00, queued_by_job_id=1, pid=3353 2024-05-24T23:45:27.831645535Z [2024-05-24T23:45:27.830+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T23:46:00.094052605Z [2024-05-24T23:46:00.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:46:00+00:00, run_after=2024-05-24T23:47:00+00:00 2024-05-24T23:46:00.102000722Z [2024-05-24T23:46:00.101+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:46:00.108302041Z [2024-05-24T23:46:00.108+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:46:00.121764420Z [2024-05-24T23:46:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:46:00+00:00, run_after=2024-05-24T23:47:00+00:00 2024-05-24T23:46:00.191226064Z [2024-05-24T23:46:00.190+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:46:00.191281113Z 2024-05-24T23:46:00.191289674Z 2024-05-24T23:46:00.191294879Z 2024-05-24T23:46:00.191300706Z 2024-05-24T23:46:00.191399345Z [2024-05-24T23:46:00.191+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:46:00.191479366Z [2024-05-24T23:46:00.191+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:46:00.191500253Z [2024-05-24T23:46:00.191+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:46:00.191568734Z [2024-05-24T23:46:00.191+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:46:00.192143606Z [2024-05-24T23:46:00.191+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:46:00.192154676Z 2024-05-24T23:46:00.192158413Z 2024-05-24T23:46:00.192161915Z 2024-05-24T23:46:00.192165256Z 2024-05-24T23:46:00.195783239Z [2024-05-24T23:46:00.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:46:00.195943047Z [2024-05-24T23:46:00.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:46:00.196131876Z [2024-05-24T23:46:00.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:46:00.196183248Z [2024-05-24T23:46:00.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:46:00.196358216Z [2024-05-24T23:46:00.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:46:00.196437277Z [2024-05-24T23:46:00.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:46:00.196583148Z [2024-05-24T23:46:00.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:46:00.196653108Z [2024-05-24T23:46:00.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:46:00.516922443Z [2024-05-24T23:46:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:44:00+00:00 exited with status queued for try_number 1 2024-05-24T23:46:00.516956201Z [2024-05-24T23:46:00.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status queued for try_number 1 2024-05-24T23:46:00.516981401Z [2024-05-24T23:46:00.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status queued for try_number 1 2024-05-24T23:46:00.517061054Z [2024-05-24T23:46:00.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status queued for try_number 1 2024-05-24T23:46:00.540411761Z [2024-05-24T23:46:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 543565e9-4e7f-4771-84b8-71589468a408 2024-05-24T23:46:00.540542000Z [2024-05-24T23:46:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6dc9bda-5c5c-4447-aafb-b54edd8667de 2024-05-24T23:46:00.540642221Z [2024-05-24T23:46:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05b5042c-fb20-4289-a0b4-925cb9288d85 2024-05-24T23:46:00.540741836Z [2024-05-24T23:46:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f28afac-7b99-4a53-8307-f89e798599c2 2024-05-24T23:46:02.917806927Z [2024-05-24T23:46:02.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:46:02.918247631Z [2024-05-24T23:46:02.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:44:00+00:00, run_id=scheduled__2024-05-24T23:44:00+00:00, run_start_date=2024-05-24 23:46:00.132692+00:00, run_end_date=2024-05-24 23:46:02.917566+00:00, run_duration=2.784874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:44:00+00:00, data_interval_end=2024-05-24 23:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:46:02.925397851Z [2024-05-24T23:46:02.924+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:46:00+00:00, run_after=2024-05-24T23:48:00+00:00 2024-05-24T23:46:02.931458011Z [2024-05-24T23:46:02.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:46:02.931542688Z [2024-05-24T23:46:02.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:45:00+00:00, run_id=scheduled__2024-05-24T23:45:00+00:00, run_start_date=2024-05-24 23:46:00.133967+00:00, run_end_date=2024-05-24 23:46:02.931104+00:00, run_duration=2.797137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:45:00+00:00, data_interval_end=2024-05-24 23:46:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:46:02.953389650Z [2024-05-24T23:46:02.952+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:46:00+00:00, run_after=2024-05-24T23:47:00+00:00 2024-05-24T23:46:03.004919179Z [2024-05-24T23:46:03.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:44:00+00:00 exited with status success for try_number 1 2024-05-24T23:46:03.004984579Z [2024-05-24T23:46:03.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status success for try_number 1 2024-05-24T23:46:03.011037835Z [2024-05-24T23:46:03.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:44:00+00:00, map_index=-1, run_start_date=2024-05-24 23:46:01.360736+00:00, run_end_date=2024-05-24 23:46:01.854594+00:00, run_duration=0.493858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:46:00.192893+00:00, queued_by_job_id=1, pid=3363 2024-05-24T23:46:03.011232318Z [2024-05-24T23:46:03.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:45:00+00:00, map_index=-1, run_start_date=2024-05-24 23:46:01.558394+00:00, run_end_date=2024-05-24 23:46:01.947809+00:00, run_duration=0.389415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:46:00.192893+00:00, queued_by_job_id=1, pid=3365 2024-05-24T23:46:04.081314920Z [2024-05-24T23:46:04.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:46:04.082714281Z [2024-05-24T23:46:04.082+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:45:00+00:00, run_id=scheduled__2024-05-24T23:45:00+00:00, run_start_date=2024-05-24 23:46:00.135966+00:00, run_end_date=2024-05-24 23:46:04.082318+00:00, run_duration=3.946352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:45:00+00:00, data_interval_end=2024-05-24 23:46:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:46:04.099873246Z [2024-05-24T23:46:04.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:46:00+00:00, run_after=2024-05-24T23:47:00+00:00 2024-05-24T23:46:04.158669766Z [2024-05-24T23:46:04.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status success for try_number 1 2024-05-24T23:46:04.165025079Z [2024-05-24T23:46:04.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:45:00+00:00, map_index=-1, run_start_date=2024-05-24 23:46:02.337968+00:00, run_end_date=2024-05-24 23:46:03.869909+00:00, run_duration=1.531941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:46:00.192893+00:00, queued_by_job_id=1, pid=3382 2024-05-24T23:46:05.215308301Z [2024-05-24T23:46:05.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:46:05.215738402Z [2024-05-24T23:46:05.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:45:00+00:00, run_id=scheduled__2024-05-24T23:45:00+00:00, run_start_date=2024-05-24 23:46:00.134992+00:00, run_end_date=2024-05-24 23:46:05.215201+00:00, run_duration=5.080209, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:45:00+00:00, data_interval_end=2024-05-24 23:46:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:46:05.229373974Z [2024-05-24T23:46:05.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:46:00+00:00, run_after=2024-05-24T23:47:00+00:00 2024-05-24T23:46:05.275521126Z [2024-05-24T23:46:05.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status success for try_number 1 2024-05-24T23:46:05.284418215Z [2024-05-24T23:46:05.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:45:00+00:00, map_index=-1, run_start_date=2024-05-24 23:46:02.796909+00:00, run_end_date=2024-05-24 23:46:04.151482+00:00, run_duration=1.354573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:46:00.192893+00:00, queued_by_job_id=1, pid=3393 2024-05-24T23:47:01.017378922Z [2024-05-24T23:47:01.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:47:00+00:00, run_after=2024-05-24T23:48:00+00:00 2024-05-24T23:47:01.031430888Z [2024-05-24T23:47:01.031+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:47:00+00:00, run_after=2024-05-24T23:48:00+00:00 2024-05-24T23:47:01.038050989Z [2024-05-24T23:47:01.037+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:47:01.119984990Z [2024-05-24T23:47:01.119+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:47:01.120045790Z 2024-05-24T23:47:01.120051629Z 2024-05-24T23:47:01.120056082Z 2024-05-24T23:47:01.120068547Z [2024-05-24T23:47:01.119+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:47:01.120174287Z [2024-05-24T23:47:01.120+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:47:01.120284463Z [2024-05-24T23:47:01.120+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:47:01.121266644Z [2024-05-24T23:47:01.120+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:47:01.121276595Z 2024-05-24T23:47:01.121281143Z 2024-05-24T23:47:01.121285605Z 2024-05-24T23:47:01.125115953Z [2024-05-24T23:47:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:47:01.125184144Z [2024-05-24T23:47:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:47:01.125527445Z [2024-05-24T23:47:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:47:01.125637932Z [2024-05-24T23:47:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:47:01.126011609Z [2024-05-24T23:47:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:47:01.126117126Z [2024-05-24T23:47:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:47:01.492289829Z [2024-05-24T23:47:01.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:46:00+00:00 exited with status queued for try_number 1 2024-05-24T23:47:01.492553969Z [2024-05-24T23:47:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:46:00+00:00 exited with status queued for try_number 1 2024-05-24T23:47:01.492724129Z [2024-05-24T23:47:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:46:00+00:00 exited with status queued for try_number 1 2024-05-24T23:47:01.506485480Z [2024-05-24T23:47:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55b67208-2841-4721-aa44-c00b3d19e94c 2024-05-24T23:47:01.509648195Z [2024-05-24T23:47:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e73da4c-b303-4dfe-bde2-d1244d523948 2024-05-24T23:47:01.509910000Z [2024-05-24T23:47:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a3840a3-6c15-49b2-92f4-0428f8dd1001 2024-05-24T23:47:03.693420831Z [2024-05-24T23:47:03.692+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:47:03.693782188Z [2024-05-24T23:47:03.693+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:46:00+00:00, run_id=scheduled__2024-05-24T23:46:00+00:00, run_start_date=2024-05-24 23:47:01.047214+00:00, run_end_date=2024-05-24 23:47:03.693303+00:00, run_duration=2.646089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:46:00+00:00, data_interval_end=2024-05-24 23:47:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:47:03.703293605Z [2024-05-24T23:47:03.703+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:47:00+00:00, run_after=2024-05-24T23:48:00+00:00 2024-05-24T23:47:03.760776192Z [2024-05-24T23:47:03.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:46:00+00:00 exited with status success for try_number 1 2024-05-24T23:47:03.771217870Z [2024-05-24T23:47:03.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:46:00+00:00, map_index=-1, run_start_date=2024-05-24 23:47:01.940933+00:00, run_end_date=2024-05-24 23:47:02.538453+00:00, run_duration=0.59752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:47:01.122125+00:00, queued_by_job_id=1, pid=3420 2024-05-24T23:47:05.081471439Z [2024-05-24T23:47:05.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:47:05.082161113Z [2024-05-24T23:47:05.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:46:00+00:00, run_id=scheduled__2024-05-24T23:46:00+00:00, run_start_date=2024-05-24 23:47:01.048522+00:00, run_end_date=2024-05-24 23:47:05.081612+00:00, run_duration=4.03309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:46:00+00:00, data_interval_end=2024-05-24 23:47:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:47:05.108008589Z [2024-05-24T23:47:05.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:47:00+00:00, run_after=2024-05-24T23:48:00+00:00 2024-05-24T23:47:05.162275137Z [2024-05-24T23:47:05.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:46:00+00:00 exited with status success for try_number 1 2024-05-24T23:47:05.170129005Z [2024-05-24T23:47:05.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:46:00+00:00, map_index=-1, run_start_date=2024-05-24 23:47:03.213906+00:00, run_end_date=2024-05-24 23:47:04.472376+00:00, run_duration=1.25847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:47:01.122125+00:00, queued_by_job_id=1, pid=3438 2024-05-24T23:47:06.237487588Z [2024-05-24T23:47:06.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:47:06.238205645Z [2024-05-24T23:47:06.237+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:46:00+00:00, run_id=scheduled__2024-05-24T23:46:00+00:00, run_start_date=2024-05-24 23:47:01.049881+00:00, run_end_date=2024-05-24 23:47:06.237528+00:00, run_duration=5.187647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:46:00+00:00, data_interval_end=2024-05-24 23:47:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:47:06.260008779Z [2024-05-24T23:47:06.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:47:00+00:00, run_after=2024-05-24T23:48:00+00:00 2024-05-24T23:47:06.294761015Z [2024-05-24T23:47:06.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:46:00+00:00 exited with status success for try_number 1 2024-05-24T23:47:06.302317901Z [2024-05-24T23:47:06.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:46:00+00:00, map_index=-1, run_start_date=2024-05-24 23:47:03.353526+00:00, run_end_date=2024-05-24 23:47:05.087456+00:00, run_duration=1.73393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:47:01.122125+00:00, queued_by_job_id=1, pid=3439 2024-05-24T23:48:00.936245710Z [2024-05-24T23:48:00.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:48:00+00:00, run_after=2024-05-24T23:49:00+00:00 2024-05-24T23:48:00.943886290Z [2024-05-24T23:48:00.943+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:48:00.956350194Z [2024-05-24T23:48:00.956+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:48:00+00:00, run_after=2024-05-24T23:49:00+00:00 2024-05-24T23:48:00.963364562Z [2024-05-24T23:48:00.963+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:48:01.063285863Z [2024-05-24T23:48:01.062+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:48:01.063330570Z 2024-05-24T23:48:01.063347440Z 2024-05-24T23:48:01.063356902Z 2024-05-24T23:48:01.063365583Z 2024-05-24T23:48:01.063374955Z [2024-05-24T23:48:01.063+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:48:01.063397744Z [2024-05-24T23:48:01.063+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:48:01.063414558Z [2024-05-24T23:48:01.063+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:48:01.063518959Z [2024-05-24T23:48:01.063+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:48:01.064133240Z [2024-05-24T23:48:01.063+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:48:01.064147345Z 2024-05-24T23:48:01.064202664Z 2024-05-24T23:48:01.064211786Z 2024-05-24T23:48:01.064220019Z 2024-05-24T23:48:01.067601067Z [2024-05-24T23:48:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:48:01.067640142Z [2024-05-24T23:48:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:48:01.067735674Z [2024-05-24T23:48:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:48:01.067885276Z [2024-05-24T23:48:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:48:01.067983462Z [2024-05-24T23:48:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:48:01.068051811Z [2024-05-24T23:48:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:48:01.068254536Z [2024-05-24T23:48:01.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:48:01.068282563Z [2024-05-24T23:48:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:48:01.714348049Z [2024-05-24T23:48:01.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:46:00+00:00 exited with status queued for try_number 1 2024-05-24T23:48:01.714381279Z [2024-05-24T23:48:01.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:47:00+00:00 exited with status queued for try_number 1 2024-05-24T23:48:01.714431616Z [2024-05-24T23:48:01.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:47:00+00:00 exited with status queued for try_number 1 2024-05-24T23:48:01.714495049Z [2024-05-24T23:48:01.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:47:00+00:00 exited with status queued for try_number 1 2024-05-24T23:48:01.734930671Z [2024-05-24T23:48:01.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ce134c6-006e-4938-939b-b7b175be1e05 2024-05-24T23:48:01.735006868Z [2024-05-24T23:48:01.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4d7c310-2713-46db-bac1-37a9f5bf4778 2024-05-24T23:48:01.735103942Z [2024-05-24T23:48:01.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6353490-6afd-44f4-9b70-9583f6383a0f 2024-05-24T23:48:01.735194450Z [2024-05-24T23:48:01.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f9ebdb4-072a-465c-a1ba-dd88dc9973d1 2024-05-24T23:48:03.014166766Z [2024-05-24T23:48:03.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:48:03.014538699Z [2024-05-24T23:48:03.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:46:00+00:00, run_id=scheduled__2024-05-24T23:46:00+00:00, run_start_date=2024-05-24 23:48:00.977110+00:00, run_end_date=2024-05-24 23:48:03.014099+00:00, run_duration=2.036989, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:46:00+00:00, data_interval_end=2024-05-24 23:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:48:03.022089605Z [2024-05-24T23:48:03.021+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:48:00+00:00, run_after=2024-05-24T23:50:00+00:00 2024-05-24T23:48:03.028033607Z [2024-05-24T23:48:03.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:48:03.028335037Z [2024-05-24T23:48:03.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:47:00+00:00, run_id=scheduled__2024-05-24T23:47:00+00:00, run_start_date=2024-05-24 23:48:00.978474+00:00, run_end_date=2024-05-24 23:48:03.027964+00:00, run_duration=2.04949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:47:00+00:00, data_interval_end=2024-05-24 23:48:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:48:03.038108832Z [2024-05-24T23:48:03.037+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:48:00+00:00, run_after=2024-05-24T23:49:00+00:00 2024-05-24T23:48:03.087014468Z [2024-05-24T23:48:03.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:46:00+00:00 exited with status success for try_number 1 2024-05-24T23:48:03.087329090Z [2024-05-24T23:48:03.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:47:00+00:00 exited with status success for try_number 1 2024-05-24T23:48:03.102271490Z [2024-05-24T23:48:03.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:47:00+00:00, map_index=-1, run_start_date=2024-05-24 23:48:02.137992+00:00, run_end_date=2024-05-24 23:48:02.597556+00:00, run_duration=0.459564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:48:01.064835+00:00, queued_by_job_id=1, pid=3473 2024-05-24T23:48:03.102803708Z [2024-05-24T23:48:03.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:46:00+00:00, map_index=-1, run_start_date=2024-05-24 23:48:01.947517+00:00, run_end_date=2024-05-24 23:48:02.600798+00:00, run_duration=0.653281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:48:01.064835+00:00, queued_by_job_id=1, pid=3472 2024-05-24T23:48:06.088973901Z [2024-05-24T23:48:06.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:48:06.089323198Z [2024-05-24T23:48:06.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:47:00+00:00, run_id=scheduled__2024-05-24T23:47:00+00:00, run_start_date=2024-05-24 23:48:00.979448+00:00, run_end_date=2024-05-24 23:48:06.088929+00:00, run_duration=5.109481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:47:00+00:00, data_interval_end=2024-05-24 23:48:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:48:06.099994556Z [2024-05-24T23:48:06.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:48:00+00:00, run_after=2024-05-24T23:49:00+00:00 2024-05-24T23:48:06.109969502Z [2024-05-24T23:48:06.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:48:06.110149684Z [2024-05-24T23:48:06.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:47:00+00:00, run_id=scheduled__2024-05-24T23:47:00+00:00, run_start_date=2024-05-24 23:48:00.980451+00:00, run_end_date=2024-05-24 23:48:06.109886+00:00, run_duration=5.129435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:47:00+00:00, data_interval_end=2024-05-24 23:48:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:48:06.119289782Z [2024-05-24T23:48:06.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:48:00+00:00, run_after=2024-05-24T23:49:00+00:00 2024-05-24T23:48:06.164953407Z [2024-05-24T23:48:06.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:47:00+00:00 exited with status success for try_number 1 2024-05-24T23:48:06.165132462Z [2024-05-24T23:48:06.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:47:00+00:00 exited with status success for try_number 1 2024-05-24T23:48:06.174661783Z [2024-05-24T23:48:06.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:47:00+00:00, map_index=-1, run_start_date=2024-05-24 23:48:03.283795+00:00, run_end_date=2024-05-24 23:48:04.948397+00:00, run_duration=1.664602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:48:01.064835+00:00, queued_by_job_id=1, pid=3496 2024-05-24T23:48:06.174914891Z [2024-05-24T23:48:06.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:47:00+00:00, map_index=-1, run_start_date=2024-05-24 23:48:03.411145+00:00, run_end_date=2024-05-24 23:48:05.447713+00:00, run_duration=2.036568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:48:01.064835+00:00, queued_by_job_id=1, pid=3497 2024-05-24T23:49:00.390431550Z [2024-05-24T23:49:00.389+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:49:00+00:00, run_after=2024-05-24T23:50:00+00:00 2024-05-24T23:49:00.404506494Z [2024-05-24T23:49:00.404+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:49:00.419322758Z [2024-05-24T23:49:00.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:49:00+00:00, run_after=2024-05-24T23:50:00+00:00 2024-05-24T23:49:00.530393078Z [2024-05-24T23:49:00.529+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:49:00.530429548Z 2024-05-24T23:49:00.530434774Z 2024-05-24T23:49:00.530439550Z 2024-05-24T23:49:00.530478778Z [2024-05-24T23:49:00.530+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:49:00.531967277Z [2024-05-24T23:49:00.530+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:49:00.532031677Z [2024-05-24T23:49:00.530+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:49:00.532046136Z [2024-05-24T23:49:00.531+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:49:00.532055330Z 2024-05-24T23:49:00.532064482Z 2024-05-24T23:49:00.532073419Z 2024-05-24T23:49:00.537874021Z [2024-05-24T23:49:00.537+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:49:00.538062322Z [2024-05-24T23:49:00.537+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:49:00.538473392Z [2024-05-24T23:49:00.538+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:49:00.538660528Z [2024-05-24T23:49:00.538+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:49:00.538928765Z [2024-05-24T23:49:00.538+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:49:00.539100869Z [2024-05-24T23:49:00.538+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:49:00.770307130Z [2024-05-24T23:49:00.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:48:00+00:00 exited with status queued for try_number 1 2024-05-24T23:49:00.770452397Z [2024-05-24T23:49:00.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:48:00+00:00 exited with status queued for try_number 1 2024-05-24T23:49:00.770527585Z [2024-05-24T23:49:00.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:48:00+00:00 exited with status queued for try_number 1 2024-05-24T23:49:00.779755274Z [2024-05-24T23:49:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to de6d8f32-bebb-440b-8698-5883b237f85a 2024-05-24T23:49:00.779944294Z [2024-05-24T23:49:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0a203fc-d20c-4e13-9a07-04aee88a7c9b 2024-05-24T23:49:00.780148953Z [2024-05-24T23:49:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0e303e0-d0f5-491b-a477-c9121daea5a2 2024-05-24T23:49:01.927042696Z [2024-05-24T23:49:01.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:49:01.927639219Z [2024-05-24T23:49:01.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:48:00+00:00, run_id=scheduled__2024-05-24T23:48:00+00:00, run_start_date=2024-05-24 23:49:00.432178+00:00, run_end_date=2024-05-24 23:49:01.927103+00:00, run_duration=1.494925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:48:00+00:00, data_interval_end=2024-05-24 23:49:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:49:01.938177299Z [2024-05-24T23:49:01.937+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:49:00+00:00, run_after=2024-05-24T23:50:00+00:00 2024-05-24T23:49:01.995734047Z [2024-05-24T23:49:01.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:48:00+00:00 exited with status success for try_number 1 2024-05-24T23:49:02.007641859Z [2024-05-24T23:49:02.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:48:00+00:00, map_index=-1, run_start_date=2024-05-24 23:49:01.296485+00:00, run_end_date=2024-05-24 23:49:01.787228+00:00, run_duration=0.490743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:49:00.532972+00:00, queued_by_job_id=1, pid=3529 2024-05-24T23:49:04.636901314Z [2024-05-24T23:49:04.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:49:04.637473273Z [2024-05-24T23:49:04.637+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:48:00+00:00, run_id=scheduled__2024-05-24T23:48:00+00:00, run_start_date=2024-05-24 23:49:00.433594+00:00, run_end_date=2024-05-24 23:49:04.637038+00:00, run_duration=4.203444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:48:00+00:00, data_interval_end=2024-05-24 23:49:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:49:04.651152235Z [2024-05-24T23:49:04.650+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:49:00+00:00, run_after=2024-05-24T23:50:00+00:00 2024-05-24T23:49:04.663178233Z [2024-05-24T23:49:04.662+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:49:04.663425759Z [2024-05-24T23:49:04.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:48:00+00:00, run_id=scheduled__2024-05-24T23:48:00+00:00, run_start_date=2024-05-24 23:49:00.434788+00:00, run_end_date=2024-05-24 23:49:04.663069+00:00, run_duration=4.228281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:48:00+00:00, data_interval_end=2024-05-24 23:49:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:49:04.680940568Z [2024-05-24T23:49:04.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:49:00+00:00, run_after=2024-05-24T23:50:00+00:00 2024-05-24T23:49:04.723021146Z [2024-05-24T23:49:04.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:48:00+00:00 exited with status success for try_number 1 2024-05-24T23:49:04.723060874Z [2024-05-24T23:49:04.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:48:00+00:00 exited with status success for try_number 1 2024-05-24T23:49:04.728848250Z [2024-05-24T23:49:04.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:48:00+00:00, map_index=-1, run_start_date=2024-05-24 23:49:02.494901+00:00, run_end_date=2024-05-24 23:49:03.712789+00:00, run_duration=1.217888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:49:00.532972+00:00, queued_by_job_id=1, pid=3548 2024-05-24T23:49:04.729014925Z [2024-05-24T23:49:04.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:48:00+00:00, map_index=-1, run_start_date=2024-05-24 23:49:02.289163+00:00, run_end_date=2024-05-24 23:49:04.026382+00:00, run_duration=1.737219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:49:00.532972+00:00, queued_by_job_id=1, pid=3547 2024-05-24T23:50:00.620801137Z [2024-05-24T23:50:00.620+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:50:00.631688081Z [2024-05-24T23:50:00.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:50:00+00:00, run_after=2024-05-24T23:55:00+00:00 2024-05-24T23:50:00.642926085Z [2024-05-24T23:50:00.642+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:50:00+00:00, run_after=2024-05-24T23:51:00+00:00 2024-05-24T23:50:00.648730090Z [2024-05-24T23:50:00.648+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:50:00.658757129Z [2024-05-24T23:50:00.658+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:50:00+00:00, run_after=2024-05-24T23:51:00+00:00 2024-05-24T23:50:00.810523328Z [2024-05-24T23:50:00.809+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T23:50:00.810565903Z 2024-05-24T23:50:00.810584599Z 2024-05-24T23:50:00.810594010Z 2024-05-24T23:50:00.810602380Z 2024-05-24T23:50:00.810610741Z 2024-05-24T23:50:00.811011304Z [2024-05-24T23:50:00.810+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:50:00.811442566Z [2024-05-24T23:50:00.811+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:50:00.811777899Z [2024-05-24T23:50:00.811+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:50:00.812035610Z [2024-05-24T23:50:00.811+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:50:00.812215709Z [2024-05-24T23:50:00.812+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:50:00.813448690Z [2024-05-24T23:50:00.813+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:50:00.813462993Z 2024-05-24T23:50:00.813471080Z 2024-05-24T23:50:00.813505503Z 2024-05-24T23:50:00.813514154Z 2024-05-24T23:50:00.813520754Z 2024-05-24T23:50:00.822722054Z [2024-05-24T23:50:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:50:00.823408979Z [2024-05-24T23:50:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:50:00.824323080Z [2024-05-24T23:50:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:50:00.824845890Z [2024-05-24T23:50:00.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:50:00.825663931Z [2024-05-24T23:50:00.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:50:00.826134348Z [2024-05-24T23:50:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:50:00.827005762Z [2024-05-24T23:50:00.826+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:50:00.827477869Z [2024-05-24T23:50:00.827+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:50:00.828145901Z [2024-05-24T23:50:00.827+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:50:00.828583624Z [2024-05-24T23:50:00.828+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:50:01.520382033Z [2024-05-24T23:50:01.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status queued for try_number 1 2024-05-24T23:50:01.520423340Z [2024-05-24T23:50:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:48:00+00:00 exited with status queued for try_number 1 2024-05-24T23:50:01.520602133Z [2024-05-24T23:50:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:49:00+00:00 exited with status queued for try_number 1 2024-05-24T23:50:01.520698937Z [2024-05-24T23:50:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:49:00+00:00 exited with status queued for try_number 1 2024-05-24T23:50:01.520806023Z [2024-05-24T23:50:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:49:00+00:00 exited with status queued for try_number 1 2024-05-24T23:50:01.537422050Z [2024-05-24T23:50:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to b80da0e9-2dd5-4723-a7cd-e6ea28e084b5 2024-05-24T23:50:01.537457621Z [2024-05-24T23:50:01.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57239779-a5d3-4ae7-bf09-d27e22f2781b 2024-05-24T23:50:01.537482708Z [2024-05-24T23:50:01.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d50d636-e011-421e-a4ca-a1cefd6e4660 2024-05-24T23:50:01.537607500Z [2024-05-24T23:50:01.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2e1e36f-d6a2-463c-a912-757bce708494 2024-05-24T23:50:01.537695188Z [2024-05-24T23:50:01.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69703ff4-bd0b-425f-ad56-c454ba295ade 2024-05-24T23:50:02.989406269Z [2024-05-24T23:50:02.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:50:02.990338800Z [2024-05-24T23:50:02.990+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:48:00+00:00, run_id=scheduled__2024-05-24T23:48:00+00:00, run_start_date=2024-05-24 23:50:00.676958+00:00, run_end_date=2024-05-24 23:50:02.989252+00:00, run_duration=2.312294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:48:00+00:00, data_interval_end=2024-05-24 23:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:50:02.998217786Z [2024-05-24T23:50:02.997+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:50:00+00:00, run_after=2024-05-24T23:52:00+00:00 2024-05-24T23:50:03.009581786Z [2024-05-24T23:50:03.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:50:03.017387009Z [2024-05-24T23:50:03.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:49:00+00:00, run_id=scheduled__2024-05-24T23:49:00+00:00, run_start_date=2024-05-24 23:50:00.679047+00:00, run_end_date=2024-05-24 23:50:03.009473+00:00, run_duration=2.330426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:49:00+00:00, data_interval_end=2024-05-24 23:50:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:50:03.021897436Z [2024-05-24T23:50:03.021+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:50:00+00:00, run_after=2024-05-24T23:51:00+00:00 2024-05-24T23:50:03.111889703Z [2024-05-24T23:50:03.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:48:00+00:00 exited with status success for try_number 1 2024-05-24T23:50:03.112204137Z [2024-05-24T23:50:03.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:49:00+00:00 exited with status success for try_number 1 2024-05-24T23:50:03.130329041Z [2024-05-24T23:50:03.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:48:00+00:00, map_index=-1, run_start_date=2024-05-24 23:50:01.630898+00:00, run_end_date=2024-05-24 23:50:02.053158+00:00, run_duration=0.42226, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:50:00.816924+00:00, queued_by_job_id=1, pid=3582 2024-05-24T23:50:03.130569899Z [2024-05-24T23:50:03.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:49:00+00:00, map_index=-1, run_start_date=2024-05-24 23:50:01.889277+00:00, run_end_date=2024-05-24 23:50:02.473121+00:00, run_duration=0.583844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:50:00.816924+00:00, queued_by_job_id=1, pid=3583 2024-05-24T23:50:04.065422374Z [2024-05-24T23:50:04.064+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:50:04.065450392Z 2024-05-24T23:50:04.065636301Z [2024-05-24T23:50:04.065+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:50:04.066300597Z [2024-05-24T23:50:04.066+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:50:04.066312561Z 2024-05-24T23:50:04.068817111Z [2024-05-24T23:50:04.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:50:04.069026172Z [2024-05-24T23:50:04.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:50:04.141173815Z [2024-05-24T23:50:04.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status queued for try_number 1 2024-05-24T23:50:04.141687665Z [2024-05-24T23:50:04.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status success for try_number 1 2024-05-24T23:50:04.151487496Z [2024-05-24T23:50:04.151+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1985219a-a48d-420f-a6cb-beb245aa87e3 2024-05-24T23:50:04.151924708Z [2024-05-24T23:50:04.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:45:00+00:00, map_index=-1, run_start_date=2024-05-24 23:50:03.325607+00:00, run_end_date=2024-05-24 23:50:03.751562+00:00, run_duration=0.425955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:50:00.816924+00:00, queued_by_job_id=1, pid=3613 2024-05-24T23:50:05.331103188Z [2024-05-24T23:50:05.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:50:05.331660586Z [2024-05-24T23:50:05.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:49:00+00:00, run_id=scheduled__2024-05-24T23:49:00+00:00, run_start_date=2024-05-24 23:50:00.681123+00:00, run_end_date=2024-05-24 23:50:05.331181+00:00, run_duration=4.650058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:49:00+00:00, data_interval_end=2024-05-24 23:50:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:50:05.365706104Z [2024-05-24T23:50:05.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:50:00+00:00, run_after=2024-05-24T23:51:00+00:00 2024-05-24T23:50:05.378964078Z [2024-05-24T23:50:05.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:50:05.379355435Z [2024-05-24T23:50:05.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:49:00+00:00, run_id=scheduled__2024-05-24T23:49:00+00:00, run_start_date=2024-05-24 23:50:00.682850+00:00, run_end_date=2024-05-24 23:50:05.378899+00:00, run_duration=4.696049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:49:00+00:00, data_interval_end=2024-05-24 23:50:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:50:05.398423741Z [2024-05-24T23:50:05.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:50:00+00:00, run_after=2024-05-24T23:51:00+00:00 2024-05-24T23:50:05.454531653Z [2024-05-24T23:50:05.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:49:00+00:00 exited with status success for try_number 1 2024-05-24T23:50:05.454555521Z [2024-05-24T23:50:05.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:49:00+00:00 exited with status success for try_number 1 2024-05-24T23:50:05.473896409Z [2024-05-24T23:50:05.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:49:00+00:00, map_index=-1, run_start_date=2024-05-24 23:50:03.254269+00:00, run_end_date=2024-05-24 23:50:04.867553+00:00, run_duration=1.613284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:50:00.816924+00:00, queued_by_job_id=1, pid=3607 2024-05-24T23:50:05.473920778Z [2024-05-24T23:50:05.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:49:00+00:00, map_index=-1, run_start_date=2024-05-24 23:50:03.464551+00:00, run_end_date=2024-05-24 23:50:04.775180+00:00, run_duration=1.310629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:50:00.816924+00:00, queued_by_job_id=1, pid=3614 2024-05-24T23:50:06.541939057Z [2024-05-24T23:50:06.531+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:50:06.541962766Z 2024-05-24T23:50:06.541966378Z [2024-05-24T23:50:06.531+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:50:06.541970119Z [2024-05-24T23:50:06.532+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:50:06.541973798Z 2024-05-24T23:50:06.541977895Z [2024-05-24T23:50:06.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:50:06.541993760Z [2024-05-24T23:50:06.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:50:06.623467149Z [2024-05-24T23:50:06.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status queued for try_number 1 2024-05-24T23:50:06.625982405Z [2024-05-24T23:50:06.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status success for try_number 1 2024-05-24T23:50:06.642356137Z [2024-05-24T23:50:06.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9514d9e9-26d5-4fe8-a01b-4cd68ec2a8e7 2024-05-24T23:50:06.642645738Z [2024-05-24T23:50:06.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:45:00+00:00, map_index=-1, run_start_date=2024-05-24 23:50:05.766693+00:00, run_end_date=2024-05-24 23:50:06.187583+00:00, run_duration=0.42089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:50:04.066722+00:00, queued_by_job_id=1, pid=3637 2024-05-24T23:50:09.262737448Z [2024-05-24T23:50:09.262+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:50:09.262788113Z 2024-05-24T23:50:09.263216463Z [2024-05-24T23:50:09.262+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:50:09.264203424Z [2024-05-24T23:50:09.263+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:50:09.264216433Z 2024-05-24T23:50:09.267439639Z [2024-05-24T23:50:09.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:50:09.267951334Z [2024-05-24T23:50:09.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:50:09.325613748Z [2024-05-24T23:50:09.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status queued for try_number 1 2024-05-24T23:50:09.325657475Z [2024-05-24T23:50:09.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status success for try_number 1 2024-05-24T23:50:09.331332946Z [2024-05-24T23:50:09.330+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86eaa73d-ad16-4809-befb-646fad5f481d 2024-05-24T23:50:09.331473311Z [2024-05-24T23:50:09.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:45:00+00:00, map_index=0, run_start_date=2024-05-24 23:50:08.479528+00:00, run_end_date=2024-05-24 23:50:08.801696+00:00, run_duration=0.322168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:50:06.532849+00:00, queued_by_job_id=1, pid=3659 2024-05-24T23:50:11.571741853Z [2024-05-24T23:50:11.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:50:11.572432493Z [2024-05-24T23:50:11.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:45:00+00:00, run_id=scheduled__2024-05-24T23:45:00+00:00, run_start_date=2024-05-24 23:50:00.674491+00:00, run_end_date=2024-05-24 23:50:11.571542+00:00, run_duration=10.897051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:45:00+00:00, data_interval_end=2024-05-24 23:50:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-24T23:50:11.583363881Z [2024-05-24T23:50:11.582+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:50:00+00:00, run_after=2024-05-24T23:55:00+00:00 2024-05-24T23:50:11.640021093Z [2024-05-24T23:50:11.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:45:00+00:00 exited with status success for try_number 1 2024-05-24T23:50:11.651595405Z [2024-05-24T23:50:11.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:45:00+00:00, map_index=-1, run_start_date=2024-05-24 23:50:10.823091+00:00, run_end_date=2024-05-24 23:50:11.221961+00:00, run_duration=0.39887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:50:09.264847+00:00, queued_by_job_id=1, pid=3667 2024-05-24T23:50:27.881557736Z [2024-05-24T23:50:27.880+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T23:51:00.857425341Z [2024-05-24T23:51:00.856+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:51:00+00:00, run_after=2024-05-24T23:52:00+00:00 2024-05-24T23:51:00.873815944Z [2024-05-24T23:51:00.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:51:00+00:00, run_after=2024-05-24T23:52:00+00:00 2024-05-24T23:51:00.883973654Z [2024-05-24T23:51:00.883+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:51:00.968325302Z [2024-05-24T23:51:00.967+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:51:00.968366162Z 2024-05-24T23:51:00.968372966Z 2024-05-24T23:51:00.968397986Z 2024-05-24T23:51:00.968509535Z [2024-05-24T23:51:00.968+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:51:00.968822551Z [2024-05-24T23:51:00.968+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:51:00.969028262Z [2024-05-24T23:51:00.968+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:51:00.969884328Z [2024-05-24T23:51:00.969+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:51:00.969909385Z 2024-05-24T23:51:00.969918003Z 2024-05-24T23:51:00.969926641Z 2024-05-24T23:51:00.974014297Z [2024-05-24T23:51:00.973+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:51:00.974343679Z [2024-05-24T23:51:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:51:00.974761124Z [2024-05-24T23:51:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:51:00.975090753Z [2024-05-24T23:51:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:51:00.975485399Z [2024-05-24T23:51:00.975+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:51:00.975737269Z [2024-05-24T23:51:00.975+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:51:01.485938316Z [2024-05-24T23:51:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status queued for try_number 1 2024-05-24T23:51:01.486060852Z [2024-05-24T23:51:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status queued for try_number 1 2024-05-24T23:51:01.486186580Z [2024-05-24T23:51:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status queued for try_number 1 2024-05-24T23:51:01.494138698Z [2024-05-24T23:51:01.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ef56d99-86f8-4fb4-98e9-247649cef617 2024-05-24T23:51:01.494314889Z [2024-05-24T23:51:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb72fd59-3384-45d1-9b75-93ecb2157b99 2024-05-24T23:51:01.494492646Z [2024-05-24T23:51:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22632028-3eed-4c61-9108-e9d00ecde399 2024-05-24T23:51:02.670127810Z [2024-05-24T23:51:02.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:51:02.671017898Z [2024-05-24T23:51:02.670+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:50:00+00:00, run_id=scheduled__2024-05-24T23:50:00+00:00, run_start_date=2024-05-24 23:51:00.898195+00:00, run_end_date=2024-05-24 23:51:02.669880+00:00, run_duration=1.771685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:50:00+00:00, data_interval_end=2024-05-24 23:51:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:51:02.683169612Z [2024-05-24T23:51:02.682+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:51:00+00:00, run_after=2024-05-24T23:52:00+00:00 2024-05-24T23:51:02.772356849Z [2024-05-24T23:51:02.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status success for try_number 1 2024-05-24T23:51:02.777904575Z [2024-05-24T23:51:02.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:50:00+00:00, map_index=-1, run_start_date=2024-05-24 23:51:01.850492+00:00, run_end_date=2024-05-24 23:51:02.350634+00:00, run_duration=0.500142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:51:00.970879+00:00, queued_by_job_id=1, pid=3676 2024-05-24T23:51:05.703610024Z [2024-05-24T23:51:05.702+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:51:05.704181526Z [2024-05-24T23:51:05.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:50:00+00:00, run_id=scheduled__2024-05-24T23:50:00+00:00, run_start_date=2024-05-24 23:51:00.899794+00:00, run_end_date=2024-05-24 23:51:05.703483+00:00, run_duration=4.803689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:50:00+00:00, data_interval_end=2024-05-24 23:51:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:51:05.717551588Z [2024-05-24T23:51:05.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:51:00+00:00, run_after=2024-05-24T23:52:00+00:00 2024-05-24T23:51:05.725927990Z [2024-05-24T23:51:05.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:51:05.726072755Z [2024-05-24T23:51:05.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:50:00+00:00, run_id=scheduled__2024-05-24T23:50:00+00:00, run_start_date=2024-05-24 23:51:00.901094+00:00, run_end_date=2024-05-24 23:51:05.725807+00:00, run_duration=4.824713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:50:00+00:00, data_interval_end=2024-05-24 23:51:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:51:05.735750769Z [2024-05-24T23:51:05.735+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:51:00+00:00, run_after=2024-05-24T23:52:00+00:00 2024-05-24T23:51:05.781498458Z [2024-05-24T23:51:05.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status success for try_number 1 2024-05-24T23:51:05.781814748Z [2024-05-24T23:51:05.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status success for try_number 1 2024-05-24T23:51:05.792646762Z [2024-05-24T23:51:05.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:50:00+00:00, map_index=-1, run_start_date=2024-05-24 23:51:03.127060+00:00, run_end_date=2024-05-24 23:51:04.879736+00:00, run_duration=1.752676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:51:00.970879+00:00, queued_by_job_id=1, pid=3694 2024-05-24T23:51:05.793181387Z [2024-05-24T23:51:05.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:50:00+00:00, map_index=-1, run_start_date=2024-05-24 23:51:03.250981+00:00, run_end_date=2024-05-24 23:51:05.345734+00:00, run_duration=2.094753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:51:00.970879+00:00, queued_by_job_id=1, pid=3695 2024-05-24T23:52:00.053428062Z [2024-05-24T23:52:00.052+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:52:00.074101910Z [2024-05-24T23:52:00.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:52:00+00:00, run_after=2024-05-24T23:53:00+00:00 2024-05-24T23:52:00.083748883Z [2024-05-24T23:52:00.083+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:52:00.098217895Z [2024-05-24T23:52:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:52:00+00:00, run_after=2024-05-24T23:53:00+00:00 2024-05-24T23:52:00.196256474Z [2024-05-24T23:52:00.195+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:52:00.196282628Z 2024-05-24T23:52:00.196289477Z 2024-05-24T23:52:00.196295096Z 2024-05-24T23:52:00.196324483Z 2024-05-24T23:52:00.196367545Z [2024-05-24T23:52:00.196+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:52:00.196683351Z [2024-05-24T23:52:00.196+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:52:00.197102580Z [2024-05-24T23:52:00.196+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:52:00.197355608Z [2024-05-24T23:52:00.197+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:52:00.198211524Z [2024-05-24T23:52:00.197+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:52:00.198285192Z 2024-05-24T23:52:00.198304117Z 2024-05-24T23:52:00.198363509Z 2024-05-24T23:52:00.198379168Z 2024-05-24T23:52:00.202918402Z [2024-05-24T23:52:00.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:52:00.203191188Z [2024-05-24T23:52:00.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:52:00.203540611Z [2024-05-24T23:52:00.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:52:00.203723070Z [2024-05-24T23:52:00.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:52:00.204052014Z [2024-05-24T23:52:00.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:52:00.204229336Z [2024-05-24T23:52:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:52:00.204482970Z [2024-05-24T23:52:00.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:52:00.204667733Z [2024-05-24T23:52:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:52:00.679726806Z [2024-05-24T23:52:00.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status queued for try_number 1 2024-05-24T23:52:00.679782490Z [2024-05-24T23:52:00.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:51:00+00:00 exited with status queued for try_number 1 2024-05-24T23:52:00.682645863Z [2024-05-24T23:52:00.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:51:00+00:00 exited with status queued for try_number 1 2024-05-24T23:52:00.682833991Z [2024-05-24T23:52:00.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:51:00+00:00 exited with status queued for try_number 1 2024-05-24T23:52:00.702644476Z [2024-05-24T23:52:00.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ce45f0c-7e40-4ed9-a51e-f60642d6efd5 2024-05-24T23:52:00.703542949Z [2024-05-24T23:52:00.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb6e9e90-8043-446a-9b18-aaf1c3b8cddb 2024-05-24T23:52:00.703835638Z [2024-05-24T23:52:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1293c2cb-0e6e-48e8-8429-21da9ae9316c 2024-05-24T23:52:00.706098905Z [2024-05-24T23:52:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to e65df6ef-9b08-4812-a5b3-2059d1675807 2024-05-24T23:52:01.972450663Z [2024-05-24T23:52:01.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:52:01.973128519Z [2024-05-24T23:52:01.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:50:00+00:00, run_id=scheduled__2024-05-24T23:50:00+00:00, run_start_date=2024-05-24 23:52:00.114046+00:00, run_end_date=2024-05-24 23:52:01.972568+00:00, run_duration=1.858522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:50:00+00:00, data_interval_end=2024-05-24 23:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:52:01.983872351Z [2024-05-24T23:52:01.983+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:52:00+00:00, run_after=2024-05-24T23:54:00+00:00 2024-05-24T23:52:01.991237846Z [2024-05-24T23:52:01.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:52:01.991883399Z [2024-05-24T23:52:01.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:51:00+00:00, run_id=scheduled__2024-05-24T23:51:00+00:00, run_start_date=2024-05-24 23:52:00.116254+00:00, run_end_date=2024-05-24 23:52:01.991151+00:00, run_duration=1.874897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:51:00+00:00, data_interval_end=2024-05-24 23:52:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:52:02.009659904Z [2024-05-24T23:52:02.009+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:52:00+00:00, run_after=2024-05-24T23:53:00+00:00 2024-05-24T23:52:02.070807146Z [2024-05-24T23:52:02.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status success for try_number 1 2024-05-24T23:52:02.073353665Z [2024-05-24T23:52:02.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:51:00+00:00 exited with status success for try_number 1 2024-05-24T23:52:02.080937345Z [2024-05-24T23:52:02.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:50:00+00:00, map_index=-1, run_start_date=2024-05-24 23:52:01.104960+00:00, run_end_date=2024-05-24 23:52:01.621114+00:00, run_duration=0.516154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:52:00.199347+00:00, queued_by_job_id=1, pid=3728 2024-05-24T23:52:02.081367016Z [2024-05-24T23:52:02.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:51:00+00:00, map_index=-1, run_start_date=2024-05-24 23:52:01.212325+00:00, run_end_date=2024-05-24 23:52:01.759555+00:00, run_duration=0.54723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:52:00.199347+00:00, queued_by_job_id=1, pid=3729 2024-05-24T23:52:05.013616464Z [2024-05-24T23:52:05.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:52:05.014285800Z [2024-05-24T23:52:05.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:51:00+00:00, run_id=scheduled__2024-05-24T23:51:00+00:00, run_start_date=2024-05-24 23:52:00.118270+00:00, run_end_date=2024-05-24 23:52:05.013736+00:00, run_duration=4.895466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:51:00+00:00, data_interval_end=2024-05-24 23:52:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:52:05.024813324Z [2024-05-24T23:52:05.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:52:00+00:00, run_after=2024-05-24T23:53:00+00:00 2024-05-24T23:52:05.031732353Z [2024-05-24T23:52:05.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:52:05.032214894Z [2024-05-24T23:52:05.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:51:00+00:00, run_id=scheduled__2024-05-24T23:51:00+00:00, run_start_date=2024-05-24 23:52:00.120335+00:00, run_end_date=2024-05-24 23:52:05.031629+00:00, run_duration=4.911294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:51:00+00:00, data_interval_end=2024-05-24 23:52:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:52:05.042025905Z [2024-05-24T23:52:05.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:52:00+00:00, run_after=2024-05-24T23:53:00+00:00 2024-05-24T23:52:05.081779527Z [2024-05-24T23:52:05.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:51:00+00:00 exited with status success for try_number 1 2024-05-24T23:52:05.081836323Z [2024-05-24T23:52:05.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:51:00+00:00 exited with status success for try_number 1 2024-05-24T23:52:05.091771843Z [2024-05-24T23:52:05.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:51:00+00:00, map_index=-1, run_start_date=2024-05-24 23:52:02.424066+00:00, run_end_date=2024-05-24 23:52:03.828044+00:00, run_duration=1.403978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:52:00.199347+00:00, queued_by_job_id=1, pid=3752 2024-05-24T23:52:05.091816108Z [2024-05-24T23:52:05.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:51:00+00:00, map_index=-1, run_start_date=2024-05-24 23:52:02.565822+00:00, run_end_date=2024-05-24 23:52:04.450376+00:00, run_duration=1.884554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:52:00.199347+00:00, queued_by_job_id=1, pid=3753 2024-05-24T23:53:00.863852926Z [2024-05-24T23:53:00.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:53:00+00:00, run_after=2024-05-24T23:54:00+00:00 2024-05-24T23:53:00.880390045Z [2024-05-24T23:53:00.879+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:53:00+00:00, run_after=2024-05-24T23:54:00+00:00 2024-05-24T23:53:00.887373412Z [2024-05-24T23:53:00.886+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:53:00.965136303Z [2024-05-24T23:53:00.964+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:53:00.965177073Z 2024-05-24T23:53:00.965185605Z 2024-05-24T23:53:00.965193442Z 2024-05-24T23:53:00.965420084Z [2024-05-24T23:53:00.965+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:53:00.965721745Z [2024-05-24T23:53:00.965+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:53:00.966030559Z [2024-05-24T23:53:00.965+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:53:00.967428440Z [2024-05-24T23:53:00.967+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:53:00.967448046Z 2024-05-24T23:53:00.967454671Z 2024-05-24T23:53:00.967460777Z 2024-05-24T23:53:00.973024043Z [2024-05-24T23:53:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:53:00.973478354Z [2024-05-24T23:53:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:53:00.974022515Z [2024-05-24T23:53:00.973+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:53:00.974398469Z [2024-05-24T23:53:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:53:00.974931224Z [2024-05-24T23:53:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:53:00.975231514Z [2024-05-24T23:53:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:53:01.407460279Z [2024-05-24T23:53:01.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:52:00+00:00 exited with status queued for try_number 1 2024-05-24T23:53:01.407565126Z [2024-05-24T23:53:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:52:00+00:00 exited with status queued for try_number 1 2024-05-24T23:53:01.407726000Z [2024-05-24T23:53:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:52:00+00:00 exited with status queued for try_number 1 2024-05-24T23:53:01.418098586Z [2024-05-24T23:53:01.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2449ab4a-caa4-49fb-a94d-3eb5094c1926 2024-05-24T23:53:01.418369664Z [2024-05-24T23:53:01.418+0000] {scheduler_job.py:635} INFO - Setting external_id for to 688046e7-d7c8-4484-b04e-d3ac84bfdb52 2024-05-24T23:53:01.418549933Z [2024-05-24T23:53:01.418+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30ec3c84-acbe-4e72-927d-7342098f54a7 2024-05-24T23:53:02.622279423Z [2024-05-24T23:53:02.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:53:02.622718006Z [2024-05-24T23:53:02.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:52:00+00:00, run_id=scheduled__2024-05-24T23:52:00+00:00, run_start_date=2024-05-24 23:53:00.896628+00:00, run_end_date=2024-05-24 23:53:02.622126+00:00, run_duration=1.725498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:52:00+00:00, data_interval_end=2024-05-24 23:53:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:53:02.633162588Z [2024-05-24T23:53:02.632+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:53:00+00:00, run_after=2024-05-24T23:54:00+00:00 2024-05-24T23:53:02.680880621Z [2024-05-24T23:53:02.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:52:00+00:00 exited with status success for try_number 1 2024-05-24T23:53:02.687951841Z [2024-05-24T23:53:02.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:52:00+00:00, map_index=-1, run_start_date=2024-05-24 23:53:01.724366+00:00, run_end_date=2024-05-24 23:53:02.118667+00:00, run_duration=0.394301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:53:00.968683+00:00, queued_by_job_id=1, pid=3785 2024-05-24T23:53:04.850853560Z [2024-05-24T23:53:04.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:53:04.851145415Z [2024-05-24T23:53:04.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:52:00+00:00, run_id=scheduled__2024-05-24T23:52:00+00:00, run_start_date=2024-05-24 23:53:00.897863+00:00, run_end_date=2024-05-24 23:53:04.850839+00:00, run_duration=3.952976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:52:00+00:00, data_interval_end=2024-05-24 23:53:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:53:04.859711809Z [2024-05-24T23:53:04.859+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:53:00+00:00, run_after=2024-05-24T23:54:00+00:00 2024-05-24T23:53:04.922114918Z [2024-05-24T23:53:04.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:52:00+00:00 exited with status success for try_number 1 2024-05-24T23:53:04.928654189Z [2024-05-24T23:53:04.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:52:00+00:00, map_index=-1, run_start_date=2024-05-24 23:53:02.966207+00:00, run_end_date=2024-05-24 23:53:04.509420+00:00, run_duration=1.543213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:53:00.968683+00:00, queued_by_job_id=1, pid=3803 2024-05-24T23:53:05.517268028Z [2024-05-24T23:53:05.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:53:05.517354580Z [2024-05-24T23:53:05.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:52:00+00:00, run_id=scheduled__2024-05-24T23:52:00+00:00, run_start_date=2024-05-24 23:53:00.898849+00:00, run_end_date=2024-05-24 23:53:05.516984+00:00, run_duration=4.618135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:52:00+00:00, data_interval_end=2024-05-24 23:53:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:53:05.527575999Z [2024-05-24T23:53:05.527+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:53:00+00:00, run_after=2024-05-24T23:54:00+00:00 2024-05-24T23:53:05.595936912Z [2024-05-24T23:53:05.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:52:00+00:00 exited with status success for try_number 1 2024-05-24T23:53:05.605030306Z [2024-05-24T23:53:05.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:52:00+00:00, map_index=-1, run_start_date=2024-05-24 23:53:03.019228+00:00, run_end_date=2024-05-24 23:53:04.925284+00:00, run_duration=1.906056, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:53:00.968683+00:00, queued_by_job_id=1, pid=3804 2024-05-24T23:54:00.586518713Z [2024-05-24T23:54:00.585+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:54:00.607295816Z [2024-05-24T23:54:00.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:54:00+00:00, run_after=2024-05-24T23:55:00+00:00 2024-05-24T23:54:00.616789344Z [2024-05-24T23:54:00.616+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:54:00.630790322Z [2024-05-24T23:54:00.630+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:54:00+00:00, run_after=2024-05-24T23:55:00+00:00 2024-05-24T23:54:00.725976286Z [2024-05-24T23:54:00.725+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:54:00.726038289Z 2024-05-24T23:54:00.726046858Z 2024-05-24T23:54:00.726053226Z 2024-05-24T23:54:00.726059196Z 2024-05-24T23:54:00.726346929Z [2024-05-24T23:54:00.725+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:54:00.726666610Z [2024-05-24T23:54:00.726+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:54:00.726995745Z [2024-05-24T23:54:00.726+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:54:00.727291482Z [2024-05-24T23:54:00.726+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:54:00.728324470Z [2024-05-24T23:54:00.728+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:54:00.728343885Z 2024-05-24T23:54:00.728353569Z 2024-05-24T23:54:00.728362403Z 2024-05-24T23:54:00.728371001Z 2024-05-24T23:54:00.734005433Z [2024-05-24T23:54:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:54:00.734287672Z [2024-05-24T23:54:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:54:00.734844949Z [2024-05-24T23:54:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:54:00.735149179Z [2024-05-24T23:54:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:54:00.735572805Z [2024-05-24T23:54:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:54:00.735864045Z [2024-05-24T23:54:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:54:00.736287810Z [2024-05-24T23:54:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:54:00.736495340Z [2024-05-24T23:54:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:54:01.006750632Z [2024-05-24T23:54:01.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:52:00+00:00 exited with status queued for try_number 1 2024-05-24T23:54:01.006894661Z [2024-05-24T23:54:01.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:53:00+00:00 exited with status queued for try_number 1 2024-05-24T23:54:01.007024543Z [2024-05-24T23:54:01.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:53:00+00:00 exited with status queued for try_number 1 2024-05-24T23:54:01.007158007Z [2024-05-24T23:54:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:53:00+00:00 exited with status queued for try_number 1 2024-05-24T23:54:01.015721913Z [2024-05-24T23:54:01.015+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9164189-b884-4fcf-806f-d683b45594eb 2024-05-24T23:54:01.016076617Z [2024-05-24T23:54:01.015+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb33fd33-6470-4164-90be-d5b88fb2faf7 2024-05-24T23:54:01.016429327Z [2024-05-24T23:54:01.016+0000] {scheduler_job.py:635} INFO - Setting external_id for to 092c23ef-96eb-42a8-beac-6c7327a56102 2024-05-24T23:54:01.016634326Z [2024-05-24T23:54:01.016+0000] {scheduler_job.py:635} INFO - Setting external_id for to 370b1b92-c3b7-4509-b78e-383859e14f2a 2024-05-24T23:54:02.378112235Z [2024-05-24T23:54:02.377+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:54:02.378536718Z [2024-05-24T23:54:02.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:52:00+00:00, run_id=scheduled__2024-05-24T23:52:00+00:00, run_start_date=2024-05-24 23:54:00.651024+00:00, run_end_date=2024-05-24 23:54:02.378000+00:00, run_duration=1.726976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:52:00+00:00, data_interval_end=2024-05-24 23:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:54:02.389428400Z [2024-05-24T23:54:02.388+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:54:00+00:00, run_after=2024-05-24T23:56:00+00:00 2024-05-24T23:54:02.398335238Z [2024-05-24T23:54:02.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:54:02.398650899Z [2024-05-24T23:54:02.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:53:00+00:00, run_id=scheduled__2024-05-24T23:53:00+00:00, run_start_date=2024-05-24 23:54:00.652527+00:00, run_end_date=2024-05-24 23:54:02.398265+00:00, run_duration=1.745738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:53:00+00:00, data_interval_end=2024-05-24 23:54:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:54:02.408170041Z [2024-05-24T23:54:02.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:54:00+00:00, run_after=2024-05-24T23:55:00+00:00 2024-05-24T23:54:02.452022032Z [2024-05-24T23:54:02.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:52:00+00:00 exited with status success for try_number 1 2024-05-24T23:54:02.452080822Z [2024-05-24T23:54:02.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:53:00+00:00 exited with status success for try_number 1 2024-05-24T23:54:02.459310123Z [2024-05-24T23:54:02.458+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:53:00+00:00, map_index=-1, run_start_date=2024-05-24 23:54:01.649532+00:00, run_end_date=2024-05-24 23:54:02.037088+00:00, run_duration=0.387556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:54:00.729674+00:00, queued_by_job_id=1, pid=3836 2024-05-24T23:54:02.459488232Z [2024-05-24T23:54:02.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:52:00+00:00, map_index=-1, run_start_date=2024-05-24 23:54:01.651243+00:00, run_end_date=2024-05-24 23:54:02.035477+00:00, run_duration=0.384234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:54:00.729674+00:00, queued_by_job_id=1, pid=3837 2024-05-24T23:54:04.627209963Z [2024-05-24T23:54:04.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:54:04.627793729Z [2024-05-24T23:54:04.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:53:00+00:00, run_id=scheduled__2024-05-24T23:53:00+00:00, run_start_date=2024-05-24 23:54:00.654326+00:00, run_end_date=2024-05-24 23:54:04.627240+00:00, run_duration=3.972914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:53:00+00:00, data_interval_end=2024-05-24 23:54:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:54:04.640046488Z [2024-05-24T23:54:04.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:54:00+00:00, run_after=2024-05-24T23:55:00+00:00 2024-05-24T23:54:04.650816992Z [2024-05-24T23:54:04.650+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:54:04.651341765Z [2024-05-24T23:54:04.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:53:00+00:00, run_id=scheduled__2024-05-24T23:53:00+00:00, run_start_date=2024-05-24 23:54:00.655609+00:00, run_end_date=2024-05-24 23:54:04.650771+00:00, run_duration=3.995162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:53:00+00:00, data_interval_end=2024-05-24 23:54:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:54:04.664193052Z [2024-05-24T23:54:04.663+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:54:00+00:00, run_after=2024-05-24T23:55:00+00:00 2024-05-24T23:54:04.717626638Z [2024-05-24T23:54:04.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:53:00+00:00 exited with status success for try_number 1 2024-05-24T23:54:04.717954868Z [2024-05-24T23:54:04.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:53:00+00:00 exited with status success for try_number 1 2024-05-24T23:54:04.728628790Z [2024-05-24T23:54:04.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:53:00+00:00, map_index=-1, run_start_date=2024-05-24 23:54:02.782503+00:00, run_end_date=2024-05-24 23:54:04.183098+00:00, run_duration=1.400595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:54:00.729674+00:00, queued_by_job_id=1, pid=3860 2024-05-24T23:54:04.729069357Z [2024-05-24T23:54:04.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:53:00+00:00, map_index=-1, run_start_date=2024-05-24 23:54:02.813850+00:00, run_end_date=2024-05-24 23:54:04.474695+00:00, run_duration=1.660845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:54:00.729674+00:00, queued_by_job_id=1, pid=3861 2024-05-24T23:55:00.815115815Z [2024-05-24T23:55:00.814+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:55:00.833178089Z [2024-05-24T23:55:00.832+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:55:00+00:00, run_after=2024-05-25T00:00:00+00:00 2024-05-24T23:55:00.850891318Z [2024-05-24T23:55:00.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:55:00+00:00, run_after=2024-05-24T23:56:00+00:00 2024-05-24T23:55:00.865982310Z [2024-05-24T23:55:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:55:00+00:00, run_after=2024-05-24T23:56:00+00:00 2024-05-24T23:55:00.967270182Z [2024-05-24T23:55:00.966+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:55:00.967372227Z 2024-05-24T23:55:00.967404722Z 2024-05-24T23:55:00.967412022Z 2024-05-24T23:55:00.967418859Z 2024-05-24T23:55:00.967445038Z [2024-05-24T23:55:00.967+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:55:00.967726719Z [2024-05-24T23:55:00.967+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:55:00.968014878Z [2024-05-24T23:55:00.967+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:55:00.968203938Z [2024-05-24T23:55:00.967+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:55:00.969095150Z [2024-05-24T23:55:00.968+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:55:00.969107632Z 2024-05-24T23:55:00.969114431Z 2024-05-24T23:55:00.969120507Z 2024-05-24T23:55:00.969178723Z 2024-05-24T23:55:00.975365914Z [2024-05-24T23:55:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T23:55:00.975486750Z [2024-05-24T23:55:00.975+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:55:00.975993577Z [2024-05-24T23:55:00.975+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:55:00.976972967Z [2024-05-24T23:55:00.975+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:55:00.977032229Z [2024-05-24T23:55:00.976+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:55:00.977042483Z [2024-05-24T23:55:00.976+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:55:00.977073646Z [2024-05-24T23:55:00.976+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:55:00.977081509Z [2024-05-24T23:55:00.976+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:55:01.479454343Z [2024-05-24T23:55:01.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status queued for try_number 1 2024-05-24T23:55:01.479693783Z [2024-05-24T23:55:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:54:00+00:00 exited with status queued for try_number 1 2024-05-24T23:55:01.479909796Z [2024-05-24T23:55:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:54:00+00:00 exited with status queued for try_number 1 2024-05-24T23:55:01.480094045Z [2024-05-24T23:55:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:54:00+00:00 exited with status queued for try_number 1 2024-05-24T23:55:01.495607179Z [2024-05-24T23:55:01.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf6ec85e-1c83-4cb2-83f7-ab8f49a972c4 2024-05-24T23:55:01.499582717Z [2024-05-24T23:55:01.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bb52d68-e3ec-4e52-8cc1-dded7dfa2ecf 2024-05-24T23:55:01.499922709Z [2024-05-24T23:55:01.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to f16da957-9612-48b2-bb0a-82e5d90d9655 2024-05-24T23:55:01.500196727Z [2024-05-24T23:55:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58f3ce2b-8134-4dce-ac48-68aad687a293 2024-05-24T23:55:03.174909650Z [2024-05-24T23:55:03.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:55:03.175410779Z [2024-05-24T23:55:03.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:54:00+00:00, run_id=scheduled__2024-05-24T23:54:00+00:00, run_start_date=2024-05-24 23:55:00.879809+00:00, run_end_date=2024-05-24 23:55:03.174864+00:00, run_duration=2.295055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:54:00+00:00, data_interval_end=2024-05-24 23:55:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:55:03.192242344Z [2024-05-24T23:55:03.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:55:00+00:00, run_after=2024-05-24T23:56:00+00:00 2024-05-24T23:55:03.276590062Z [2024-05-24T23:55:03.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:54:00+00:00 exited with status success for try_number 1 2024-05-24T23:55:03.289324580Z [2024-05-24T23:55:03.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:54:00+00:00, map_index=-1, run_start_date=2024-05-24 23:55:01.911292+00:00, run_end_date=2024-05-24 23:55:02.564742+00:00, run_duration=0.65345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:55:00.971056+00:00, queued_by_job_id=1, pid=3894 2024-05-24T23:55:04.401887840Z [2024-05-24T23:55:04.401+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:55:04.401913280Z 2024-05-24T23:55:04.401955913Z [2024-05-24T23:55:04.401+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:55:04.402922625Z [2024-05-24T23:55:04.402+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:55:04.402967810Z 2024-05-24T23:55:04.405684301Z [2024-05-24T23:55:04.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T23:55:04.405864567Z [2024-05-24T23:55:04.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:55:04.491246491Z [2024-05-24T23:55:04.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status queued for try_number 1 2024-05-24T23:55:04.491309031Z [2024-05-24T23:55:04.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status success for try_number 1 2024-05-24T23:55:04.498635960Z [2024-05-24T23:55:04.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cf49fdc-dd8b-44b4-98ca-01cb3e4333ee 2024-05-24T23:55:04.498730978Z [2024-05-24T23:55:04.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:50:00+00:00, map_index=-1, run_start_date=2024-05-24 23:55:03.058830+00:00, run_end_date=2024-05-24 23:55:03.420190+00:00, run_duration=0.36136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:55:00.971056+00:00, queued_by_job_id=1, pid=3918 2024-05-24T23:55:05.659075614Z [2024-05-24T23:55:05.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:55:05.659225782Z [2024-05-24T23:55:05.658+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:54:00+00:00, run_id=scheduled__2024-05-24T23:54:00+00:00, run_start_date=2024-05-24 23:55:00.882242+00:00, run_end_date=2024-05-24 23:55:05.658830+00:00, run_duration=4.776588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:54:00+00:00, data_interval_end=2024-05-24 23:55:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:55:05.668477350Z [2024-05-24T23:55:05.668+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:55:00+00:00, run_after=2024-05-24T23:56:00+00:00 2024-05-24T23:55:05.675485469Z [2024-05-24T23:55:05.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:55:05.675688832Z [2024-05-24T23:55:05.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:54:00+00:00, run_id=scheduled__2024-05-24T23:54:00+00:00, run_start_date=2024-05-24 23:55:00.881092+00:00, run_end_date=2024-05-24 23:55:05.675296+00:00, run_duration=4.794204, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:54:00+00:00, data_interval_end=2024-05-24 23:55:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:55:05.685632136Z [2024-05-24T23:55:05.685+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:55:00+00:00, run_after=2024-05-24T23:56:00+00:00 2024-05-24T23:55:05.729611023Z [2024-05-24T23:55:05.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:54:00+00:00 exited with status success for try_number 1 2024-05-24T23:55:05.730052799Z [2024-05-24T23:55:05.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:54:00+00:00 exited with status success for try_number 1 2024-05-24T23:55:05.739716042Z [2024-05-24T23:55:05.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:54:00+00:00, map_index=-1, run_start_date=2024-05-24 23:55:03.241930+00:00, run_end_date=2024-05-24 23:55:04.814640+00:00, run_duration=1.57271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:55:00.971056+00:00, queued_by_job_id=1, pid=3920 2024-05-24T23:55:05.740164890Z [2024-05-24T23:55:05.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:54:00+00:00, map_index=-1, run_start_date=2024-05-24 23:55:03.092816+00:00, run_end_date=2024-05-24 23:55:04.549479+00:00, run_duration=1.456663, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:55:00.971056+00:00, queued_by_job_id=1, pid=3919 2024-05-24T23:55:07.161338767Z [2024-05-24T23:55:07.160+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:55:07.161362446Z 2024-05-24T23:55:07.161444479Z [2024-05-24T23:55:07.161+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:55:07.162343876Z [2024-05-24T23:55:07.162+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:55:07.162363610Z 2024-05-24T23:55:07.165441240Z [2024-05-24T23:55:07.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T23:55:07.165629280Z [2024-05-24T23:55:07.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:55:07.239061638Z [2024-05-24T23:55:07.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status queued for try_number 1 2024-05-24T23:55:07.239393477Z [2024-05-24T23:55:07.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status success for try_number 1 2024-05-24T23:55:07.246158190Z [2024-05-24T23:55:07.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7921660-f623-491a-961b-941ecc4659fd 2024-05-24T23:55:07.246438295Z [2024-05-24T23:55:07.246+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:50:00+00:00, map_index=-1, run_start_date=2024-05-24 23:55:06.121459+00:00, run_end_date=2024-05-24 23:55:06.546637+00:00, run_duration=0.425178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:55:04.403329+00:00, queued_by_job_id=1, pid=3953 2024-05-24T23:55:09.524039220Z [2024-05-24T23:55:09.523+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T23:55:09.524060780Z 2024-05-24T23:55:09.524235737Z [2024-05-24T23:55:09.523+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:55:09.524828389Z [2024-05-24T23:55:09.524+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:55:09.524839861Z 2024-05-24T23:55:09.527082709Z [2024-05-24T23:55:09.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:55:09.527337013Z [2024-05-24T23:55:09.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:55:09.580555646Z [2024-05-24T23:55:09.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status queued for try_number 1 2024-05-24T23:55:09.580670822Z [2024-05-24T23:55:09.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status success for try_number 1 2024-05-24T23:55:09.586250302Z [2024-05-24T23:55:09.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab82a493-ad6a-4b5e-850a-208f98ff21b9 2024-05-24T23:55:09.586586734Z [2024-05-24T23:55:09.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:50:00+00:00, map_index=0, run_start_date=2024-05-24 23:55:08.972296+00:00, run_end_date=2024-05-24 23:55:09.324379+00:00, run_duration=0.352083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:55:07.162872+00:00, queued_by_job_id=1, pid=3964 2024-05-24T23:55:11.820606799Z [2024-05-24T23:55:11.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:55:11.821903760Z [2024-05-24T23:55:11.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:50:00+00:00, run_id=scheduled__2024-05-24T23:50:00+00:00, run_start_date=2024-05-24 23:55:00.878458+00:00, run_end_date=2024-05-24 23:55:11.821459+00:00, run_duration=10.943001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:50:00+00:00, data_interval_end=2024-05-24 23:55:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-24T23:55:11.831408095Z [2024-05-24T23:55:11.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:55:00+00:00, run_after=2024-05-25T00:00:00+00:00 2024-05-24T23:55:11.868127945Z [2024-05-24T23:55:11.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:50:00+00:00 exited with status success for try_number 1 2024-05-24T23:55:11.878147264Z [2024-05-24T23:55:11.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:50:00+00:00, map_index=-1, run_start_date=2024-05-24 23:55:11.152560+00:00, run_end_date=2024-05-24 23:55:11.564198+00:00, run_duration=0.411638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:55:09.525173+00:00, queued_by_job_id=1, pid=3972 2024-05-24T23:55:27.958332077Z [2024-05-24T23:55:27.957+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T23:56:01.037401562Z [2024-05-24T23:56:01.036+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:56:01.046796851Z [2024-05-24T23:56:01.046+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:56:01.062658683Z [2024-05-24T23:56:01.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:56:00+00:00, run_after=2024-05-24T23:57:00+00:00 2024-05-24T23:56:01.077273667Z [2024-05-24T23:56:01.076+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:56:00+00:00, run_after=2024-05-24T23:57:00+00:00 2024-05-24T23:56:01.178796345Z [2024-05-24T23:56:01.178+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:56:01.178842440Z 2024-05-24T23:56:01.178855509Z 2024-05-24T23:56:01.178865193Z 2024-05-24T23:56:01.178874549Z 2024-05-24T23:56:01.179182641Z [2024-05-24T23:56:01.178+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:56:01.179607735Z [2024-05-24T23:56:01.179+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:56:01.180035236Z [2024-05-24T23:56:01.179+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:56:01.180424363Z [2024-05-24T23:56:01.180+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:56:01.181606918Z [2024-05-24T23:56:01.181+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:56:01.181624546Z 2024-05-24T23:56:01.181631886Z 2024-05-24T23:56:01.181638318Z 2024-05-24T23:56:01.181644974Z 2024-05-24T23:56:01.187693738Z [2024-05-24T23:56:01.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:56:01.187921196Z [2024-05-24T23:56:01.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:56:01.188337656Z [2024-05-24T23:56:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:56:01.188552098Z [2024-05-24T23:56:01.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:56:01.188955901Z [2024-05-24T23:56:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:56:01.189199581Z [2024-05-24T23:56:01.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:56:01.189643429Z [2024-05-24T23:56:01.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:56:01.189879508Z [2024-05-24T23:56:01.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:56:01.693840153Z [2024-05-24T23:56:01.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:54:00+00:00 exited with status queued for try_number 1 2024-05-24T23:56:01.693864984Z [2024-05-24T23:56:01.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status queued for try_number 1 2024-05-24T23:56:01.693879064Z [2024-05-24T23:56:01.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status queued for try_number 1 2024-05-24T23:56:01.693882407Z [2024-05-24T23:56:01.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status queued for try_number 1 2024-05-24T23:56:01.719007525Z [2024-05-24T23:56:01.714+0000] {scheduler_job.py:635} INFO - Setting external_id for to 757737dc-93af-4375-81d0-fa2bc13f8570 2024-05-24T23:56:01.719028790Z [2024-05-24T23:56:01.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29f04b18-21df-4bd0-b8dd-06e491e578f0 2024-05-24T23:56:01.721874743Z [2024-05-24T23:56:01.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90ea3917-da3b-462d-84c4-d7ba7752d4e1 2024-05-24T23:56:01.728637883Z [2024-05-24T23:56:01.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to aeece0c6-081e-47bd-a95e-b1338292bd95 2024-05-24T23:56:02.962265934Z [2024-05-24T23:56:02.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:56:02.963265269Z [2024-05-24T23:56:02.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:54:00+00:00, run_id=scheduled__2024-05-24T23:54:00+00:00, run_start_date=2024-05-24 23:56:01.092268+00:00, run_end_date=2024-05-24 23:56:02.962319+00:00, run_duration=1.870051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:54:00+00:00, data_interval_end=2024-05-24 23:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:56:02.975055230Z [2024-05-24T23:56:02.974+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:56:00+00:00, run_after=2024-05-24T23:58:00+00:00 2024-05-24T23:56:03.061361124Z [2024-05-24T23:56:03.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:54:00+00:00 exited with status success for try_number 1 2024-05-24T23:56:03.067036214Z [2024-05-24T23:56:03.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:54:00+00:00, map_index=-1, run_start_date=2024-05-24 23:56:02.099178+00:00, run_end_date=2024-05-24 23:56:02.585377+00:00, run_duration=0.486199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:56:01.183037+00:00, queued_by_job_id=1, pid=3977 2024-05-24T23:56:04.118589967Z [2024-05-24T23:56:04.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:56:04.118819489Z [2024-05-24T23:56:04.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:55:00+00:00, run_id=scheduled__2024-05-24T23:55:00+00:00, run_start_date=2024-05-24 23:56:01.093762+00:00, run_end_date=2024-05-24 23:56:04.118544+00:00, run_duration=3.024782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:55:00+00:00, data_interval_end=2024-05-24 23:56:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:56:04.127119741Z [2024-05-24T23:56:04.126+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:56:00+00:00, run_after=2024-05-24T23:57:00+00:00 2024-05-24T23:56:04.175225811Z [2024-05-24T23:56:04.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status success for try_number 1 2024-05-24T23:56:04.182090015Z [2024-05-24T23:56:04.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:55:00+00:00, map_index=-1, run_start_date=2024-05-24 23:56:02.583833+00:00, run_end_date=2024-05-24 23:56:03.077361+00:00, run_duration=0.493528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:56:01.183037+00:00, queued_by_job_id=1, pid=3988 2024-05-24T23:56:05.232306939Z [2024-05-24T23:56:05.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:56:05.232651064Z [2024-05-24T23:56:05.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:55:00+00:00, run_id=scheduled__2024-05-24T23:55:00+00:00, run_start_date=2024-05-24 23:56:01.095034+00:00, run_end_date=2024-05-24 23:56:05.232142+00:00, run_duration=4.137108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:55:00+00:00, data_interval_end=2024-05-24 23:56:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:56:05.244719319Z [2024-05-24T23:56:05.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:56:00+00:00, run_after=2024-05-24T23:57:00+00:00 2024-05-24T23:56:06.337993038Z [2024-05-24T23:56:06.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:56:06.338361088Z [2024-05-24T23:56:06.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:55:00+00:00, run_id=scheduled__2024-05-24T23:55:00+00:00, run_start_date=2024-05-24 23:56:01.096272+00:00, run_end_date=2024-05-24 23:56:06.337874+00:00, run_duration=5.241602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:55:00+00:00, data_interval_end=2024-05-24 23:56:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:56:06.351455738Z [2024-05-24T23:56:06.351+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:56:00+00:00, run_after=2024-05-24T23:57:00+00:00 2024-05-24T23:56:06.404377867Z [2024-05-24T23:56:06.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status success for try_number 1 2024-05-24T23:56:06.404686788Z [2024-05-24T23:56:06.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status success for try_number 1 2024-05-24T23:56:06.413634267Z [2024-05-24T23:56:06.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:55:00+00:00, map_index=-1, run_start_date=2024-05-24 23:56:03.804586+00:00, run_end_date=2024-05-24 23:56:05.164045+00:00, run_duration=1.359459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:56:01.183037+00:00, queued_by_job_id=1, pid=4007 2024-05-24T23:56:06.414037865Z [2024-05-24T23:56:06.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:55:00+00:00, map_index=-1, run_start_date=2024-05-24 23:56:03.563454+00:00, run_end_date=2024-05-24 23:56:05.298852+00:00, run_duration=1.735398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:56:01.183037+00:00, queued_by_job_id=1, pid=4001 2024-05-24T23:57:00.029710678Z [2024-05-24T23:57:00.028+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:57:00+00:00, run_after=2024-05-24T23:58:00+00:00 2024-05-24T23:57:00.035549064Z [2024-05-24T23:57:00.035+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:57:00.046632908Z [2024-05-24T23:57:00.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:57:00+00:00, run_after=2024-05-24T23:58:00+00:00 2024-05-24T23:57:00.136263849Z [2024-05-24T23:57:00.135+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:57:00.136314980Z 2024-05-24T23:57:00.136334138Z 2024-05-24T23:57:00.136345770Z 2024-05-24T23:57:00.136356960Z [2024-05-24T23:57:00.135+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:57:00.136367515Z [2024-05-24T23:57:00.136+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:57:00.136378085Z [2024-05-24T23:57:00.136+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:57:00.136841418Z [2024-05-24T23:57:00.136+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:57:00.136897613Z 2024-05-24T23:57:00.136933205Z 2024-05-24T23:57:00.136971077Z 2024-05-24T23:57:00.140382810Z [2024-05-24T23:57:00.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:57:00.140521428Z [2024-05-24T23:57:00.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:57:00.140751931Z [2024-05-24T23:57:00.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:57:00.140851342Z [2024-05-24T23:57:00.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:57:00.141080945Z [2024-05-24T23:57:00.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:57:00.141177753Z [2024-05-24T23:57:00.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:57:00.405859827Z [2024-05-24T23:57:00.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:56:00+00:00 exited with status queued for try_number 1 2024-05-24T23:57:00.406008853Z [2024-05-24T23:57:00.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:56:00+00:00 exited with status queued for try_number 1 2024-05-24T23:57:00.406150806Z [2024-05-24T23:57:00.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:56:00+00:00 exited with status queued for try_number 1 2024-05-24T23:57:00.429901811Z [2024-05-24T23:57:00.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0c8a1b9-ed7d-4d4c-b6f6-b4c2a61e09d9 2024-05-24T23:57:00.429989221Z [2024-05-24T23:57:00.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46b076e7-a3b2-40e4-b024-f0283323dc97 2024-05-24T23:57:00.430036658Z [2024-05-24T23:57:00.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfda0ea9-bf69-4c54-91ab-57805b0e073a 2024-05-24T23:57:01.589018720Z [2024-05-24T23:57:01.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:57:01.589664873Z [2024-05-24T23:57:01.589+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:56:00+00:00, run_id=scheduled__2024-05-24T23:56:00+00:00, run_start_date=2024-05-24 23:57:00.060994+00:00, run_end_date=2024-05-24 23:57:01.589112+00:00, run_duration=1.528118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:56:00+00:00, data_interval_end=2024-05-24 23:57:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:57:01.604913233Z [2024-05-24T23:57:01.604+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:57:00+00:00, run_after=2024-05-24T23:58:00+00:00 2024-05-24T23:57:01.674786310Z [2024-05-24T23:57:01.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:56:00+00:00 exited with status success for try_number 1 2024-05-24T23:57:01.684017504Z [2024-05-24T23:57:01.683+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:56:00+00:00, map_index=-1, run_start_date=2024-05-24 23:57:00.894898+00:00, run_end_date=2024-05-24 23:57:01.252517+00:00, run_duration=0.357619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:57:00.137199+00:00, queued_by_job_id=1, pid=4039 2024-05-24T23:57:03.871782927Z [2024-05-24T23:57:03.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:57:03.872068812Z [2024-05-24T23:57:03.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:56:00+00:00, run_id=scheduled__2024-05-24T23:56:00+00:00, run_start_date=2024-05-24 23:57:00.063440+00:00, run_end_date=2024-05-24 23:57:03.871543+00:00, run_duration=3.808103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:56:00+00:00, data_interval_end=2024-05-24 23:57:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:57:03.890611843Z [2024-05-24T23:57:03.884+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:57:00+00:00, run_after=2024-05-24T23:58:00+00:00 2024-05-24T23:57:03.891846246Z [2024-05-24T23:57:03.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:57:03.892081587Z [2024-05-24T23:57:03.891+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:56:00+00:00, run_id=scheduled__2024-05-24T23:56:00+00:00, run_start_date=2024-05-24 23:57:00.065635+00:00, run_end_date=2024-05-24 23:57:03.891809+00:00, run_duration=3.826174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:56:00+00:00, data_interval_end=2024-05-24 23:57:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:57:03.902507637Z [2024-05-24T23:57:03.901+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:57:00+00:00, run_after=2024-05-24T23:58:00+00:00 2024-05-24T23:57:03.962560740Z [2024-05-24T23:57:03.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:56:00+00:00 exited with status success for try_number 1 2024-05-24T23:57:03.962739815Z [2024-05-24T23:57:03.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:56:00+00:00 exited with status success for try_number 1 2024-05-24T23:57:03.971053756Z [2024-05-24T23:57:03.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:56:00+00:00, map_index=-1, run_start_date=2024-05-24 23:57:02.011524+00:00, run_end_date=2024-05-24 23:57:03.633583+00:00, run_duration=1.622059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:57:00.137199+00:00, queued_by_job_id=1, pid=4058 2024-05-24T23:57:03.971419138Z [2024-05-24T23:57:03.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:56:00+00:00, map_index=-1, run_start_date=2024-05-24 23:57:01.910225+00:00, run_end_date=2024-05-24 23:57:03.255878+00:00, run_duration=1.345653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:57:00.137199+00:00, queued_by_job_id=1, pid=4057 2024-05-24T23:58:00.725945302Z [2024-05-24T23:58:00.725+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:58:00.754289522Z [2024-05-24T23:58:00.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:58:00+00:00, run_after=2024-05-24T23:59:00+00:00 2024-05-24T23:58:00.766081737Z [2024-05-24T23:58:00.765+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:58:00.782197242Z [2024-05-24T23:58:00.781+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:58:00+00:00, run_after=2024-05-24T23:59:00+00:00 2024-05-24T23:58:00.880226212Z [2024-05-24T23:58:00.879+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T23:58:00.880261780Z 2024-05-24T23:58:00.880270742Z 2024-05-24T23:58:00.880277834Z 2024-05-24T23:58:00.880284624Z 2024-05-24T23:58:00.880315332Z [2024-05-24T23:58:00.880+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T23:58:00.880335586Z [2024-05-24T23:58:00.880+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:58:00.880342719Z [2024-05-24T23:58:00.880+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:58:00.880432714Z [2024-05-24T23:58:00.880+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:58:00.881329217Z [2024-05-24T23:58:00.881+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:58:00.881347879Z 2024-05-24T23:58:00.881355034Z 2024-05-24T23:58:00.881361470Z 2024-05-24T23:58:00.881368009Z 2024-05-24T23:58:00.886105566Z [2024-05-24T23:58:00.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:58:00.886142996Z [2024-05-24T23:58:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:58:00.886421519Z [2024-05-24T23:58:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:58:00.886494605Z [2024-05-24T23:58:00.886+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:58:00.886754352Z [2024-05-24T23:58:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:58:00.886817930Z [2024-05-24T23:58:00.886+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:58:00.887079397Z [2024-05-24T23:58:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:58:00.887142834Z [2024-05-24T23:58:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:58:01.187283745Z [2024-05-24T23:58:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:56:00+00:00 exited with status queued for try_number 1 2024-05-24T23:58:01.187381387Z [2024-05-24T23:58:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:57:00+00:00 exited with status queued for try_number 1 2024-05-24T23:58:01.187483573Z [2024-05-24T23:58:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:57:00+00:00 exited with status queued for try_number 1 2024-05-24T23:58:01.187583371Z [2024-05-24T23:58:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:57:00+00:00 exited with status queued for try_number 1 2024-05-24T23:58:01.201066661Z [2024-05-24T23:58:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to c622b816-cd99-4ea1-ad59-8c90c15f7ba5 2024-05-24T23:58:01.201659447Z [2024-05-24T23:58:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 557c1713-35e4-401c-b260-66423eae7943 2024-05-24T23:58:01.201913128Z [2024-05-24T23:58:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9782d731-54fd-4808-8429-572536a60fc6 2024-05-24T23:58:01.202079012Z [2024-05-24T23:58:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59b4700a-654f-46d5-a53f-75816b19a1b6 2024-05-24T23:58:03.542072546Z [2024-05-24T23:58:03.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:58:03.542547987Z [2024-05-24T23:58:03.542+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:56:00+00:00, run_id=scheduled__2024-05-24T23:56:00+00:00, run_start_date=2024-05-24 23:58:00.796930+00:00, run_end_date=2024-05-24 23:58:03.541951+00:00, run_duration=2.745021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:56:00+00:00, data_interval_end=2024-05-24 23:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T23:58:03.552460674Z [2024-05-24T23:58:03.552+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T23:58:00+00:00, run_after=2024-05-25T00:00:00+00:00 2024-05-24T23:58:03.562668428Z [2024-05-24T23:58:03.562+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:58:03.564310429Z [2024-05-24T23:58:03.564+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:57:00+00:00, run_id=scheduled__2024-05-24T23:57:00+00:00, run_start_date=2024-05-24 23:58:00.799031+00:00, run_end_date=2024-05-24 23:58:03.562581+00:00, run_duration=2.76355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:57:00+00:00, data_interval_end=2024-05-24 23:58:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:58:03.581955693Z [2024-05-24T23:58:03.581+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:58:00+00:00, run_after=2024-05-24T23:59:00+00:00 2024-05-24T23:58:03.650127121Z [2024-05-24T23:58:03.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:56:00+00:00 exited with status success for try_number 1 2024-05-24T23:58:03.650257300Z [2024-05-24T23:58:03.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:57:00+00:00 exited with status success for try_number 1 2024-05-24T23:58:03.657874261Z [2024-05-24T23:58:03.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:56:00+00:00, map_index=-1, run_start_date=2024-05-24 23:58:01.808886+00:00, run_end_date=2024-05-24 23:58:02.434317+00:00, run_duration=0.625431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:58:00.882407+00:00, queued_by_job_id=1, pid=4091 2024-05-24T23:58:03.658157411Z [2024-05-24T23:58:03.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:57:00+00:00, map_index=-1, run_start_date=2024-05-24 23:58:01.923998+00:00, run_end_date=2024-05-24 23:58:02.592052+00:00, run_duration=0.668054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:58:00.882407+00:00, queued_by_job_id=1, pid=4093 2024-05-24T23:58:04.697603937Z [2024-05-24T23:58:04.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:58:04.698029814Z [2024-05-24T23:58:04.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:57:00+00:00, run_id=scheduled__2024-05-24T23:57:00+00:00, run_start_date=2024-05-24 23:58:00.800438+00:00, run_end_date=2024-05-24 23:58:04.697496+00:00, run_duration=3.897058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:57:00+00:00, data_interval_end=2024-05-24 23:58:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:58:04.709119673Z [2024-05-24T23:58:04.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:58:00+00:00, run_after=2024-05-24T23:59:00+00:00 2024-05-24T23:58:04.717762958Z [2024-05-24T23:58:04.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:58:04.718101676Z [2024-05-24T23:58:04.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:57:00+00:00, run_id=scheduled__2024-05-24T23:57:00+00:00, run_start_date=2024-05-24 23:58:00.801640+00:00, run_end_date=2024-05-24 23:58:04.717601+00:00, run_duration=3.915961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:57:00+00:00, data_interval_end=2024-05-24 23:58:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:58:04.728491061Z [2024-05-24T23:58:04.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:58:00+00:00, run_after=2024-05-24T23:59:00+00:00 2024-05-24T23:58:04.770995586Z [2024-05-24T23:58:04.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:57:00+00:00 exited with status success for try_number 1 2024-05-24T23:58:04.771300571Z [2024-05-24T23:58:04.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:57:00+00:00 exited with status success for try_number 1 2024-05-24T23:58:04.780109480Z [2024-05-24T23:58:04.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:57:00+00:00, map_index=-1, run_start_date=2024-05-24 23:58:03.222645+00:00, run_end_date=2024-05-24 23:58:04.455045+00:00, run_duration=1.2324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:58:00.882407+00:00, queued_by_job_id=1, pid=4121 2024-05-24T23:58:04.780658376Z [2024-05-24T23:58:04.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:57:00+00:00, map_index=-1, run_start_date=2024-05-24 23:58:02.862948+00:00, run_end_date=2024-05-24 23:58:04.532139+00:00, run_duration=1.669191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:58:00.882407+00:00, queued_by_job_id=1, pid=4110 2024-05-24T23:59:00.058547833Z [2024-05-24T23:59:00.057+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T23:59:00.094523770Z [2024-05-24T23:59:00.094+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:59:00+00:00, run_after=2024-05-25T00:00:00+00:00 2024-05-24T23:59:00.109691164Z [2024-05-24T23:59:00.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:59:00+00:00, run_after=2024-05-25T00:00:00+00:00 2024-05-24T23:59:00.186417117Z [2024-05-24T23:59:00.185+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T23:59:00.186496275Z 2024-05-24T23:59:00.186508862Z 2024-05-24T23:59:00.186518519Z 2024-05-24T23:59:00.186538311Z [2024-05-24T23:59:00.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:59:00.186593674Z [2024-05-24T23:59:00.186+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-24T23:59:00.186604052Z [2024-05-24T23:59:00.186+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-24T23:59:00.187118243Z [2024-05-24T23:59:00.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T23:59:00.187150971Z 2024-05-24T23:59:00.187160657Z 2024-05-24T23:59:00.187169162Z 2024-05-24T23:59:00.190833755Z [2024-05-24T23:59:00.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:59:00.190930520Z [2024-05-24T23:59:00.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:59:00.191173673Z [2024-05-24T23:59:00.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:59:00.191246373Z [2024-05-24T23:59:00.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:59:00.191447088Z [2024-05-24T23:59:00.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T23:59:00.191599716Z [2024-05-24T23:59:00.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:59:00.398303751Z [2024-05-24T23:59:00.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:58:00+00:00 exited with status queued for try_number 1 2024-05-24T23:59:00.398405090Z [2024-05-24T23:59:00.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:58:00+00:00 exited with status queued for try_number 1 2024-05-24T23:59:00.398473946Z [2024-05-24T23:59:00.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:58:00+00:00 exited with status queued for try_number 1 2024-05-24T23:59:00.404890702Z [2024-05-24T23:59:00.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to f23fb844-435e-42c0-9f58-0bee8e6081b5 2024-05-24T23:59:00.404973280Z [2024-05-24T23:59:00.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6aaeb1d1-9838-45d0-802d-193e01ff775e 2024-05-24T23:59:00.405152677Z [2024-05-24T23:59:00.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b3e2cad-a827-47ce-99db-5c8b56a95985 2024-05-24T23:59:01.475425254Z [2024-05-24T23:59:01.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:59:01.475468475Z [2024-05-24T23:59:01.475+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:58:00+00:00, run_id=scheduled__2024-05-24T23:58:00+00:00, run_start_date=2024-05-24 23:59:00.121805+00:00, run_end_date=2024-05-24 23:59:01.474999+00:00, run_duration=1.353194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:58:00+00:00, data_interval_end=2024-05-24 23:59:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-24T23:59:01.485752476Z [2024-05-24T23:59:01.485+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-24T23:59:00+00:00, run_after=2024-05-25T00:00:00+00:00 2024-05-24T23:59:01.530336437Z [2024-05-24T23:59:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:58:00+00:00 exited with status success for try_number 1 2024-05-24T23:59:01.543876465Z [2024-05-24T23:59:01.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:58:00+00:00, map_index=-1, run_start_date=2024-05-24 23:59:00.919190+00:00, run_end_date=2024-05-24 23:59:01.299024+00:00, run_duration=0.379834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:59:00.187831+00:00, queued_by_job_id=1, pid=4148 2024-05-24T23:59:03.722613166Z [2024-05-24T23:59:03.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:59:03.722737240Z [2024-05-24T23:59:03.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:58:00+00:00, run_id=scheduled__2024-05-24T23:58:00+00:00, run_start_date=2024-05-24 23:59:00.123140+00:00, run_end_date=2024-05-24 23:59:03.722413+00:00, run_duration=3.599273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:58:00+00:00, data_interval_end=2024-05-24 23:59:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-24T23:59:03.731619038Z [2024-05-24T23:59:03.731+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:59:00+00:00, run_after=2024-05-25T00:00:00+00:00 2024-05-24T23:59:03.741582320Z [2024-05-24T23:59:03.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T23:59:03.741662813Z [2024-05-24T23:59:03.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:58:00+00:00, run_id=scheduled__2024-05-24T23:58:00+00:00, run_start_date=2024-05-24 23:59:00.124273+00:00, run_end_date=2024-05-24 23:59:03.741370+00:00, run_duration=3.617097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:58:00+00:00, data_interval_end=2024-05-24 23:59:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-24T23:59:03.753820894Z [2024-05-24T23:59:03.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-24T23:59:00+00:00, run_after=2024-05-25T00:00:00+00:00 2024-05-24T23:59:03.824087930Z [2024-05-24T23:59:03.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:58:00+00:00 exited with status success for try_number 1 2024-05-24T23:59:03.829708381Z [2024-05-24T23:59:03.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:58:00+00:00, map_index=-1, run_start_date=2024-05-24 23:59:01.984297+00:00, run_end_date=2024-05-24 23:59:03.353151+00:00, run_duration=1.368854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:59:00.187831+00:00, queued_by_job_id=1, pid=4167 2024-05-24T23:59:04.930091739Z [2024-05-24T23:59:04.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:58:00+00:00 exited with status success for try_number 1 2024-05-24T23:59:04.938833096Z [2024-05-24T23:59:04.938+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:58:00+00:00, map_index=-1, run_start_date=2024-05-24 23:59:01.976837+00:00, run_end_date=2024-05-24 23:59:03.659182+00:00, run_duration=1.682345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 23:59:00.187831+00:00, queued_by_job_id=1, pid=4166 2024-05-25T00:00:00.480668586Z [2024-05-25T00:00:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:00:00+00:00, run_after=2024-05-25T00:05:00+00:00 2024-05-25T00:00:00.493185497Z [2024-05-25T00:00:00.492+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:00:00.508107044Z [2024-05-25T00:00:00.507+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:00:00+00:00, run_after=2024-05-25T00:01:00+00:00 2024-05-25T00:00:00.521784724Z [2024-05-25T00:00:00.521+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:00:00+00:00, run_after=2024-05-25T00:01:00+00:00 2024-05-25T00:00:00.530691861Z [2024-05-25T00:00:00.530+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:00:00.662408097Z [2024-05-25T00:00:00.661+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T00:00:00.662480104Z 2024-05-25T00:00:00.662490981Z 2024-05-25T00:00:00.662511059Z 2024-05-25T00:00:00.662551407Z 2024-05-25T00:00:00.662561198Z 2024-05-25T00:00:00.662596519Z [2024-05-25T00:00:00.662+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:00:00.662644897Z [2024-05-25T00:00:00.662+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:00:00.662737514Z [2024-05-25T00:00:00.662+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:00:00.662801084Z [2024-05-25T00:00:00.662+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:00:00.662886024Z [2024-05-25T00:00:00.662+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:00:00.663674967Z [2024-05-25T00:00:00.663+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:00:00.663683219Z 2024-05-25T00:00:00.663686953Z 2024-05-25T00:00:00.663690512Z 2024-05-25T00:00:00.663693626Z 2024-05-25T00:00:00.663697001Z 2024-05-25T00:00:00.669562220Z [2024-05-25T00:00:00.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T00:00:00.669690632Z [2024-05-25T00:00:00.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:00:00.669962465Z [2024-05-25T00:00:00.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:00:00.670073573Z [2024-05-25T00:00:00.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:00:00.670303532Z [2024-05-25T00:00:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:00:00.670409898Z [2024-05-25T00:00:00.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:00:00.670633498Z [2024-05-25T00:00:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:00:00.670787829Z [2024-05-25T00:00:00.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:00:00.671063732Z [2024-05-25T00:00:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:00:00.671181889Z [2024-05-25T00:00:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:00:01.265914421Z [2024-05-25T00:00:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status queued for try_number 1 2024-05-25T00:00:01.265951408Z [2024-05-25T00:00:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:58:00+00:00 exited with status queued for try_number 1 2024-05-25T00:00:01.266098872Z [2024-05-25T00:00:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:59:00+00:00 exited with status queued for try_number 1 2024-05-25T00:00:01.266217041Z [2024-05-25T00:00:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:59:00+00:00 exited with status queued for try_number 1 2024-05-25T00:00:01.266313345Z [2024-05-25T00:00:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:59:00+00:00 exited with status queued for try_number 1 2024-05-25T00:00:01.274904861Z [2024-05-25T00:00:01.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e95af48-e0dd-44ee-94e3-b6899b9227dc 2024-05-25T00:00:01.274987471Z [2024-05-25T00:00:01.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10fb08b3-421b-4a96-af99-6d5118603cb6 2024-05-25T00:00:01.275162763Z [2024-05-25T00:00:01.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16d68576-c172-446f-ac96-72a0004e5b81 2024-05-25T00:00:01.275314445Z [2024-05-25T00:00:01.275+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb401bc1-8b75-429e-b637-9e9028dedc78 2024-05-25T00:00:01.275496494Z [2024-05-25T00:00:01.275+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a7f4dd4-281e-4e93-8e1c-874e9afe8a5b 2024-05-25T00:00:02.911695454Z [2024-05-25T00:00:02.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:00:02.912923402Z [2024-05-25T00:00:02.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 23:58:00+00:00, run_id=scheduled__2024-05-24T23:58:00+00:00, run_start_date=2024-05-25 00:00:00.555162+00:00, run_end_date=2024-05-25 00:00:02.911610+00:00, run_duration=2.356448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:58:00+00:00, data_interval_end=2024-05-25 00:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:00:02.928242546Z [2024-05-25T00:00:02.927+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:00:00+00:00, run_after=2024-05-25T00:02:00+00:00 2024-05-25T00:00:02.937125249Z [2024-05-25T00:00:02.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:00:02.939820149Z [2024-05-25T00:00:02.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-24 23:59:00+00:00, run_id=scheduled__2024-05-24T23:59:00+00:00, run_start_date=2024-05-25 00:00:00.556215+00:00, run_end_date=2024-05-25 00:00:02.939378+00:00, run_duration=2.383163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:59:00+00:00, data_interval_end=2024-05-25 00:00:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:00:02.950211613Z [2024-05-25T00:00:02.949+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:00:00+00:00, run_after=2024-05-25T00:01:00+00:00 2024-05-25T00:00:02.998535245Z [2024-05-25T00:00:02.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T23:58:00+00:00 exited with status success for try_number 1 2024-05-25T00:00:02.998849065Z [2024-05-25T00:00:02.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:59:00+00:00 exited with status success for try_number 1 2024-05-25T00:00:03.009992028Z [2024-05-25T00:00:03.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:59:00+00:00, map_index=-1, run_start_date=2024-05-25 00:00:02.026243+00:00, run_end_date=2024-05-25 00:00:02.657333+00:00, run_duration=0.63109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:00:00.665125+00:00, queued_by_job_id=1, pid=4201 2024-05-25T00:00:03.010475361Z [2024-05-25T00:00:03.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T23:58:00+00:00, map_index=-1, run_start_date=2024-05-25 00:00:02.126835+00:00, run_end_date=2024-05-25 00:00:02.744779+00:00, run_duration=0.617944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:00:00.665125+00:00, queued_by_job_id=1, pid=4203 2024-05-25T00:00:04.110977064Z [2024-05-25T00:00:04.110+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:00:04.111038953Z 2024-05-25T00:00:04.111202877Z [2024-05-25T00:00:04.110+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:00:04.112790981Z [2024-05-25T00:00:04.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:00:04.112816317Z 2024-05-25T00:00:04.122930508Z [2024-05-25T00:00:04.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-24T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T00:00:04.124023467Z [2024-05-25T00:00:04.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:00:04.171229204Z [2024-05-25T00:00:04.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status queued for try_number 1 2024-05-25T00:00:04.171319502Z [2024-05-25T00:00:04.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status success for try_number 1 2024-05-25T00:00:04.176577642Z [2024-05-25T00:00:04.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cf68afe-662e-4537-b102-079c0ad81137 2024-05-25T00:00:04.176794141Z [2024-05-25T00:00:04.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T23:55:00+00:00, map_index=-1, run_start_date=2024-05-25 00:00:03.066403+00:00, run_end_date=2024-05-25 00:00:03.444790+00:00, run_duration=0.378387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:00:00.665125+00:00, queued_by_job_id=1, pid=4226 2024-05-25T00:00:05.341938365Z [2024-05-25T00:00:05.341+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:00:05.342433119Z [2024-05-25T00:00:05.342+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:59:00+00:00, run_id=scheduled__2024-05-24T23:59:00+00:00, run_start_date=2024-05-25 00:00:00.557288+00:00, run_end_date=2024-05-25 00:00:05.341821+00:00, run_duration=4.784533, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:59:00+00:00, data_interval_end=2024-05-25 00:00:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:00:05.356196965Z [2024-05-25T00:00:05.355+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:00:00+00:00, run_after=2024-05-25T00:01:00+00:00 2024-05-25T00:00:05.420057735Z [2024-05-25T00:00:05.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:59:00+00:00 exited with status success for try_number 1 2024-05-25T00:00:05.426924854Z [2024-05-25T00:00:05.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:59:00+00:00, map_index=-1, run_start_date=2024-05-25 00:00:03.226965+00:00, run_end_date=2024-05-25 00:00:04.497258+00:00, run_duration=1.270293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:00:00.665125+00:00, queued_by_job_id=1, pid=4227 2024-05-25T00:00:06.523102575Z [2024-05-25T00:00:06.518+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:00:06.523134840Z 2024-05-25T00:00:06.523140956Z [2024-05-25T00:00:06.518+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:00:06.523146642Z [2024-05-25T00:00:06.520+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:00:06.523150997Z 2024-05-25T00:00:06.530883113Z [2024-05-25T00:00:06.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-24T23:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T00:00:06.530909044Z [2024-05-25T00:00:06.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:00:06.650306144Z [2024-05-25T00:00:06.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status queued for try_number 1 2024-05-25T00:00:06.650386902Z [2024-05-25T00:00:06.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status success for try_number 1 2024-05-25T00:00:06.656912979Z [2024-05-25T00:00:06.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c2a74ca-104a-433c-8aab-d86cbff569ed 2024-05-25T00:00:06.656999265Z [2024-05-25T00:00:06.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-24T23:55:00+00:00, map_index=-1, run_start_date=2024-05-25 00:00:05.863081+00:00, run_end_date=2024-05-25 00:00:06.331609+00:00, run_duration=0.468528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:00:04.113698+00:00, queued_by_job_id=1, pid=4256 2024-05-25T00:00:07.992235944Z [2024-05-25T00:00:07.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:00:07.992624257Z [2024-05-25T00:00:07.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:59:00+00:00, run_id=scheduled__2024-05-24T23:59:00+00:00, run_start_date=2024-05-25 00:00:00.558270+00:00, run_end_date=2024-05-25 00:00:07.992295+00:00, run_duration=7.434025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:59:00+00:00, data_interval_end=2024-05-25 00:00:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:00:08.005416903Z [2024-05-25T00:00:08.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:00:00+00:00, run_after=2024-05-25T00:01:00+00:00 2024-05-25T00:00:08.061103303Z [2024-05-25T00:00:08.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T23:59:00+00:00 exited with status success for try_number 1 2024-05-25T00:00:08.066995090Z [2024-05-25T00:00:08.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T23:59:00+00:00, map_index=-1, run_start_date=2024-05-25 00:00:03.587014+00:00, run_end_date=2024-05-25 00:00:06.908751+00:00, run_duration=3.321737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:00:00.665125+00:00, queued_by_job_id=1, pid=4243 2024-05-25T00:00:09.569340737Z [2024-05-25T00:00:09.568+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:00:09.569403180Z 2024-05-25T00:00:09.569603355Z [2024-05-25T00:00:09.569+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:00:09.571473397Z [2024-05-25T00:00:09.570+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:00:09.571500685Z 2024-05-25T00:00:09.577756224Z [2024-05-25T00:00:09.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-24T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:00:09.578065729Z [2024-05-25T00:00:09.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:00:09.636280963Z [2024-05-25T00:00:09.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status queued for try_number 1 2024-05-25T00:00:09.636533726Z [2024-05-25T00:00:09.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status success for try_number 1 2024-05-25T00:00:09.642883285Z [2024-05-25T00:00:09.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4433394a-118a-4012-884c-4aab5f09bf76 2024-05-25T00:00:09.643151074Z [2024-05-25T00:00:09.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-24T23:55:00+00:00, map_index=0, run_start_date=2024-05-25 00:00:08.166699+00:00, run_end_date=2024-05-25 00:00:08.553949+00:00, run_duration=0.38725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:00:06.521438+00:00, queued_by_job_id=1, pid=4278 2024-05-25T00:00:11.840534271Z [2024-05-25T00:00:11.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:00:11.841076022Z [2024-05-25T00:00:11.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-24 23:55:00+00:00, run_id=scheduled__2024-05-24T23:55:00+00:00, run_start_date=2024-05-25 00:00:00.554018+00:00, run_end_date=2024-05-25 00:00:11.840460+00:00, run_duration=11.286442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 23:55:00+00:00, data_interval_end=2024-05-25 00:00:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T00:00:11.851473684Z [2024-05-25T00:00:11.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:00:00+00:00, run_after=2024-05-25T00:05:00+00:00 2024-05-25T00:00:11.901852129Z [2024-05-25T00:00:11.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-24T23:55:00+00:00 exited with status success for try_number 1 2024-05-25T00:00:11.908542171Z [2024-05-25T00:00:11.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-24T23:55:00+00:00, map_index=-1, run_start_date=2024-05-25 00:00:11.159650+00:00, run_end_date=2024-05-25 00:00:11.519936+00:00, run_duration=0.360286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:00:09.572551+00:00, queued_by_job_id=1, pid=4286 2024-05-25T00:00:28.009730699Z [2024-05-25T00:00:28.009+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T00:01:00.932438473Z [2024-05-25T00:01:00.931+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:01:00+00:00, run_after=2024-05-25T00:02:00+00:00 2024-05-25T00:01:00.948658857Z [2024-05-25T00:01:00.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:01:00+00:00, run_after=2024-05-25T00:02:00+00:00 2024-05-25T00:01:00.960059255Z [2024-05-25T00:01:00.959+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:01:01.041260647Z [2024-05-25T00:01:01.040+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:01:01.041329826Z 2024-05-25T00:01:01.041338556Z 2024-05-25T00:01:01.041345364Z 2024-05-25T00:01:01.041351996Z [2024-05-25T00:01:01.040+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:01:01.041358733Z [2024-05-25T00:01:01.040+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:01:01.041414307Z [2024-05-25T00:01:01.041+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:01:01.041980922Z [2024-05-25T00:01:01.041+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:01:01.042004338Z 2024-05-25T00:01:01.042010954Z 2024-05-25T00:01:01.042015884Z 2024-05-25T00:01:01.045457928Z [2024-05-25T00:01:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:01:01.045688064Z [2024-05-25T00:01:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:01:01.046153709Z [2024-05-25T00:01:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:01:01.046394176Z [2024-05-25T00:01:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:01:01.046858747Z [2024-05-25T00:01:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:01:01.046881801Z [2024-05-25T00:01:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:01:01.224761056Z [2024-05-25T00:01:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status queued for try_number 1 2024-05-25T00:01:01.224808568Z [2024-05-25T00:01:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status queued for try_number 1 2024-05-25T00:01:01.227117293Z [2024-05-25T00:01:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status queued for try_number 1 2024-05-25T00:01:01.234006440Z [2024-05-25T00:01:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27e7d970-acb5-404b-b850-10ccc47a0c80 2024-05-25T00:01:01.234157751Z [2024-05-25T00:01:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79fd9ea2-4c3f-43f6-9053-da93b35ec626 2024-05-25T00:01:01.234317565Z [2024-05-25T00:01:01.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5aab3941-ba37-4753-91b4-25d9b415624f 2024-05-25T00:01:02.860986563Z [2024-05-25T00:01:02.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:01:02.861494334Z [2024-05-25T00:01:02.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:00:00+00:00, run_id=scheduled__2024-05-25T00:00:00+00:00, run_start_date=2024-05-25 00:01:00.977535+00:00, run_end_date=2024-05-25 00:01:02.861108+00:00, run_duration=1.883573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:00:00+00:00, data_interval_end=2024-05-25 00:01:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:01:02.870226622Z [2024-05-25T00:01:02.869+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:01:00+00:00, run_after=2024-05-25T00:02:00+00:00 2024-05-25T00:01:02.912768613Z [2024-05-25T00:01:02.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status success for try_number 1 2024-05-25T00:01:02.921432321Z [2024-05-25T00:01:02.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:00:00+00:00, map_index=-1, run_start_date=2024-05-25 00:01:01.747042+00:00, run_end_date=2024-05-25 00:01:02.138622+00:00, run_duration=0.39158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:01:01.042855+00:00, queued_by_job_id=1, pid=4295 2024-05-25T00:01:05.106859517Z [2024-05-25T00:01:05.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:01:05.107339932Z [2024-05-25T00:01:05.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:00:00+00:00, run_id=scheduled__2024-05-25T00:00:00+00:00, run_start_date=2024-05-25 00:01:00.979378+00:00, run_end_date=2024-05-25 00:01:05.106653+00:00, run_duration=4.127275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:00:00+00:00, data_interval_end=2024-05-25 00:01:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:01:05.119220871Z [2024-05-25T00:01:05.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:01:00+00:00, run_after=2024-05-25T00:02:00+00:00 2024-05-25T00:01:05.127975055Z [2024-05-25T00:01:05.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:01:05.128135015Z [2024-05-25T00:01:05.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:00:00+00:00, run_id=scheduled__2024-05-25T00:00:00+00:00, run_start_date=2024-05-25 00:01:00.981180+00:00, run_end_date=2024-05-25 00:01:05.127697+00:00, run_duration=4.146517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:00:00+00:00, data_interval_end=2024-05-25 00:01:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:01:05.137372212Z [2024-05-25T00:01:05.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:01:00+00:00, run_after=2024-05-25T00:02:00+00:00 2024-05-25T00:01:05.183399621Z [2024-05-25T00:01:05.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status success for try_number 1 2024-05-25T00:01:05.183853291Z [2024-05-25T00:01:05.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status success for try_number 1 2024-05-25T00:01:05.194943925Z [2024-05-25T00:01:05.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:00:00+00:00, map_index=-1, run_start_date=2024-05-25 00:01:02.939459+00:00, run_end_date=2024-05-25 00:01:04.395868+00:00, run_duration=1.456409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:01:01.042855+00:00, queued_by_job_id=1, pid=4314 2024-05-25T00:01:05.195979686Z [2024-05-25T00:01:05.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:00:00+00:00, map_index=-1, run_start_date=2024-05-25 00:01:02.843764+00:00, run_end_date=2024-05-25 00:01:04.426307+00:00, run_duration=1.582543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:01:01.042855+00:00, queued_by_job_id=1, pid=4313 2024-05-25T00:02:00.310434706Z [2024-05-25T00:02:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:02:00+00:00, run_after=2024-05-25T00:03:00+00:00 2024-05-25T00:02:00.319868384Z [2024-05-25T00:02:00.319+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:02:00.334687046Z [2024-05-25T00:02:00.334+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:02:00+00:00, run_after=2024-05-25T00:03:00+00:00 2024-05-25T00:02:00.342305407Z [2024-05-25T00:02:00.341+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:02:00.443035023Z [2024-05-25T00:02:00.442+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:02:00.443068815Z 2024-05-25T00:02:00.443076646Z 2024-05-25T00:02:00.443083628Z 2024-05-25T00:02:00.443089767Z 2024-05-25T00:02:00.443220285Z [2024-05-25T00:02:00.442+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:02:00.443535220Z [2024-05-25T00:02:00.443+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:02:00.444468362Z [2024-05-25T00:02:00.443+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:02:00.444683473Z [2024-05-25T00:02:00.444+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:02:00.445428214Z [2024-05-25T00:02:00.445+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:02:00.445440266Z 2024-05-25T00:02:00.445447654Z 2024-05-25T00:02:00.445453763Z 2024-05-25T00:02:00.445459904Z 2024-05-25T00:02:00.450056050Z [2024-05-25T00:02:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:02:00.450130785Z [2024-05-25T00:02:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:02:00.450473422Z [2024-05-25T00:02:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:02:00.450646004Z [2024-05-25T00:02:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:02:00.450929184Z [2024-05-25T00:02:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:02:00.451123827Z [2024-05-25T00:02:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:02:00.451595312Z [2024-05-25T00:02:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:02:00.451690454Z [2024-05-25T00:02:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:02:00.800178963Z [2024-05-25T00:02:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status queued for try_number 1 2024-05-25T00:02:00.800616902Z [2024-05-25T00:02:00.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:01:00+00:00 exited with status queued for try_number 1 2024-05-25T00:02:00.801026694Z [2024-05-25T00:02:00.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:01:00+00:00 exited with status queued for try_number 1 2024-05-25T00:02:00.801418041Z [2024-05-25T00:02:00.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:01:00+00:00 exited with status queued for try_number 1 2024-05-25T00:02:00.817701680Z [2024-05-25T00:02:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a4d1d27-4e19-42ed-a6ec-f300f7a9b9e0 2024-05-25T00:02:00.817898600Z [2024-05-25T00:02:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8290c43f-4519-4df6-ab33-d53214d288f3 2024-05-25T00:02:00.818113852Z [2024-05-25T00:02:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7773adbf-363e-4dd0-b56a-7af1f78989e2 2024-05-25T00:02:00.818383446Z [2024-05-25T00:02:00.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c073de0-d579-4e50-b288-bbdfacfa3365 2024-05-25T00:02:01.981421703Z [2024-05-25T00:02:01.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:02:01.981763825Z [2024-05-25T00:02:01.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:00:00+00:00, run_id=scheduled__2024-05-25T00:00:00+00:00, run_start_date=2024-05-25 00:02:00.354761+00:00, run_end_date=2024-05-25 00:02:01.981332+00:00, run_duration=1.626571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:00:00+00:00, data_interval_end=2024-05-25 00:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:02:01.990512701Z [2024-05-25T00:02:01.990+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:02:00+00:00, run_after=2024-05-25T00:04:00+00:00 2024-05-25T00:02:01.997707344Z [2024-05-25T00:02:01.997+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:02:01.997907904Z [2024-05-25T00:02:01.997+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:01:00+00:00, run_id=scheduled__2024-05-25T00:01:00+00:00, run_start_date=2024-05-25 00:02:00.356055+00:00, run_end_date=2024-05-25 00:02:01.997631+00:00, run_duration=1.641576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:01:00+00:00, data_interval_end=2024-05-25 00:02:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:02:02.008804091Z [2024-05-25T00:02:02.008+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:02:00+00:00, run_after=2024-05-25T00:03:00+00:00 2024-05-25T00:02:02.073870914Z [2024-05-25T00:02:02.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status success for try_number 1 2024-05-25T00:02:02.082554761Z [2024-05-25T00:02:02.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:00:00+00:00, map_index=-1, run_start_date=2024-05-25 00:02:01.361998+00:00, run_end_date=2024-05-25 00:02:01.770122+00:00, run_duration=0.408124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:02:00.446468+00:00, queued_by_job_id=1, pid=4347 2024-05-25T00:02:02.429022466Z [2024-05-25T00:02:02.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:01:00+00:00 exited with status success for try_number 1 2024-05-25T00:02:02.434636523Z [2024-05-25T00:02:02.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:01:00+00:00, map_index=-1, run_start_date=2024-05-25 00:02:01.510749+00:00, run_end_date=2024-05-25 00:02:01.932264+00:00, run_duration=0.421515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:02:00.446468+00:00, queued_by_job_id=1, pid=4348 2024-05-25T00:02:04.924149288Z [2024-05-25T00:02:04.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:02:04.924358322Z [2024-05-25T00:02:04.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:01:00+00:00, run_id=scheduled__2024-05-25T00:01:00+00:00, run_start_date=2024-05-25 00:02:00.357171+00:00, run_end_date=2024-05-25 00:02:04.923920+00:00, run_duration=4.566749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:01:00+00:00, data_interval_end=2024-05-25 00:02:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:02:04.933290383Z [2024-05-25T00:02:04.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:02:00+00:00, run_after=2024-05-25T00:03:00+00:00 2024-05-25T00:02:04.947512903Z [2024-05-25T00:02:04.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:02:04.947683732Z [2024-05-25T00:02:04.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:01:00+00:00, run_id=scheduled__2024-05-25T00:01:00+00:00, run_start_date=2024-05-25 00:02:00.358354+00:00, run_end_date=2024-05-25 00:02:04.947344+00:00, run_duration=4.58899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:01:00+00:00, data_interval_end=2024-05-25 00:02:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:02:04.957924714Z [2024-05-25T00:02:04.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:02:00+00:00, run_after=2024-05-25T00:03:00+00:00 2024-05-25T00:02:04.999903812Z [2024-05-25T00:02:04.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:01:00+00:00 exited with status success for try_number 1 2024-05-25T00:02:05.000099602Z [2024-05-25T00:02:04.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:01:00+00:00 exited with status success for try_number 1 2024-05-25T00:02:05.012028775Z [2024-05-25T00:02:05.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:01:00+00:00, map_index=-1, run_start_date=2024-05-25 00:02:02.463145+00:00, run_end_date=2024-05-25 00:02:03.865490+00:00, run_duration=1.402345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:02:00.446468+00:00, queued_by_job_id=1, pid=4371 2024-05-25T00:02:05.012427951Z [2024-05-25T00:02:05.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:01:00+00:00, map_index=-1, run_start_date=2024-05-25 00:02:02.481700+00:00, run_end_date=2024-05-25 00:02:04.154288+00:00, run_duration=1.672588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:02:00.446468+00:00, queued_by_job_id=1, pid=4372 2024-05-25T00:03:00.750726591Z [2024-05-25T00:03:00.749+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:03:00+00:00, run_after=2024-05-25T00:04:00+00:00 2024-05-25T00:03:00.762765799Z [2024-05-25T00:03:00.762+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:03:00.777456017Z [2024-05-25T00:03:00.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:03:00+00:00, run_after=2024-05-25T00:04:00+00:00 2024-05-25T00:03:00.859661347Z [2024-05-25T00:03:00.859+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:03:00.859698613Z 2024-05-25T00:03:00.859706116Z 2024-05-25T00:03:00.859712420Z 2024-05-25T00:03:00.860010989Z [2024-05-25T00:03:00.859+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:03:00.860395810Z [2024-05-25T00:03:00.860+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:03:00.860728729Z [2024-05-25T00:03:00.860+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:03:00.861973785Z [2024-05-25T00:03:00.861+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:03:00.861997104Z 2024-05-25T00:03:00.862004638Z 2024-05-25T00:03:00.862011302Z 2024-05-25T00:03:00.867693866Z [2024-05-25T00:03:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:03:00.867819118Z [2024-05-25T00:03:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:03:00.868207508Z [2024-05-25T00:03:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:03:00.868478760Z [2024-05-25T00:03:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:03:00.868910553Z [2024-05-25T00:03:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:03:00.869143525Z [2024-05-25T00:03:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:03:01.105119460Z [2024-05-25T00:03:01.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:02:00+00:00 exited with status queued for try_number 1 2024-05-25T00:03:01.105285968Z [2024-05-25T00:03:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:02:00+00:00 exited with status queued for try_number 1 2024-05-25T00:03:01.105587832Z [2024-05-25T00:03:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:02:00+00:00 exited with status queued for try_number 1 2024-05-25T00:03:01.116967528Z [2024-05-25T00:03:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7db28573-4fc7-4a42-b61b-0ad0c99c1f3d 2024-05-25T00:03:01.117158965Z [2024-05-25T00:03:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe910d53-ac01-46b6-a3b6-0f1ba030d91f 2024-05-25T00:03:01.117356312Z [2024-05-25T00:03:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to c51b18b5-54ea-4947-bd38-3f4f283915c3 2024-05-25T00:03:02.339831087Z [2024-05-25T00:03:02.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:03:02.341511540Z [2024-05-25T00:03:02.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:02:00+00:00, run_id=scheduled__2024-05-25T00:02:00+00:00, run_start_date=2024-05-25 00:03:00.789388+00:00, run_end_date=2024-05-25 00:03:02.341067+00:00, run_duration=1.551679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:02:00+00:00, data_interval_end=2024-05-25 00:03:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:03:02.359128427Z [2024-05-25T00:03:02.358+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:03:00+00:00, run_after=2024-05-25T00:04:00+00:00 2024-05-25T00:03:02.423560773Z [2024-05-25T00:03:02.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:02:00+00:00 exited with status success for try_number 1 2024-05-25T00:03:02.432075767Z [2024-05-25T00:03:02.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:02:00+00:00, map_index=-1, run_start_date=2024-05-25 00:03:01.740419+00:00, run_end_date=2024-05-25 00:03:02.182807+00:00, run_duration=0.442388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:03:00.863528+00:00, queued_by_job_id=1, pid=4404 2024-05-25T00:03:04.747007873Z [2024-05-25T00:03:04.746+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:03:04.747439871Z [2024-05-25T00:03:04.747+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:02:00+00:00, run_id=scheduled__2024-05-25T00:02:00+00:00, run_start_date=2024-05-25 00:03:00.790666+00:00, run_end_date=2024-05-25 00:03:04.747037+00:00, run_duration=3.956371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:02:00+00:00, data_interval_end=2024-05-25 00:03:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:03:04.759261204Z [2024-05-25T00:03:04.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:03:00+00:00, run_after=2024-05-25T00:04:00+00:00 2024-05-25T00:03:04.798008942Z [2024-05-25T00:03:04.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:02:00+00:00 exited with status success for try_number 1 2024-05-25T00:03:04.805071266Z [2024-05-25T00:03:04.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:02:00+00:00, map_index=-1, run_start_date=2024-05-25 00:03:02.812354+00:00, run_end_date=2024-05-25 00:03:04.235885+00:00, run_duration=1.423531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:03:00.863528+00:00, queued_by_job_id=1, pid=4423 2024-05-25T00:03:05.878035534Z [2024-05-25T00:03:05.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:03:05.878370364Z [2024-05-25T00:03:05.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:02:00+00:00, run_id=scheduled__2024-05-25T00:02:00+00:00, run_start_date=2024-05-25 00:03:00.791813+00:00, run_end_date=2024-05-25 00:03:05.877766+00:00, run_duration=5.085953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:02:00+00:00, data_interval_end=2024-05-25 00:03:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:03:05.889377656Z [2024-05-25T00:03:05.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:03:00+00:00, run_after=2024-05-25T00:04:00+00:00 2024-05-25T00:03:05.932617741Z [2024-05-25T00:03:05.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:02:00+00:00 exited with status success for try_number 1 2024-05-25T00:03:05.938647761Z [2024-05-25T00:03:05.938+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:02:00+00:00, map_index=-1, run_start_date=2024-05-25 00:03:02.749677+00:00, run_end_date=2024-05-25 00:03:04.759020+00:00, run_duration=2.009343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:03:00.863528+00:00, queued_by_job_id=1, pid=4422 2024-05-25T00:04:00.761692012Z [2024-05-25T00:04:00.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:04:00+00:00, run_after=2024-05-25T00:05:00+00:00 2024-05-25T00:04:00.782624646Z [2024-05-25T00:04:00.782+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:04:00.806456658Z [2024-05-25T00:04:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:04:00+00:00, run_after=2024-05-25T00:05:00+00:00 2024-05-25T00:04:00.812756349Z [2024-05-25T00:04:00.812+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:04:00.912715839Z [2024-05-25T00:04:00.912+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:04:00.912752807Z 2024-05-25T00:04:00.912757001Z 2024-05-25T00:04:00.912760558Z 2024-05-25T00:04:00.912763596Z 2024-05-25T00:04:00.912774028Z [2024-05-25T00:04:00.912+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:04:00.912809089Z [2024-05-25T00:04:00.912+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:04:00.912886674Z [2024-05-25T00:04:00.912+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:04:00.912961237Z [2024-05-25T00:04:00.912+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:04:00.913622306Z [2024-05-25T00:04:00.913+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:04:00.913634278Z 2024-05-25T00:04:00.913653119Z 2024-05-25T00:04:00.913656585Z 2024-05-25T00:04:00.913659591Z 2024-05-25T00:04:00.916827682Z [2024-05-25T00:04:00.916+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:04:00.916913932Z [2024-05-25T00:04:00.916+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:04:00.917111833Z [2024-05-25T00:04:00.916+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:04:00.917193516Z [2024-05-25T00:04:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:04:00.917394602Z [2024-05-25T00:04:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:04:00.917477511Z [2024-05-25T00:04:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:04:00.917652389Z [2024-05-25T00:04:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:04:00.917724425Z [2024-05-25T00:04:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:04:01.327167386Z [2024-05-25T00:04:01.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:02:00+00:00 exited with status queued for try_number 1 2024-05-25T00:04:01.327218235Z [2024-05-25T00:04:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:03:00+00:00 exited with status queued for try_number 1 2024-05-25T00:04:01.327310849Z [2024-05-25T00:04:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:03:00+00:00 exited with status queued for try_number 1 2024-05-25T00:04:01.327350981Z [2024-05-25T00:04:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:03:00+00:00 exited with status queued for try_number 1 2024-05-25T00:04:01.349356142Z [2024-05-25T00:04:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bd23958-928b-4282-b998-089166b7f6f0 2024-05-25T00:04:01.349406033Z [2024-05-25T00:04:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 448ca8f0-69a8-4d67-b6fb-84059c5dee9c 2024-05-25T00:04:01.349409728Z [2024-05-25T00:04:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84fdc66a-1266-416f-b596-edbf2916a782 2024-05-25T00:04:01.349417326Z [2024-05-25T00:04:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to debe9c0b-4cbd-4372-85a5-23fb6821e707 2024-05-25T00:04:03.033391543Z [2024-05-25T00:04:03.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:04:03.033992161Z [2024-05-25T00:04:03.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:03:00+00:00, run_id=scheduled__2024-05-25T00:03:00+00:00, run_start_date=2024-05-25 00:04:00.824948+00:00, run_end_date=2024-05-25 00:04:03.033312+00:00, run_duration=2.208364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:03:00+00:00, data_interval_end=2024-05-25 00:04:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:04:03.043677828Z [2024-05-25T00:04:03.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:04:00+00:00, run_after=2024-05-25T00:05:00+00:00 2024-05-25T00:04:03.054314240Z [2024-05-25T00:04:03.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:04:03.055423685Z [2024-05-25T00:04:03.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:02:00+00:00, run_id=scheduled__2024-05-25T00:02:00+00:00, run_start_date=2024-05-25 00:04:00.823545+00:00, run_end_date=2024-05-25 00:04:03.054176+00:00, run_duration=2.230631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:02:00+00:00, data_interval_end=2024-05-25 00:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:04:03.074411517Z [2024-05-25T00:04:03.073+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:04:00+00:00, run_after=2024-05-25T00:06:00+00:00 2024-05-25T00:04:03.176879604Z [2024-05-25T00:04:03.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:02:00+00:00 exited with status success for try_number 1 2024-05-25T00:04:03.183305539Z [2024-05-25T00:04:03.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:03:00+00:00 exited with status success for try_number 1 2024-05-25T00:04:03.201392399Z [2024-05-25T00:04:03.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:02:00+00:00, map_index=-1, run_start_date=2024-05-25 00:04:01.981201+00:00, run_end_date=2024-05-25 00:04:02.587430+00:00, run_duration=0.606229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:04:00.914394+00:00, queued_by_job_id=1, pid=4456 2024-05-25T00:04:03.201636754Z [2024-05-25T00:04:03.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:03:00+00:00, map_index=-1, run_start_date=2024-05-25 00:04:02.167887+00:00, run_end_date=2024-05-25 00:04:02.772331+00:00, run_duration=0.604444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:04:00.914394+00:00, queued_by_job_id=1, pid=4457 2024-05-25T00:04:05.344488790Z [2024-05-25T00:04:05.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:04:05.345867339Z [2024-05-25T00:04:05.345+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:03:00+00:00, run_id=scheduled__2024-05-25T00:03:00+00:00, run_start_date=2024-05-25 00:04:00.826649+00:00, run_end_date=2024-05-25 00:04:05.344374+00:00, run_duration=4.517725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:03:00+00:00, data_interval_end=2024-05-25 00:04:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:04:05.368548222Z [2024-05-25T00:04:05.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:04:00+00:00, run_after=2024-05-25T00:05:00+00:00 2024-05-25T00:04:05.376839281Z [2024-05-25T00:04:05.376+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:04:05.377137910Z [2024-05-25T00:04:05.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:03:00+00:00, run_id=scheduled__2024-05-25T00:03:00+00:00, run_start_date=2024-05-25 00:04:00.828591+00:00, run_end_date=2024-05-25 00:04:05.376833+00:00, run_duration=4.548242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:03:00+00:00, data_interval_end=2024-05-25 00:04:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:04:05.386661135Z [2024-05-25T00:04:05.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:04:00+00:00, run_after=2024-05-25T00:05:00+00:00 2024-05-25T00:04:05.436145016Z [2024-05-25T00:04:05.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:03:00+00:00 exited with status success for try_number 1 2024-05-25T00:04:05.441965410Z [2024-05-25T00:04:05.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:03:00+00:00, map_index=-1, run_start_date=2024-05-25 00:04:03.595157+00:00, run_end_date=2024-05-25 00:04:05.038678+00:00, run_duration=1.443521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:04:00.914394+00:00, queued_by_job_id=1, pid=4481 2024-05-25T00:04:06.474008195Z [2024-05-25T00:04:06.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:03:00+00:00 exited with status success for try_number 1 2024-05-25T00:04:06.482804546Z [2024-05-25T00:04:06.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:03:00+00:00, map_index=-1, run_start_date=2024-05-25 00:04:03.519485+00:00, run_end_date=2024-05-25 00:04:05.281765+00:00, run_duration=1.76228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:04:00.914394+00:00, queued_by_job_id=1, pid=4480 2024-05-25T00:05:00.518291556Z [2024-05-25T00:05:00.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:05:00+00:00, run_after=2024-05-25T00:10:00+00:00 2024-05-25T00:05:00.530063451Z [2024-05-25T00:05:00.529+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:05:00.549611303Z [2024-05-25T00:05:00.549+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:05:00+00:00, run_after=2024-05-25T00:06:00+00:00 2024-05-25T00:05:00.566879339Z [2024-05-25T00:05:00.566+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:05:00+00:00, run_after=2024-05-25T00:06:00+00:00 2024-05-25T00:05:00.680592011Z [2024-05-25T00:05:00.680+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:05:00.680618854Z 2024-05-25T00:05:00.680623454Z 2024-05-25T00:05:00.680626813Z 2024-05-25T00:05:00.680630283Z 2024-05-25T00:05:00.680892340Z [2024-05-25T00:05:00.680+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:05:00.681029569Z [2024-05-25T00:05:00.680+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:05:00.681147549Z [2024-05-25T00:05:00.681+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:05:00.681370941Z [2024-05-25T00:05:00.681+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:05:00.682144395Z [2024-05-25T00:05:00.681+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:05:00.682183506Z 2024-05-25T00:05:00.682187933Z 2024-05-25T00:05:00.682191548Z 2024-05-25T00:05:00.682194856Z 2024-05-25T00:05:00.687286147Z [2024-05-25T00:05:00.686+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T00:05:00.687574940Z [2024-05-25T00:05:00.687+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:05:00.687906304Z [2024-05-25T00:05:00.687+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:05:00.688087194Z [2024-05-25T00:05:00.687+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:05:00.688355470Z [2024-05-25T00:05:00.688+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:05:00.688587862Z [2024-05-25T00:05:00.688+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:05:00.688901635Z [2024-05-25T00:05:00.688+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:05:00.689079648Z [2024-05-25T00:05:00.688+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:05:01.088013548Z [2024-05-25T00:05:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status queued for try_number 1 2024-05-25T00:05:01.088160575Z [2024-05-25T00:05:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:04:00+00:00 exited with status queued for try_number 1 2024-05-25T00:05:01.088326829Z [2024-05-25T00:05:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:04:00+00:00 exited with status queued for try_number 1 2024-05-25T00:05:01.088657403Z [2024-05-25T00:05:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:04:00+00:00 exited with status queued for try_number 1 2024-05-25T00:05:01.096846053Z [2024-05-25T00:05:01.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9145038b-d4a7-4ed2-87f4-dfc43493002b 2024-05-25T00:05:01.097064643Z [2024-05-25T00:05:01.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to b96655c7-d149-4c3e-8983-decc2e2922f5 2024-05-25T00:05:01.097355060Z [2024-05-25T00:05:01.097+0000] {scheduler_job.py:635} INFO - Setting external_id for to 259805fa-845c-44ef-bdb8-73b1f9aa2903 2024-05-25T00:05:01.097565237Z [2024-05-25T00:05:01.097+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7862fd96-47d6-4ceb-b86f-96d391837bc4 2024-05-25T00:05:03.562853400Z [2024-05-25T00:05:03.562+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:05:03.563109908Z [2024-05-25T00:05:03.562+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:04:00+00:00, run_id=scheduled__2024-05-25T00:04:00+00:00, run_start_date=2024-05-25 00:05:00.587096+00:00, run_end_date=2024-05-25 00:05:03.562793+00:00, run_duration=2.975697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:04:00+00:00, data_interval_end=2024-05-25 00:05:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:05:03.587846902Z [2024-05-25T00:05:03.585+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:05:00+00:00, run_after=2024-05-25T00:06:00+00:00 2024-05-25T00:05:03.679055332Z [2024-05-25T00:05:03.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:04:00+00:00 exited with status success for try_number 1 2024-05-25T00:05:03.686408359Z [2024-05-25T00:05:03.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:04:00+00:00, map_index=-1, run_start_date=2024-05-25 00:05:02.102991+00:00, run_end_date=2024-05-25 00:05:02.717428+00:00, run_duration=0.614437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:05:00.682959+00:00, queued_by_job_id=1, pid=4515 2024-05-25T00:05:04.733553214Z [2024-05-25T00:05:04.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:05:04.733934089Z [2024-05-25T00:05:04.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:04:00+00:00, run_id=scheduled__2024-05-25T00:04:00+00:00, run_start_date=2024-05-25 00:05:00.588565+00:00, run_end_date=2024-05-25 00:05:04.733416+00:00, run_duration=4.144851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:04:00+00:00, data_interval_end=2024-05-25 00:05:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:05:04.743077161Z [2024-05-25T00:05:04.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:05:00+00:00, run_after=2024-05-25T00:06:00+00:00 2024-05-25T00:05:04.789755351Z [2024-05-25T00:05:04.789+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:05:04.789783657Z 2024-05-25T00:05:04.791543007Z [2024-05-25T00:05:04.789+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:05:04.792726372Z [2024-05-25T00:05:04.792+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:05:04.792739390Z 2024-05-25T00:05:04.798799055Z [2024-05-25T00:05:04.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T00:05:04.799333139Z [2024-05-25T00:05:04.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:05:04.862815779Z [2024-05-25T00:05:04.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status queued for try_number 1 2024-05-25T00:05:04.864371786Z [2024-05-25T00:05:04.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status success for try_number 1 2024-05-25T00:05:04.864715241Z [2024-05-25T00:05:04.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:04:00+00:00 exited with status success for try_number 1 2024-05-25T00:05:04.875554435Z [2024-05-25T00:05:04.875+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f59451d-05f4-4a5d-9d2b-48b594f764d9 2024-05-25T00:05:04.876594526Z [2024-05-25T00:05:04.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T00:00:00+00:00, map_index=-1, run_start_date=2024-05-25 00:05:03.462899+00:00, run_end_date=2024-05-25 00:05:04.069570+00:00, run_duration=0.606671, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:05:00.682959+00:00, queued_by_job_id=1, pid=4545 2024-05-25T00:05:04.876965161Z [2024-05-25T00:05:04.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:04:00+00:00, map_index=-1, run_start_date=2024-05-25 00:05:03.348961+00:00, run_end_date=2024-05-25 00:05:04.580937+00:00, run_duration=1.231976, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:05:00.682959+00:00, queued_by_job_id=1, pid=4539 2024-05-25T00:05:04.929289099Z [2024-05-25T00:05:04.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:05:04.929447057Z [2024-05-25T00:05:04.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:04:00+00:00, run_id=scheduled__2024-05-25T00:04:00+00:00, run_start_date=2024-05-25 00:05:00.589905+00:00, run_end_date=2024-05-25 00:05:04.929046+00:00, run_duration=4.339141, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:04:00+00:00, data_interval_end=2024-05-25 00:05:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:05:04.942499878Z [2024-05-25T00:05:04.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:05:00+00:00, run_after=2024-05-25T00:06:00+00:00 2024-05-25T00:05:05.009691610Z [2024-05-25T00:05:05.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:04:00+00:00 exited with status success for try_number 1 2024-05-25T00:05:05.015714820Z [2024-05-25T00:05:05.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:04:00+00:00, map_index=-1, run_start_date=2024-05-25 00:05:03.185696+00:00, run_end_date=2024-05-25 00:05:04.790967+00:00, run_duration=1.605271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:05:00.682959+00:00, queued_by_job_id=1, pid=4538 2024-05-25T00:05:07.212760899Z [2024-05-25T00:05:07.212+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:05:07.212809522Z 2024-05-25T00:05:07.213231300Z [2024-05-25T00:05:07.212+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:05:07.214371979Z [2024-05-25T00:05:07.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:05:07.214384257Z 2024-05-25T00:05:07.221765474Z [2024-05-25T00:05:07.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T00:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T00:05:07.221964992Z [2024-05-25T00:05:07.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:05:07.294062367Z [2024-05-25T00:05:07.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status queued for try_number 1 2024-05-25T00:05:07.294330387Z [2024-05-25T00:05:07.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status success for try_number 1 2024-05-25T00:05:07.304783540Z [2024-05-25T00:05:07.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cd0f652-3fdf-4dbe-8c77-733c21b82799 2024-05-25T00:05:07.305415444Z [2024-05-25T00:05:07.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T00:00:00+00:00, map_index=-1, run_start_date=2024-05-25 00:05:06.413601+00:00, run_end_date=2024-05-25 00:05:06.809813+00:00, run_duration=0.396212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:05:04.794459+00:00, queued_by_job_id=1, pid=4573 2024-05-25T00:05:09.837543567Z [2024-05-25T00:05:09.837+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:05:09.837589372Z 2024-05-25T00:05:09.837867316Z [2024-05-25T00:05:09.837+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:05:09.838813726Z [2024-05-25T00:05:09.838+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:05:09.838828868Z 2024-05-25T00:05:09.842168778Z [2024-05-25T00:05:09.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:05:09.842726129Z [2024-05-25T00:05:09.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:05:09.895705430Z [2024-05-25T00:05:09.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status queued for try_number 1 2024-05-25T00:05:09.895948208Z [2024-05-25T00:05:09.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status success for try_number 1 2024-05-25T00:05:09.906607917Z [2024-05-25T00:05:09.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9f39871-72bf-481e-b0b7-b82fd3011137 2024-05-25T00:05:09.907071010Z [2024-05-25T00:05:09.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T00:00:00+00:00, map_index=0, run_start_date=2024-05-25 00:05:08.869270+00:00, run_end_date=2024-05-25 00:05:09.201280+00:00, run_duration=0.33201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:05:07.215096+00:00, queued_by_job_id=1, pid=4584 2024-05-25T00:05:12.268447387Z [2024-05-25T00:05:12.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:05:12.269245776Z [2024-05-25T00:05:12.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:00:00+00:00, run_id=scheduled__2024-05-25T00:00:00+00:00, run_start_date=2024-05-25 00:05:00.585654+00:00, run_end_date=2024-05-25 00:05:12.268735+00:00, run_duration=11.683081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:00:00+00:00, data_interval_end=2024-05-25 00:05:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T00:05:12.278862716Z [2024-05-25T00:05:12.278+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:05:00+00:00, run_after=2024-05-25T00:10:00+00:00 2024-05-25T00:05:12.310279031Z [2024-05-25T00:05:12.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:00:00+00:00 exited with status success for try_number 1 2024-05-25T00:05:12.323779640Z [2024-05-25T00:05:12.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T00:00:00+00:00, map_index=-1, run_start_date=2024-05-25 00:05:11.478479+00:00, run_end_date=2024-05-25 00:05:11.816634+00:00, run_duration=0.338155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:05:09.839423+00:00, queued_by_job_id=1, pid=4592 2024-05-25T00:05:28.072251624Z [2024-05-25T00:05:28.070+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T00:06:00.481826944Z [2024-05-25T00:06:00.481+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:06:00+00:00, run_after=2024-05-25T00:07:00+00:00 2024-05-25T00:06:00.491105104Z [2024-05-25T00:06:00.490+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:06:00.497399055Z [2024-05-25T00:06:00.497+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:06:00.508814481Z [2024-05-25T00:06:00.508+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:06:00+00:00, run_after=2024-05-25T00:07:00+00:00 2024-05-25T00:06:00.611116680Z [2024-05-25T00:06:00.610+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:06:00.611145728Z 2024-05-25T00:06:00.611170475Z 2024-05-25T00:06:00.611174775Z 2024-05-25T00:06:00.611178900Z 2024-05-25T00:06:00.611355507Z [2024-05-25T00:06:00.611+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:06:00.611551641Z [2024-05-25T00:06:00.611+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:06:00.611843008Z [2024-05-25T00:06:00.611+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:06:00.612063112Z [2024-05-25T00:06:00.611+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:06:00.612649425Z [2024-05-25T00:06:00.612+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:06:00.612661564Z 2024-05-25T00:06:00.612667609Z 2024-05-25T00:06:00.612671017Z 2024-05-25T00:06:00.612674310Z 2024-05-25T00:06:00.618555575Z [2024-05-25T00:06:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:06:00.618881187Z [2024-05-25T00:06:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:06:00.619345464Z [2024-05-25T00:06:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:06:00.619611178Z [2024-05-25T00:06:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:06:00.620221639Z [2024-05-25T00:06:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:06:00.620655996Z [2024-05-25T00:06:00.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:06:00.621091148Z [2024-05-25T00:06:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:06:00.621424483Z [2024-05-25T00:06:00.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:06:01.092310788Z [2024-05-25T00:06:01.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:04:00+00:00 exited with status queued for try_number 1 2024-05-25T00:06:01.092393075Z [2024-05-25T00:06:01.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status queued for try_number 1 2024-05-25T00:06:01.092399593Z [2024-05-25T00:06:01.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status queued for try_number 1 2024-05-25T00:06:01.092524650Z [2024-05-25T00:06:01.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status queued for try_number 1 2024-05-25T00:06:01.101338188Z [2024-05-25T00:06:01.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc58d7aa-f1d7-4548-8cde-3746bb0f2ec4 2024-05-25T00:06:01.101493786Z [2024-05-25T00:06:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 376e9f1d-ce11-48ea-9816-867b29b2cf5a 2024-05-25T00:06:01.101640795Z [2024-05-25T00:06:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2a6cc21-e993-4a93-8894-d40cdb571d03 2024-05-25T00:06:01.101736750Z [2024-05-25T00:06:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d8bdcfb-3cf7-489c-9fef-39655cd2b039 2024-05-25T00:06:02.695785053Z [2024-05-25T00:06:02.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:06:02.696033475Z [2024-05-25T00:06:02.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:04:00+00:00, run_id=scheduled__2024-05-25T00:04:00+00:00, run_start_date=2024-05-25 00:06:00.529162+00:00, run_end_date=2024-05-25 00:06:02.695652+00:00, run_duration=2.16649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:04:00+00:00, data_interval_end=2024-05-25 00:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:06:02.703864270Z [2024-05-25T00:06:02.703+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:06:00+00:00, run_after=2024-05-25T00:08:00+00:00 2024-05-25T00:06:02.712145840Z [2024-05-25T00:06:02.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:06:02.712637515Z [2024-05-25T00:06:02.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:05:00+00:00, run_id=scheduled__2024-05-25T00:05:00+00:00, run_start_date=2024-05-25 00:06:00.531168+00:00, run_end_date=2024-05-25 00:06:02.712086+00:00, run_duration=2.180918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:05:00+00:00, data_interval_end=2024-05-25 00:06:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:06:02.722166528Z [2024-05-25T00:06:02.721+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:06:00+00:00, run_after=2024-05-25T00:07:00+00:00 2024-05-25T00:06:02.760192640Z [2024-05-25T00:06:02.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:04:00+00:00 exited with status success for try_number 1 2024-05-25T00:06:02.760226497Z [2024-05-25T00:06:02.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status success for try_number 1 2024-05-25T00:06:02.767797343Z [2024-05-25T00:06:02.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:04:00+00:00, map_index=-1, run_start_date=2024-05-25 00:06:01.494686+00:00, run_end_date=2024-05-25 00:06:01.914129+00:00, run_duration=0.419443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:06:00.613679+00:00, queued_by_job_id=1, pid=4597 2024-05-25T00:06:02.767961474Z [2024-05-25T00:06:02.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:05:00+00:00, map_index=-1, run_start_date=2024-05-25 00:06:01.787040+00:00, run_end_date=2024-05-25 00:06:02.194530+00:00, run_duration=0.40749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:06:00.613679+00:00, queued_by_job_id=1, pid=4603 2024-05-25T00:06:05.051561165Z [2024-05-25T00:06:05.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:06:05.052142940Z [2024-05-25T00:06:05.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:05:00+00:00, run_id=scheduled__2024-05-25T00:05:00+00:00, run_start_date=2024-05-25 00:06:00.532834+00:00, run_end_date=2024-05-25 00:06:05.051689+00:00, run_duration=4.518855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:05:00+00:00, data_interval_end=2024-05-25 00:06:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:06:05.065786222Z [2024-05-25T00:06:05.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:06:00+00:00, run_after=2024-05-25T00:07:00+00:00 2024-05-25T00:06:05.112307878Z [2024-05-25T00:06:05.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status success for try_number 1 2024-05-25T00:06:05.117771643Z [2024-05-25T00:06:05.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:05:00+00:00, map_index=-1, run_start_date=2024-05-25 00:06:02.853651+00:00, run_end_date=2024-05-25 00:06:04.641196+00:00, run_duration=1.787545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:06:00.613679+00:00, queued_by_job_id=1, pid=4627 2024-05-25T00:06:06.158702909Z [2024-05-25T00:06:06.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:06:06.159306168Z [2024-05-25T00:06:06.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:05:00+00:00, run_id=scheduled__2024-05-25T00:05:00+00:00, run_start_date=2024-05-25 00:06:00.534083+00:00, run_end_date=2024-05-25 00:06:06.158631+00:00, run_duration=5.624548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:05:00+00:00, data_interval_end=2024-05-25 00:06:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:06:06.186685245Z [2024-05-25T00:06:06.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:06:00+00:00, run_after=2024-05-25T00:07:00+00:00 2024-05-25T00:06:06.227022848Z [2024-05-25T00:06:06.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status success for try_number 1 2024-05-25T00:06:06.234611773Z [2024-05-25T00:06:06.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:05:00+00:00, map_index=-1, run_start_date=2024-05-25 00:06:02.844474+00:00, run_end_date=2024-05-25 00:06:05.327487+00:00, run_duration=2.483013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:06:00.613679+00:00, queued_by_job_id=1, pid=4626 2024-05-25T00:07:00.350246888Z [2024-05-25T00:07:00.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:07:00+00:00, run_after=2024-05-25T00:08:00+00:00 2024-05-25T00:07:00.360531563Z [2024-05-25T00:07:00.360+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:07:00.375818335Z [2024-05-25T00:07:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:07:00+00:00, run_after=2024-05-25T00:08:00+00:00 2024-05-25T00:07:00.496597441Z [2024-05-25T00:07:00.495+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:07:00.496623683Z 2024-05-25T00:07:00.496632475Z 2024-05-25T00:07:00.496649370Z 2024-05-25T00:07:00.496740897Z [2024-05-25T00:07:00.496+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:07:00.496989276Z [2024-05-25T00:07:00.496+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:07:00.497173334Z [2024-05-25T00:07:00.496+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:07:00.497963466Z [2024-05-25T00:07:00.497+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:07:00.497976307Z 2024-05-25T00:07:00.497979557Z 2024-05-25T00:07:00.497982515Z 2024-05-25T00:07:00.501481568Z [2024-05-25T00:07:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:07:00.501696623Z [2024-05-25T00:07:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:07:00.501995727Z [2024-05-25T00:07:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:07:00.502148482Z [2024-05-25T00:07:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:07:00.502371119Z [2024-05-25T00:07:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:07:00.502511986Z [2024-05-25T00:07:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:07:00.737981481Z [2024-05-25T00:07:00.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:06:00+00:00 exited with status queued for try_number 1 2024-05-25T00:07:00.738196209Z [2024-05-25T00:07:00.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:06:00+00:00 exited with status queued for try_number 1 2024-05-25T00:07:00.738389010Z [2024-05-25T00:07:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:06:00+00:00 exited with status queued for try_number 1 2024-05-25T00:07:00.745237845Z [2024-05-25T00:07:00.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1d35ec8-b69e-42c0-adfe-46eb9132dd4f 2024-05-25T00:07:00.745456210Z [2024-05-25T00:07:00.745+0000] {scheduler_job.py:635} INFO - Setting external_id for to d00998d7-0a0b-4944-b6a5-b9bfb78570e6 2024-05-25T00:07:00.745731359Z [2024-05-25T00:07:00.745+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad32a5ed-3103-441b-ad25-653cb639b7d6 2024-05-25T00:07:01.913451025Z [2024-05-25T00:07:01.913+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:07:01.913813857Z [2024-05-25T00:07:01.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:06:00+00:00, run_id=scheduled__2024-05-25T00:06:00+00:00, run_start_date=2024-05-25 00:07:00.393962+00:00, run_end_date=2024-05-25 00:07:01.913373+00:00, run_duration=1.519411, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:06:00+00:00, data_interval_end=2024-05-25 00:07:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:07:01.923184761Z [2024-05-25T00:07:01.922+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:07:00+00:00, run_after=2024-05-25T00:08:00+00:00 2024-05-25T00:07:01.969151379Z [2024-05-25T00:07:01.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:06:00+00:00 exited with status success for try_number 1 2024-05-25T00:07:01.974854331Z [2024-05-25T00:07:01.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:06:00+00:00, map_index=-1, run_start_date=2024-05-25 00:07:01.328751+00:00, run_end_date=2024-05-25 00:07:01.733633+00:00, run_duration=0.404882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:07:00.498680+00:00, queued_by_job_id=1, pid=4659 2024-05-25T00:07:04.227591135Z [2024-05-25T00:07:04.226+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:07:04.230117840Z [2024-05-25T00:07:04.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:06:00+00:00, run_id=scheduled__2024-05-25T00:06:00+00:00, run_start_date=2024-05-25 00:07:00.396999+00:00, run_end_date=2024-05-25 00:07:04.227325+00:00, run_duration=3.830326, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:06:00+00:00, data_interval_end=2024-05-25 00:07:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:07:04.262305940Z [2024-05-25T00:07:04.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:07:00+00:00, run_after=2024-05-25T00:08:00+00:00 2024-05-25T00:07:04.324925846Z [2024-05-25T00:07:04.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:06:00+00:00 exited with status success for try_number 1 2024-05-25T00:07:04.333546439Z [2024-05-25T00:07:04.333+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:06:00+00:00, map_index=-1, run_start_date=2024-05-25 00:07:02.622737+00:00, run_end_date=2024-05-25 00:07:03.948856+00:00, run_duration=1.326119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:07:00.498680+00:00, queued_by_job_id=1, pid=4678 2024-05-25T00:07:05.397138627Z [2024-05-25T00:07:05.396+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:07:05.397687136Z [2024-05-25T00:07:05.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:06:00+00:00, run_id=scheduled__2024-05-25T00:06:00+00:00, run_start_date=2024-05-25 00:07:00.399605+00:00, run_end_date=2024-05-25 00:07:05.397349+00:00, run_duration=4.997744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:06:00+00:00, data_interval_end=2024-05-25 00:07:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:07:05.406445341Z [2024-05-25T00:07:05.406+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:07:00+00:00, run_after=2024-05-25T00:08:00+00:00 2024-05-25T00:07:05.442952875Z [2024-05-25T00:07:05.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:06:00+00:00 exited with status success for try_number 1 2024-05-25T00:07:05.448505653Z [2024-05-25T00:07:05.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:06:00+00:00, map_index=-1, run_start_date=2024-05-25 00:07:02.566381+00:00, run_end_date=2024-05-25 00:07:04.270899+00:00, run_duration=1.704518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:07:00.498680+00:00, queued_by_job_id=1, pid=4677 2024-05-25T00:08:00.182080245Z [2024-05-25T00:08:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:08:00+00:00, run_after=2024-05-25T00:09:00+00:00 2024-05-25T00:08:00.209361424Z [2024-05-25T00:08:00.209+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:08:00+00:00, run_after=2024-05-25T00:09:00+00:00 2024-05-25T00:08:00.218033537Z [2024-05-25T00:08:00.217+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:08:00.224800834Z [2024-05-25T00:08:00.224+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:08:00.304553645Z [2024-05-25T00:08:00.304+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:08:00.304585037Z 2024-05-25T00:08:00.304591212Z 2024-05-25T00:08:00.304596843Z 2024-05-25T00:08:00.304601930Z 2024-05-25T00:08:00.304621143Z [2024-05-25T00:08:00.304+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:08:00.304662074Z [2024-05-25T00:08:00.304+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:08:00.304870385Z [2024-05-25T00:08:00.304+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:08:00.304929141Z [2024-05-25T00:08:00.304+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:08:00.305506834Z [2024-05-25T00:08:00.305+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:08:00.305522880Z 2024-05-25T00:08:00.305528191Z 2024-05-25T00:08:00.305533197Z 2024-05-25T00:08:00.305537774Z 2024-05-25T00:08:00.308656497Z [2024-05-25T00:08:00.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:08:00.308717039Z [2024-05-25T00:08:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:08:00.308935718Z [2024-05-25T00:08:00.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:08:00.308994785Z [2024-05-25T00:08:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:08:00.309176928Z [2024-05-25T00:08:00.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:08:00.309305179Z [2024-05-25T00:08:00.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:08:00.309432915Z [2024-05-25T00:08:00.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:08:00.309497017Z [2024-05-25T00:08:00.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:08:00.628997235Z [2024-05-25T00:08:00.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:06:00+00:00 exited with status queued for try_number 1 2024-05-25T00:08:00.629186261Z [2024-05-25T00:08:00.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:07:00+00:00 exited with status queued for try_number 1 2024-05-25T00:08:00.629566482Z [2024-05-25T00:08:00.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:07:00+00:00 exited with status queued for try_number 1 2024-05-25T00:08:00.629757546Z [2024-05-25T00:08:00.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:07:00+00:00 exited with status queued for try_number 1 2024-05-25T00:08:00.639884028Z [2024-05-25T00:08:00.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b501a44-4232-4d08-b867-adf9e1bc66c2 2024-05-25T00:08:00.640274422Z [2024-05-25T00:08:00.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea94ffab-ddfe-4ab9-b95b-024f53c24044 2024-05-25T00:08:00.640519741Z [2024-05-25T00:08:00.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0cbe1e9-3dd5-4127-8a41-53f73c6d824e 2024-05-25T00:08:00.640772963Z [2024-05-25T00:08:00.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f533f03-26bc-495d-a05f-659996c36703 2024-05-25T00:08:02.496381172Z [2024-05-25T00:08:02.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:08:02.497632288Z [2024-05-25T00:08:02.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:06:00+00:00, run_id=scheduled__2024-05-25T00:06:00+00:00, run_start_date=2024-05-25 00:08:00.234896+00:00, run_end_date=2024-05-25 00:08:02.496547+00:00, run_duration=2.261651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:06:00+00:00, data_interval_end=2024-05-25 00:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:08:02.504746655Z [2024-05-25T00:08:02.504+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:08:00+00:00, run_after=2024-05-25T00:10:00+00:00 2024-05-25T00:08:02.634171646Z [2024-05-25T00:08:02.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:06:00+00:00 exited with status success for try_number 1 2024-05-25T00:08:02.647025970Z [2024-05-25T00:08:02.646+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:06:00+00:00, map_index=-1, run_start_date=2024-05-25 00:08:01.441605+00:00, run_end_date=2024-05-25 00:08:02.149282+00:00, run_duration=0.707677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:08:00.306264+00:00, queued_by_job_id=1, pid=4711 2024-05-25T00:08:03.707077380Z [2024-05-25T00:08:03.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:08:03.707391943Z [2024-05-25T00:08:03.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:07:00+00:00, run_id=scheduled__2024-05-25T00:07:00+00:00, run_start_date=2024-05-25 00:08:00.236070+00:00, run_end_date=2024-05-25 00:08:03.706958+00:00, run_duration=3.470888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:07:00+00:00, data_interval_end=2024-05-25 00:08:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:08:03.716194262Z [2024-05-25T00:08:03.715+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:08:00+00:00, run_after=2024-05-25T00:09:00+00:00 2024-05-25T00:08:03.767805073Z [2024-05-25T00:08:03.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:07:00+00:00 exited with status success for try_number 1 2024-05-25T00:08:03.777572502Z [2024-05-25T00:08:03.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:07:00+00:00, map_index=-1, run_start_date=2024-05-25 00:08:01.705740+00:00, run_end_date=2024-05-25 00:08:02.554322+00:00, run_duration=0.848582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:08:00.306264+00:00, queued_by_job_id=1, pid=4713 2024-05-25T00:08:04.538320355Z [2024-05-25T00:08:04.537+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:08:04.538612292Z [2024-05-25T00:08:04.538+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:07:00+00:00, run_id=scheduled__2024-05-25T00:07:00+00:00, run_start_date=2024-05-25 00:08:00.237089+00:00, run_end_date=2024-05-25 00:08:04.538252+00:00, run_duration=4.301163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:07:00+00:00, data_interval_end=2024-05-25 00:08:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:08:04.550957872Z [2024-05-25T00:08:04.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:08:00+00:00, run_after=2024-05-25T00:09:00+00:00 2024-05-25T00:08:05.674690608Z [2024-05-25T00:08:05.674+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:08:05.675278189Z [2024-05-25T00:08:05.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:07:00+00:00, run_id=scheduled__2024-05-25T00:07:00+00:00, run_start_date=2024-05-25 00:08:00.241275+00:00, run_end_date=2024-05-25 00:08:05.674602+00:00, run_duration=5.433327, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:07:00+00:00, data_interval_end=2024-05-25 00:08:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:08:05.694406889Z [2024-05-25T00:08:05.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:08:00+00:00, run_after=2024-05-25T00:09:00+00:00 2024-05-25T00:08:05.721837857Z [2024-05-25T00:08:05.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:07:00+00:00 exited with status success for try_number 1 2024-05-25T00:08:05.722026900Z [2024-05-25T00:08:05.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:07:00+00:00 exited with status success for try_number 1 2024-05-25T00:08:05.729380327Z [2024-05-25T00:08:05.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:07:00+00:00, map_index=-1, run_start_date=2024-05-25 00:08:03.073408+00:00, run_end_date=2024-05-25 00:08:04.501249+00:00, run_duration=1.427841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:08:00.306264+00:00, queued_by_job_id=1, pid=4735 2024-05-25T00:08:05.729750275Z [2024-05-25T00:08:05.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:07:00+00:00, map_index=-1, run_start_date=2024-05-25 00:08:03.108092+00:00, run_end_date=2024-05-25 00:08:05.338108+00:00, run_duration=2.230016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:08:00.306264+00:00, queued_by_job_id=1, pid=4736 2024-05-25T00:09:00.848742461Z [2024-05-25T00:09:00.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:09:00+00:00, run_after=2024-05-25T00:10:00+00:00 2024-05-25T00:09:00.859238468Z [2024-05-25T00:09:00.858+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:09:00.874907786Z [2024-05-25T00:09:00.874+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:09:00+00:00, run_after=2024-05-25T00:10:00+00:00 2024-05-25T00:09:00.966856460Z [2024-05-25T00:09:00.966+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:09:00.966996427Z 2024-05-25T00:09:00.967007528Z 2024-05-25T00:09:00.967016250Z 2024-05-25T00:09:00.967078374Z [2024-05-25T00:09:00.966+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:09:00.967553531Z [2024-05-25T00:09:00.967+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:09:00.967980682Z [2024-05-25T00:09:00.967+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:09:00.969700624Z [2024-05-25T00:09:00.969+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:09:00.969752468Z 2024-05-25T00:09:00.969764603Z 2024-05-25T00:09:00.969774651Z 2024-05-25T00:09:00.977969562Z [2024-05-25T00:09:00.976+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:09:00.978245902Z [2024-05-25T00:09:00.977+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:09:00.978771061Z [2024-05-25T00:09:00.978+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:09:00.978928934Z [2024-05-25T00:09:00.978+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:09:00.979227394Z [2024-05-25T00:09:00.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:09:00.979332450Z [2024-05-25T00:09:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:09:01.235019668Z [2024-05-25T00:09:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:08:00+00:00 exited with status queued for try_number 1 2024-05-25T00:09:01.235466822Z [2024-05-25T00:09:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:08:00+00:00 exited with status queued for try_number 1 2024-05-25T00:09:01.235827412Z [2024-05-25T00:09:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:08:00+00:00 exited with status queued for try_number 1 2024-05-25T00:09:01.246478704Z [2024-05-25T00:09:01.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to f56a32ee-09d4-4bda-968b-df3b3d6092bf 2024-05-25T00:09:01.246864360Z [2024-05-25T00:09:01.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa934c74-f8ae-4826-880e-8c2ffbf61753 2024-05-25T00:09:01.247234962Z [2024-05-25T00:09:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to b32330fa-9367-4e1a-bc62-8769ecffb872 2024-05-25T00:09:02.800394828Z [2024-05-25T00:09:02.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:09:02.801599933Z [2024-05-25T00:09:02.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:08:00+00:00, run_id=scheduled__2024-05-25T00:08:00+00:00, run_start_date=2024-05-25 00:09:00.888204+00:00, run_end_date=2024-05-25 00:09:02.800923+00:00, run_duration=1.912719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:08:00+00:00, data_interval_end=2024-05-25 00:09:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:09:02.813932506Z [2024-05-25T00:09:02.813+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:09:00+00:00, run_after=2024-05-25T00:10:00+00:00 2024-05-25T00:09:02.882463862Z [2024-05-25T00:09:02.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:08:00+00:00 exited with status success for try_number 1 2024-05-25T00:09:02.887930316Z [2024-05-25T00:09:02.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:08:00+00:00, map_index=-1, run_start_date=2024-05-25 00:09:01.896760+00:00, run_end_date=2024-05-25 00:09:02.394182+00:00, run_duration=0.497422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:09:00.971838+00:00, queued_by_job_id=1, pid=4768 2024-05-25T00:09:06.045300610Z [2024-05-25T00:09:06.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:09:06.045327258Z [2024-05-25T00:09:06.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:08:00+00:00, run_id=scheduled__2024-05-25T00:08:00+00:00, run_start_date=2024-05-25 00:09:00.889792+00:00, run_end_date=2024-05-25 00:09:06.044502+00:00, run_duration=5.15471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:08:00+00:00, data_interval_end=2024-05-25 00:09:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:09:06.058444460Z [2024-05-25T00:09:06.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:09:00+00:00, run_after=2024-05-25T00:10:00+00:00 2024-05-25T00:09:06.120370440Z [2024-05-25T00:09:06.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:08:00+00:00 exited with status success for try_number 1 2024-05-25T00:09:06.125045286Z [2024-05-25T00:09:06.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:08:00+00:00, map_index=-1, run_start_date=2024-05-25 00:09:02.881407+00:00, run_end_date=2024-05-25 00:09:05.340931+00:00, run_duration=2.459524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:09:00.971838+00:00, queued_by_job_id=1, pid=4786 2024-05-25T00:09:06.793866320Z [2024-05-25T00:09:06.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:09:06.794199323Z [2024-05-25T00:09:06.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:08:00+00:00, run_id=scheduled__2024-05-25T00:08:00+00:00, run_start_date=2024-05-25 00:09:00.891090+00:00, run_end_date=2024-05-25 00:09:06.793733+00:00, run_duration=5.902643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:08:00+00:00, data_interval_end=2024-05-25 00:09:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:09:06.803998990Z [2024-05-25T00:09:06.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:09:00+00:00, run_after=2024-05-25T00:10:00+00:00 2024-05-25T00:09:06.855139602Z [2024-05-25T00:09:06.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:08:00+00:00 exited with status success for try_number 1 2024-05-25T00:09:06.863008381Z [2024-05-25T00:09:06.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:08:00+00:00, map_index=-1, run_start_date=2024-05-25 00:09:02.961671+00:00, run_end_date=2024-05-25 00:09:06.182289+00:00, run_duration=3.220618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:09:00.971838+00:00, queued_by_job_id=1, pid=4787 2024-05-25T00:10:00.836916093Z [2024-05-25T00:10:00.836+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:10:00.852814499Z [2024-05-25T00:10:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:10:00+00:00, run_after=2024-05-25T00:15:00+00:00 2024-05-25T00:10:00.865628496Z [2024-05-25T00:10:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:10:00+00:00, run_after=2024-05-25T00:11:00+00:00 2024-05-25T00:10:00.879733966Z [2024-05-25T00:10:00.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:10:00+00:00, run_after=2024-05-25T00:11:00+00:00 2024-05-25T00:10:00.887197300Z [2024-05-25T00:10:00.886+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:10:00.979190519Z [2024-05-25T00:10:00.978+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T00:10:00.979217698Z 2024-05-25T00:10:00.979221569Z 2024-05-25T00:10:00.979225591Z 2024-05-25T00:10:00.979260025Z 2024-05-25T00:10:00.979265561Z 2024-05-25T00:10:00.979277195Z [2024-05-25T00:10:00.979+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:10:00.979456815Z [2024-05-25T00:10:00.979+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:10:00.979575212Z [2024-05-25T00:10:00.979+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:10:00.979731111Z [2024-05-25T00:10:00.979+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:10:00.979896508Z [2024-05-25T00:10:00.979+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:10:00.980545655Z [2024-05-25T00:10:00.980+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:10:00.980554499Z 2024-05-25T00:10:00.980559294Z 2024-05-25T00:10:00.980563006Z 2024-05-25T00:10:00.980566441Z 2024-05-25T00:10:00.980584633Z 2024-05-25T00:10:00.990664900Z [2024-05-25T00:10:00.990+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T00:10:00.990818112Z [2024-05-25T00:10:00.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:10:00.991118156Z [2024-05-25T00:10:00.990+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:10:00.991227657Z [2024-05-25T00:10:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:10:00.991578236Z [2024-05-25T00:10:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:10:00.991589774Z [2024-05-25T00:10:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:10:00.991927116Z [2024-05-25T00:10:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:10:00.992072005Z [2024-05-25T00:10:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:10:00.992306249Z [2024-05-25T00:10:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:10:00.992402083Z [2024-05-25T00:10:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:10:01.589129770Z [2024-05-25T00:10:01.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status queued for try_number 1 2024-05-25T00:10:01.589236755Z [2024-05-25T00:10:01.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:08:00+00:00 exited with status queued for try_number 1 2024-05-25T00:10:01.589384509Z [2024-05-25T00:10:01.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:09:00+00:00 exited with status queued for try_number 1 2024-05-25T00:10:01.590397370Z [2024-05-25T00:10:01.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:09:00+00:00 exited with status queued for try_number 1 2024-05-25T00:10:01.590476532Z [2024-05-25T00:10:01.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:09:00+00:00 exited with status queued for try_number 1 2024-05-25T00:10:01.603043320Z [2024-05-25T00:10:01.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to c39d0430-b360-4fde-8f1f-14f2162c3a8c 2024-05-25T00:10:01.603392818Z [2024-05-25T00:10:01.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to d68cfe0a-b690-4a85-8282-df5032d14345 2024-05-25T00:10:01.603670738Z [2024-05-25T00:10:01.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to edd94038-edd4-40e3-b928-c634dd030711 2024-05-25T00:10:01.603945838Z [2024-05-25T00:10:01.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5ed9f0c-21d5-456d-8548-a93eab6f8381 2024-05-25T00:10:01.604209071Z [2024-05-25T00:10:01.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3321333-2ada-438c-842c-07308faff2ee 2024-05-25T00:10:03.714539384Z [2024-05-25T00:10:03.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:10:03.715827380Z [2024-05-25T00:10:03.715+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:08:00+00:00, run_id=scheduled__2024-05-25T00:08:00+00:00, run_start_date=2024-05-25 00:10:00.906903+00:00, run_end_date=2024-05-25 00:10:03.715331+00:00, run_duration=2.808428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:08:00+00:00, data_interval_end=2024-05-25 00:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:10:03.759613834Z [2024-05-25T00:10:03.759+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:10:00+00:00, run_after=2024-05-25T00:12:00+00:00 2024-05-25T00:10:03.777433785Z [2024-05-25T00:10:03.776+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:10:03.777718245Z [2024-05-25T00:10:03.777+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:09:00+00:00, run_id=scheduled__2024-05-25T00:09:00+00:00, run_start_date=2024-05-25 00:10:00.908013+00:00, run_end_date=2024-05-25 00:10:03.777374+00:00, run_duration=2.869361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:09:00+00:00, data_interval_end=2024-05-25 00:10:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:10:03.792561499Z [2024-05-25T00:10:03.792+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:10:00+00:00, run_after=2024-05-25T00:11:00+00:00 2024-05-25T00:10:03.908418507Z [2024-05-25T00:10:03.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:08:00+00:00 exited with status success for try_number 1 2024-05-25T00:10:03.908807984Z [2024-05-25T00:10:03.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:09:00+00:00 exited with status success for try_number 1 2024-05-25T00:10:03.938217572Z [2024-05-25T00:10:03.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:08:00+00:00, map_index=-1, run_start_date=2024-05-25 00:10:02.445373+00:00, run_end_date=2024-05-25 00:10:02.897544+00:00, run_duration=0.452171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:10:00.985641+00:00, queued_by_job_id=1, pid=4821 2024-05-25T00:10:03.940795527Z [2024-05-25T00:10:03.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:09:00+00:00, map_index=-1, run_start_date=2024-05-25 00:10:02.565060+00:00, run_end_date=2024-05-25 00:10:03.123969+00:00, run_duration=0.558909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:10:00.985641+00:00, queued_by_job_id=1, pid=4822 2024-05-25T00:10:05.090386812Z [2024-05-25T00:10:05.090+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:10:05.090412436Z 2024-05-25T00:10:05.090648977Z [2024-05-25T00:10:05.090+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:10:05.091147769Z [2024-05-25T00:10:05.090+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:10:05.091156880Z 2024-05-25T00:10:05.110158784Z [2024-05-25T00:10:05.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T00:10:05.110200425Z [2024-05-25T00:10:05.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:10:05.161811639Z [2024-05-25T00:10:05.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status queued for try_number 1 2024-05-25T00:10:05.161890922Z [2024-05-25T00:10:05.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status success for try_number 1 2024-05-25T00:10:05.168243236Z [2024-05-25T00:10:05.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to 723eb287-a466-4b16-9c63-b87a70a2895a 2024-05-25T00:10:05.168981249Z [2024-05-25T00:10:05.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T00:05:00+00:00, map_index=-1, run_start_date=2024-05-25 00:10:04.586163+00:00, run_end_date=2024-05-25 00:10:04.946313+00:00, run_duration=0.36015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:10:00.985641+00:00, queued_by_job_id=1, pid=4852 2024-05-25T00:10:06.350490114Z [2024-05-25T00:10:06.349+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:10:06.350937811Z [2024-05-25T00:10:06.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:09:00+00:00, run_id=scheduled__2024-05-25T00:09:00+00:00, run_start_date=2024-05-25 00:10:00.909168+00:00, run_end_date=2024-05-25 00:10:06.350390+00:00, run_duration=5.441222, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:09:00+00:00, data_interval_end=2024-05-25 00:10:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:10:06.361191040Z [2024-05-25T00:10:06.360+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:10:00+00:00, run_after=2024-05-25T00:11:00+00:00 2024-05-25T00:10:06.368054690Z [2024-05-25T00:10:06.367+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:10:06.368498164Z [2024-05-25T00:10:06.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:09:00+00:00, run_id=scheduled__2024-05-25T00:09:00+00:00, run_start_date=2024-05-25 00:10:00.910308+00:00, run_end_date=2024-05-25 00:10:06.367958+00:00, run_duration=5.45765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:09:00+00:00, data_interval_end=2024-05-25 00:10:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:10:06.378235086Z [2024-05-25T00:10:06.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:10:00+00:00, run_after=2024-05-25T00:11:00+00:00 2024-05-25T00:10:06.431851753Z [2024-05-25T00:10:06.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:09:00+00:00 exited with status success for try_number 1 2024-05-25T00:10:06.432252594Z [2024-05-25T00:10:06.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:09:00+00:00 exited with status success for try_number 1 2024-05-25T00:10:06.438006206Z [2024-05-25T00:10:06.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:09:00+00:00, map_index=-1, run_start_date=2024-05-25 00:10:04.657779+00:00, run_end_date=2024-05-25 00:10:05.913809+00:00, run_duration=1.25603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:10:00.985641+00:00, queued_by_job_id=1, pid=4853 2024-05-25T00:10:06.438374907Z [2024-05-25T00:10:06.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:09:00+00:00, map_index=-1, run_start_date=2024-05-25 00:10:04.535836+00:00, run_end_date=2024-05-25 00:10:06.104431+00:00, run_duration=1.568595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:10:00.985641+00:00, queued_by_job_id=1, pid=4851 2024-05-25T00:10:07.495225408Z [2024-05-25T00:10:07.494+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:10:07.495269901Z 2024-05-25T00:10:07.495294213Z [2024-05-25T00:10:07.495+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:10:07.496489470Z [2024-05-25T00:10:07.496+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:10:07.496516793Z 2024-05-25T00:10:07.500321321Z [2024-05-25T00:10:07.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T00:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T00:10:07.500435130Z [2024-05-25T00:10:07.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:10:07.557293190Z [2024-05-25T00:10:07.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status queued for try_number 1 2024-05-25T00:10:07.557421698Z [2024-05-25T00:10:07.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status success for try_number 1 2024-05-25T00:10:07.563124074Z [2024-05-25T00:10:07.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8514614-ce5a-4b66-9a8d-af13684c0ea0 2024-05-25T00:10:07.563239547Z [2024-05-25T00:10:07.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T00:05:00+00:00, map_index=-1, run_start_date=2024-05-25 00:10:06.890858+00:00, run_end_date=2024-05-25 00:10:07.307490+00:00, run_duration=0.416632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:10:05.091710+00:00, queued_by_job_id=1, pid=4887 2024-05-25T00:10:10.247141636Z [2024-05-25T00:10:10.246+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:10:10.247180660Z 2024-05-25T00:10:10.247205663Z [2024-05-25T00:10:10.246+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:10:10.248561504Z [2024-05-25T00:10:10.248+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:10:10.248580022Z 2024-05-25T00:10:10.255840019Z [2024-05-25T00:10:10.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:10:10.256204853Z [2024-05-25T00:10:10.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:10:10.327263267Z [2024-05-25T00:10:10.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status queued for try_number 1 2024-05-25T00:10:10.327544017Z [2024-05-25T00:10:10.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status success for try_number 1 2024-05-25T00:10:10.334625090Z [2024-05-25T00:10:10.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b381fdd-20e4-4290-b427-8c3d7ab9e1f7 2024-05-25T00:10:10.335277049Z [2024-05-25T00:10:10.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T00:05:00+00:00, map_index=0, run_start_date=2024-05-25 00:10:09.234482+00:00, run_end_date=2024-05-25 00:10:09.565018+00:00, run_duration=0.330536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:10:07.496902+00:00, queued_by_job_id=1, pid=4898 2024-05-25T00:10:12.606695549Z [2024-05-25T00:10:12.605+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:10:12.607238553Z [2024-05-25T00:10:12.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:05:00+00:00, run_id=scheduled__2024-05-25T00:05:00+00:00, run_start_date=2024-05-25 00:10:00.905228+00:00, run_end_date=2024-05-25 00:10:12.606468+00:00, run_duration=11.70124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:05:00+00:00, data_interval_end=2024-05-25 00:10:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T00:10:12.617855567Z [2024-05-25T00:10:12.617+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:10:00+00:00, run_after=2024-05-25T00:15:00+00:00 2024-05-25T00:10:12.676692192Z [2024-05-25T00:10:12.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:05:00+00:00 exited with status success for try_number 1 2024-05-25T00:10:12.684654486Z [2024-05-25T00:10:12.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T00:05:00+00:00, map_index=-1, run_start_date=2024-05-25 00:10:11.804286+00:00, run_end_date=2024-05-25 00:10:12.122517+00:00, run_duration=0.318231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:10:10.249416+00:00, queued_by_job_id=1, pid=4906 2024-05-25T00:10:28.138292299Z [2024-05-25T00:10:28.137+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T00:11:01.045379149Z [2024-05-25T00:11:01.044+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:11:00+00:00, run_after=2024-05-25T00:12:00+00:00 2024-05-25T00:11:01.067174655Z [2024-05-25T00:11:01.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:11:00+00:00, run_after=2024-05-25T00:12:00+00:00 2024-05-25T00:11:01.077774000Z [2024-05-25T00:11:01.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:11:01.168800854Z [2024-05-25T00:11:01.168+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:11:01.168848906Z 2024-05-25T00:11:01.168868272Z 2024-05-25T00:11:01.168877426Z 2024-05-25T00:11:01.169060191Z [2024-05-25T00:11:01.168+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:11:01.169466545Z [2024-05-25T00:11:01.169+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:11:01.169764233Z [2024-05-25T00:11:01.169+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:11:01.170561166Z [2024-05-25T00:11:01.170+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:11:01.170578439Z 2024-05-25T00:11:01.170587550Z 2024-05-25T00:11:01.170596322Z 2024-05-25T00:11:01.174867905Z [2024-05-25T00:11:01.174+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:11:01.175117535Z [2024-05-25T00:11:01.174+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:11:01.175463785Z [2024-05-25T00:11:01.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:11:01.175667190Z [2024-05-25T00:11:01.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:11:01.176003608Z [2024-05-25T00:11:01.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:11:01.176173283Z [2024-05-25T00:11:01.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:11:01.422119392Z [2024-05-25T00:11:01.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status queued for try_number 1 2024-05-25T00:11:01.429634268Z [2024-05-25T00:11:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status queued for try_number 1 2024-05-25T00:11:01.429757443Z [2024-05-25T00:11:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status queued for try_number 1 2024-05-25T00:11:01.440462234Z [2024-05-25T00:11:01.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78a9126c-d704-4451-86ce-a000751a8ce8 2024-05-25T00:11:01.440827535Z [2024-05-25T00:11:01.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to df74170b-ef10-4f21-9f43-36ca28361634 2024-05-25T00:11:01.441049697Z [2024-05-25T00:11:01.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60fc43c0-5d5a-446e-9f71-3e354d205c8d 2024-05-25T00:11:02.584694740Z [2024-05-25T00:11:02.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:11:02.585024621Z [2024-05-25T00:11:02.584+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:10:00+00:00, run_id=scheduled__2024-05-25T00:10:00+00:00, run_start_date=2024-05-25 00:11:01.093449+00:00, run_end_date=2024-05-25 00:11:02.584698+00:00, run_duration=1.491249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:10:00+00:00, data_interval_end=2024-05-25 00:11:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:11:02.593583713Z [2024-05-25T00:11:02.593+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:11:00+00:00, run_after=2024-05-25T00:12:00+00:00 2024-05-25T00:11:02.636879722Z [2024-05-25T00:11:02.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status success for try_number 1 2024-05-25T00:11:02.641713032Z [2024-05-25T00:11:02.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:10:00+00:00, map_index=-1, run_start_date=2024-05-25 00:11:02.006988+00:00, run_end_date=2024-05-25 00:11:02.444784+00:00, run_duration=0.437796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:11:01.171400+00:00, queued_by_job_id=1, pid=4915 2024-05-25T00:11:05.505898869Z [2024-05-25T00:11:05.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:11:05.506115661Z [2024-05-25T00:11:05.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:10:00+00:00, run_id=scheduled__2024-05-25T00:10:00+00:00, run_start_date=2024-05-25 00:11:01.095025+00:00, run_end_date=2024-05-25 00:11:05.505728+00:00, run_duration=4.410703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:10:00+00:00, data_interval_end=2024-05-25 00:11:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:11:05.517011867Z [2024-05-25T00:11:05.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:11:00+00:00, run_after=2024-05-25T00:12:00+00:00 2024-05-25T00:11:05.524209607Z [2024-05-25T00:11:05.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:11:05.524289679Z [2024-05-25T00:11:05.524+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:10:00+00:00, run_id=scheduled__2024-05-25T00:10:00+00:00, run_start_date=2024-05-25 00:11:01.096423+00:00, run_end_date=2024-05-25 00:11:05.524032+00:00, run_duration=4.427609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:10:00+00:00, data_interval_end=2024-05-25 00:11:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:11:05.534019718Z [2024-05-25T00:11:05.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:11:00+00:00, run_after=2024-05-25T00:12:00+00:00 2024-05-25T00:11:05.577159064Z [2024-05-25T00:11:05.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status success for try_number 1 2024-05-25T00:11:05.577521629Z [2024-05-25T00:11:05.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status success for try_number 1 2024-05-25T00:11:05.588160582Z [2024-05-25T00:11:05.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:10:00+00:00, map_index=-1, run_start_date=2024-05-25 00:11:03.136682+00:00, run_end_date=2024-05-25 00:11:04.936392+00:00, run_duration=1.79971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:11:01.171400+00:00, queued_by_job_id=1, pid=4934 2024-05-25T00:11:05.588261998Z [2024-05-25T00:11:05.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:10:00+00:00, map_index=-1, run_start_date=2024-05-25 00:11:03.027896+00:00, run_end_date=2024-05-25 00:11:05.309103+00:00, run_duration=2.281207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:11:01.171400+00:00, queued_by_job_id=1, pid=4933 2024-05-25T00:12:00.948773457Z [2024-05-25T00:12:00.948+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:12:00.964145342Z [2024-05-25T00:12:00.963+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:12:00.983396607Z [2024-05-25T00:12:00.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:12:00+00:00, run_after=2024-05-25T00:13:00+00:00 2024-05-25T00:12:00.995247514Z [2024-05-25T00:12:00.994+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:12:00+00:00, run_after=2024-05-25T00:13:00+00:00 2024-05-25T00:12:01.102204118Z [2024-05-25T00:12:01.101+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:12:01.102240221Z 2024-05-25T00:12:01.102245055Z 2024-05-25T00:12:01.102248208Z 2024-05-25T00:12:01.102251322Z 2024-05-25T00:12:01.102453115Z [2024-05-25T00:12:01.102+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:12:01.102801801Z [2024-05-25T00:12:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:12:01.103044366Z [2024-05-25T00:12:01.102+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:12:01.103272011Z [2024-05-25T00:12:01.103+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:12:01.104163023Z [2024-05-25T00:12:01.103+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:12:01.104170309Z 2024-05-25T00:12:01.104173737Z 2024-05-25T00:12:01.104176896Z 2024-05-25T00:12:01.104180078Z 2024-05-25T00:12:01.108991493Z [2024-05-25T00:12:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:12:01.109437754Z [2024-05-25T00:12:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:12:01.110040773Z [2024-05-25T00:12:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:12:01.110306702Z [2024-05-25T00:12:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:12:01.110899556Z [2024-05-25T00:12:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:12:01.111203116Z [2024-05-25T00:12:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:12:01.111971472Z [2024-05-25T00:12:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:12:01.112306149Z [2024-05-25T00:12:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:12:01.362849548Z [2024-05-25T00:12:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status queued for try_number 1 2024-05-25T00:12:01.362880951Z [2024-05-25T00:12:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:11:00+00:00 exited with status queued for try_number 1 2024-05-25T00:12:01.362895893Z [2024-05-25T00:12:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:11:00+00:00 exited with status queued for try_number 1 2024-05-25T00:12:01.362899391Z [2024-05-25T00:12:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:11:00+00:00 exited with status queued for try_number 1 2024-05-25T00:12:01.373291923Z [2024-05-25T00:12:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3e1398f-3ae4-413b-8335-f04cf0f6f64a 2024-05-25T00:12:01.373324224Z [2024-05-25T00:12:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9641d9c8-8304-4e5d-b682-221fd19bdcb1 2024-05-25T00:12:01.373331899Z [2024-05-25T00:12:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53dceaf0-b7f5-4cc2-9035-1f1a31192252 2024-05-25T00:12:01.373335463Z [2024-05-25T00:12:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9aee8c9b-d97b-437d-8e56-7b25d6739916 2024-05-25T00:12:02.668681955Z [2024-05-25T00:12:02.668+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:12:02.669160516Z [2024-05-25T00:12:02.668+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:10:00+00:00, run_id=scheduled__2024-05-25T00:10:00+00:00, run_start_date=2024-05-25 00:12:01.008516+00:00, run_end_date=2024-05-25 00:12:02.668603+00:00, run_duration=1.660087, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:10:00+00:00, data_interval_end=2024-05-25 00:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:12:02.678746670Z [2024-05-25T00:12:02.678+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:12:00+00:00, run_after=2024-05-25T00:14:00+00:00 2024-05-25T00:12:02.686222783Z [2024-05-25T00:12:02.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:12:02.686684280Z [2024-05-25T00:12:02.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:11:00+00:00, run_id=scheduled__2024-05-25T00:11:00+00:00, run_start_date=2024-05-25 00:12:01.010255+00:00, run_end_date=2024-05-25 00:12:02.686142+00:00, run_duration=1.675887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:11:00+00:00, data_interval_end=2024-05-25 00:12:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:12:02.698306409Z [2024-05-25T00:12:02.697+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:12:00+00:00, run_after=2024-05-25T00:13:00+00:00 2024-05-25T00:12:02.768262146Z [2024-05-25T00:12:02.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status success for try_number 1 2024-05-25T00:12:02.768478125Z [2024-05-25T00:12:02.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:11:00+00:00 exited with status success for try_number 1 2024-05-25T00:12:02.778320051Z [2024-05-25T00:12:02.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:10:00+00:00, map_index=-1, run_start_date=2024-05-25 00:12:01.861708+00:00, run_end_date=2024-05-25 00:12:02.205839+00:00, run_duration=0.344131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:12:01.105431+00:00, queued_by_job_id=1, pid=4967 2024-05-25T00:12:02.778897373Z [2024-05-25T00:12:02.778+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:11:00+00:00, map_index=-1, run_start_date=2024-05-25 00:12:02.086982+00:00, run_end_date=2024-05-25 00:12:02.562944+00:00, run_duration=0.475962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:12:01.105431+00:00, queued_by_job_id=1, pid=4971 2024-05-25T00:12:05.861335309Z [2024-05-25T00:12:05.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:12:05.862324989Z [2024-05-25T00:12:05.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:11:00+00:00, run_id=scheduled__2024-05-25T00:11:00+00:00, run_start_date=2024-05-25 00:12:01.011590+00:00, run_end_date=2024-05-25 00:12:05.861060+00:00, run_duration=4.84947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:11:00+00:00, data_interval_end=2024-05-25 00:12:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:12:05.876366019Z [2024-05-25T00:12:05.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:12:00+00:00, run_after=2024-05-25T00:13:00+00:00 2024-05-25T00:12:05.885252763Z [2024-05-25T00:12:05.884+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:12:05.885689644Z [2024-05-25T00:12:05.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:11:00+00:00, run_id=scheduled__2024-05-25T00:11:00+00:00, run_start_date=2024-05-25 00:12:01.013001+00:00, run_end_date=2024-05-25 00:12:05.885069+00:00, run_duration=4.872068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:11:00+00:00, data_interval_end=2024-05-25 00:12:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:12:05.896380047Z [2024-05-25T00:12:05.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:12:00+00:00, run_after=2024-05-25T00:13:00+00:00 2024-05-25T00:12:05.947089024Z [2024-05-25T00:12:05.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:11:00+00:00 exited with status success for try_number 1 2024-05-25T00:12:05.947782191Z [2024-05-25T00:12:05.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:11:00+00:00 exited with status success for try_number 1 2024-05-25T00:12:05.963185305Z [2024-05-25T00:12:05.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:11:00+00:00, map_index=-1, run_start_date=2024-05-25 00:12:03.239284+00:00, run_end_date=2024-05-25 00:12:05.369633+00:00, run_duration=2.130349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:12:01.105431+00:00, queued_by_job_id=1, pid=4992 2024-05-25T00:12:05.964257991Z [2024-05-25T00:12:05.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:11:00+00:00, map_index=-1, run_start_date=2024-05-25 00:12:03.157624+00:00, run_end_date=2024-05-25 00:12:04.947347+00:00, run_duration=1.789723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:12:01.105431+00:00, queued_by_job_id=1, pid=4991 2024-05-25T00:13:00.812688354Z [2024-05-25T00:13:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:13:00+00:00, run_after=2024-05-25T00:14:00+00:00 2024-05-25T00:13:00.826086093Z [2024-05-25T00:13:00.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:13:00+00:00, run_after=2024-05-25T00:14:00+00:00 2024-05-25T00:13:00.834468781Z [2024-05-25T00:13:00.834+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:13:00.919982904Z [2024-05-25T00:13:00.919+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:13:00.920055471Z 2024-05-25T00:13:00.920065415Z 2024-05-25T00:13:00.920073213Z 2024-05-25T00:13:00.920121535Z [2024-05-25T00:13:00.919+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:13:00.920266791Z [2024-05-25T00:13:00.920+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:13:00.920708307Z [2024-05-25T00:13:00.920+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:13:00.921868238Z [2024-05-25T00:13:00.921+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:13:00.921883765Z 2024-05-25T00:13:00.921942532Z 2024-05-25T00:13:00.921950617Z 2024-05-25T00:13:00.928822445Z [2024-05-25T00:13:00.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:13:00.928857665Z [2024-05-25T00:13:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:13:00.929009574Z [2024-05-25T00:13:00.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:13:00.929303313Z [2024-05-25T00:13:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:13:00.929659897Z [2024-05-25T00:13:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:13:00.929681445Z [2024-05-25T00:13:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:13:01.263568444Z [2024-05-25T00:13:01.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:12:00+00:00 exited with status queued for try_number 1 2024-05-25T00:13:01.269806089Z [2024-05-25T00:13:01.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:12:00+00:00 exited with status queued for try_number 1 2024-05-25T00:13:01.269949066Z [2024-05-25T00:13:01.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:12:00+00:00 exited with status queued for try_number 1 2024-05-25T00:13:01.290523099Z [2024-05-25T00:13:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to c79346f3-082d-45af-bd2c-298ae99001f7 2024-05-25T00:13:01.290660639Z [2024-05-25T00:13:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1930419e-9044-4bc5-a196-57a6cd4c9520 2024-05-25T00:13:01.290803214Z [2024-05-25T00:13:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3431746c-b1fc-42e0-ae86-5c937847656f 2024-05-25T00:13:02.487149364Z [2024-05-25T00:13:02.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:13:02.487252071Z [2024-05-25T00:13:02.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:12:00+00:00, run_id=scheduled__2024-05-25T00:12:00+00:00, run_start_date=2024-05-25 00:13:00.847151+00:00, run_end_date=2024-05-25 00:13:02.486942+00:00, run_duration=1.639791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:12:00+00:00, data_interval_end=2024-05-25 00:13:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:13:02.496936850Z [2024-05-25T00:13:02.496+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:13:00+00:00, run_after=2024-05-25T00:14:00+00:00 2024-05-25T00:13:02.542796746Z [2024-05-25T00:13:02.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:12:00+00:00 exited with status success for try_number 1 2024-05-25T00:13:02.550687936Z [2024-05-25T00:13:02.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:12:00+00:00, map_index=-1, run_start_date=2024-05-25 00:13:01.884031+00:00, run_end_date=2024-05-25 00:13:02.328471+00:00, run_duration=0.44444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:13:00.923367+00:00, queued_by_job_id=1, pid=5024 2024-05-25T00:13:04.734224170Z [2024-05-25T00:13:04.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:13:04.734799318Z [2024-05-25T00:13:04.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:12:00+00:00, run_id=scheduled__2024-05-25T00:12:00+00:00, run_start_date=2024-05-25 00:13:00.848436+00:00, run_end_date=2024-05-25 00:13:04.734268+00:00, run_duration=3.885832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:12:00+00:00, data_interval_end=2024-05-25 00:13:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:13:04.746272417Z [2024-05-25T00:13:04.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:13:00+00:00, run_after=2024-05-25T00:14:00+00:00 2024-05-25T00:13:04.810474461Z [2024-05-25T00:13:04.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:12:00+00:00 exited with status success for try_number 1 2024-05-25T00:13:04.818938824Z [2024-05-25T00:13:04.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:12:00+00:00, map_index=-1, run_start_date=2024-05-25 00:13:03.040969+00:00, run_end_date=2024-05-25 00:13:04.544065+00:00, run_duration=1.503096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:13:00.923367+00:00, queued_by_job_id=1, pid=5043 2024-05-25T00:13:05.375769275Z [2024-05-25T00:13:05.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:13:05.376858885Z [2024-05-25T00:13:05.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:12:00+00:00, run_id=scheduled__2024-05-25T00:12:00+00:00, run_start_date=2024-05-25 00:13:00.849603+00:00, run_end_date=2024-05-25 00:13:05.376032+00:00, run_duration=4.526429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:12:00+00:00, data_interval_end=2024-05-25 00:13:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:13:05.405554430Z [2024-05-25T00:13:05.404+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:13:00+00:00, run_after=2024-05-25T00:14:00+00:00 2024-05-25T00:13:05.450401793Z [2024-05-25T00:13:05.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:12:00+00:00 exited with status success for try_number 1 2024-05-25T00:13:05.458054593Z [2024-05-25T00:13:05.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:12:00+00:00, map_index=-1, run_start_date=2024-05-25 00:13:02.933139+00:00, run_end_date=2024-05-25 00:13:04.852993+00:00, run_duration=1.919854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:13:00.923367+00:00, queued_by_job_id=1, pid=5042 2024-05-25T00:14:00.411866926Z [2024-05-25T00:14:00.410+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:14:00.443050033Z [2024-05-25T00:14:00.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:14:00+00:00, run_after=2024-05-25T00:15:00+00:00 2024-05-25T00:14:00.453918715Z [2024-05-25T00:14:00.453+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:14:00.470738868Z [2024-05-25T00:14:00.470+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:14:00+00:00, run_after=2024-05-25T00:15:00+00:00 2024-05-25T00:14:00.568325109Z [2024-05-25T00:14:00.567+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:14:00.568402937Z 2024-05-25T00:14:00.568409887Z 2024-05-25T00:14:00.568414492Z 2024-05-25T00:14:00.568419695Z 2024-05-25T00:14:00.568511389Z [2024-05-25T00:14:00.568+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:14:00.568764794Z [2024-05-25T00:14:00.568+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:14:00.568921337Z [2024-05-25T00:14:00.568+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:14:00.569088847Z [2024-05-25T00:14:00.568+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:14:00.569915382Z [2024-05-25T00:14:00.569+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:14:00.569924640Z 2024-05-25T00:14:00.569929256Z 2024-05-25T00:14:00.569933487Z 2024-05-25T00:14:00.569937737Z 2024-05-25T00:14:00.574126704Z [2024-05-25T00:14:00.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:14:00.574317391Z [2024-05-25T00:14:00.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:14:00.574675169Z [2024-05-25T00:14:00.574+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:14:00.574917861Z [2024-05-25T00:14:00.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:14:00.575272142Z [2024-05-25T00:14:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:14:00.575483012Z [2024-05-25T00:14:00.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:14:00.575850880Z [2024-05-25T00:14:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:14:00.576077032Z [2024-05-25T00:14:00.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:14:00.994383435Z [2024-05-25T00:14:00.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:12:00+00:00 exited with status queued for try_number 1 2024-05-25T00:14:00.994594057Z [2024-05-25T00:14:00.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:13:00+00:00 exited with status queued for try_number 1 2024-05-25T00:14:00.994746566Z [2024-05-25T00:14:00.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:13:00+00:00 exited with status queued for try_number 1 2024-05-25T00:14:00.994860082Z [2024-05-25T00:14:00.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:13:00+00:00 exited with status queued for try_number 1 2024-05-25T00:14:01.021481150Z [2024-05-25T00:14:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to d83aeace-6aa5-4c06-9640-6bedca314989 2024-05-25T00:14:01.021979331Z [2024-05-25T00:14:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1413e216-c03f-4e33-b365-6a3e75974b27 2024-05-25T00:14:01.022132782Z [2024-05-25T00:14:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5e2bc73-6e95-4caf-b2a2-7ae2fbaf9a59 2024-05-25T00:14:01.022281617Z [2024-05-25T00:14:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ae6abfb-8c25-427f-b85c-b03fcdf1a6f5 2024-05-25T00:14:02.249570401Z [2024-05-25T00:14:02.244+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:14:02.249593061Z [2024-05-25T00:14:02.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:12:00+00:00, run_id=scheduled__2024-05-25T00:12:00+00:00, run_start_date=2024-05-25 00:14:00.485654+00:00, run_end_date=2024-05-25 00:14:02.244818+00:00, run_duration=1.759164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:12:00+00:00, data_interval_end=2024-05-25 00:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:14:02.258124762Z [2024-05-25T00:14:02.257+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:14:00+00:00, run_after=2024-05-25T00:16:00+00:00 2024-05-25T00:14:02.266917910Z [2024-05-25T00:14:02.265+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:14:02.266940990Z [2024-05-25T00:14:02.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:13:00+00:00, run_id=scheduled__2024-05-25T00:13:00+00:00, run_start_date=2024-05-25 00:14:00.489303+00:00, run_end_date=2024-05-25 00:14:02.265858+00:00, run_duration=1.776555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:13:00+00:00, data_interval_end=2024-05-25 00:14:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:14:02.289299603Z [2024-05-25T00:14:02.284+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:14:00+00:00, run_after=2024-05-25T00:15:00+00:00 2024-05-25T00:14:02.358621450Z [2024-05-25T00:14:02.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:12:00+00:00 exited with status success for try_number 1 2024-05-25T00:14:02.358741159Z [2024-05-25T00:14:02.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:13:00+00:00 exited with status success for try_number 1 2024-05-25T00:14:02.367288860Z [2024-05-25T00:14:02.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:12:00+00:00, map_index=-1, run_start_date=2024-05-25 00:14:01.533987+00:00, run_end_date=2024-05-25 00:14:01.858350+00:00, run_duration=0.324363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:14:00.570969+00:00, queued_by_job_id=1, pid=5077 2024-05-25T00:14:02.367585458Z [2024-05-25T00:14:02.367+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:13:00+00:00, map_index=-1, run_start_date=2024-05-25 00:14:01.350819+00:00, run_end_date=2024-05-25 00:14:01.767396+00:00, run_duration=0.416577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:14:00.570969+00:00, queued_by_job_id=1, pid=5076 2024-05-25T00:14:04.530453229Z [2024-05-25T00:14:04.529+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:14:04.530676152Z [2024-05-25T00:14:04.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:13:00+00:00, run_id=scheduled__2024-05-25T00:13:00+00:00, run_start_date=2024-05-25 00:14:00.491211+00:00, run_end_date=2024-05-25 00:14:04.530219+00:00, run_duration=4.039008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:13:00+00:00, data_interval_end=2024-05-25 00:14:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:14:04.544814645Z [2024-05-25T00:14:04.544+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:14:00+00:00, run_after=2024-05-25T00:15:00+00:00 2024-05-25T00:14:04.551958703Z [2024-05-25T00:14:04.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:14:04.552181489Z [2024-05-25T00:14:04.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:13:00+00:00, run_id=scheduled__2024-05-25T00:13:00+00:00, run_start_date=2024-05-25 00:14:00.492696+00:00, run_end_date=2024-05-25 00:14:04.551709+00:00, run_duration=4.059013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:13:00+00:00, data_interval_end=2024-05-25 00:14:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:14:04.562383699Z [2024-05-25T00:14:04.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:14:00+00:00, run_after=2024-05-25T00:15:00+00:00 2024-05-25T00:14:04.598307082Z [2024-05-25T00:14:04.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:13:00+00:00 exited with status success for try_number 1 2024-05-25T00:14:04.598565477Z [2024-05-25T00:14:04.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:13:00+00:00 exited with status success for try_number 1 2024-05-25T00:14:04.610131110Z [2024-05-25T00:14:04.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:13:00+00:00, map_index=-1, run_start_date=2024-05-25 00:14:02.668261+00:00, run_end_date=2024-05-25 00:14:03.912091+00:00, run_duration=1.24383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:14:00.570969+00:00, queued_by_job_id=1, pid=5101 2024-05-25T00:14:04.610700012Z [2024-05-25T00:14:04.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:13:00+00:00, map_index=-1, run_start_date=2024-05-25 00:14:02.597660+00:00, run_end_date=2024-05-25 00:14:04.241297+00:00, run_duration=1.643637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:14:00.570969+00:00, queued_by_job_id=1, pid=5100 2024-05-25T00:15:00.398611241Z [2024-05-25T00:15:00.395+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:15:00+00:00, run_after=2024-05-25T00:16:00+00:00 2024-05-25T00:15:00.407205392Z [2024-05-25T00:15:00.406+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:15:00.424993606Z [2024-05-25T00:15:00.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:15:00+00:00, run_after=2024-05-25T00:20:00+00:00 2024-05-25T00:15:00.451821758Z [2024-05-25T00:15:00.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:15:00+00:00, run_after=2024-05-25T00:16:00+00:00 2024-05-25T00:15:00.559557903Z [2024-05-25T00:15:00.556+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:15:00.559580117Z 2024-05-25T00:15:00.559584542Z 2024-05-25T00:15:00.559588039Z 2024-05-25T00:15:00.559601269Z 2024-05-25T00:15:00.559609497Z [2024-05-25T00:15:00.556+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:15:00.559612701Z [2024-05-25T00:15:00.556+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:15:00.559616074Z [2024-05-25T00:15:00.557+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:15:00.559619088Z [2024-05-25T00:15:00.557+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:15:00.559622595Z [2024-05-25T00:15:00.558+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:15:00.559625632Z 2024-05-25T00:15:00.559628642Z 2024-05-25T00:15:00.559631655Z 2024-05-25T00:15:00.559634534Z 2024-05-25T00:15:00.564504977Z [2024-05-25T00:15:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T00:15:00.564560192Z [2024-05-25T00:15:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:15:00.564759488Z [2024-05-25T00:15:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:15:00.564822199Z [2024-05-25T00:15:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:15:00.565013020Z [2024-05-25T00:15:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:15:00.565076509Z [2024-05-25T00:15:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:15:00.565351100Z [2024-05-25T00:15:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:15:00.565370668Z [2024-05-25T00:15:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:15:01.191171088Z [2024-05-25T00:15:01.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status queued for try_number 1 2024-05-25T00:15:01.195540099Z [2024-05-25T00:15:01.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:14:00+00:00 exited with status queued for try_number 1 2024-05-25T00:15:01.196168625Z [2024-05-25T00:15:01.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:14:00+00:00 exited with status queued for try_number 1 2024-05-25T00:15:01.197776969Z [2024-05-25T00:15:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:14:00+00:00 exited with status queued for try_number 1 2024-05-25T00:15:01.214152619Z [2024-05-25T00:15:01.213+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97a74524-383f-4b1b-830d-755b81de379e 2024-05-25T00:15:01.215424819Z [2024-05-25T00:15:01.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed708ffa-d13d-4eef-abe6-b69815df4652 2024-05-25T00:15:01.215652136Z [2024-05-25T00:15:01.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dcae482-0a58-4988-a5f5-270526fa7f29 2024-05-25T00:15:01.215833563Z [2024-05-25T00:15:01.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to d08773d6-3ced-42cb-9db5-8f49bb514774 2024-05-25T00:15:03.358313444Z [2024-05-25T00:15:03.357+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:15:03.358548756Z [2024-05-25T00:15:03.358+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:14:00+00:00, run_id=scheduled__2024-05-25T00:14:00+00:00, run_start_date=2024-05-25 00:15:00.480999+00:00, run_end_date=2024-05-25 00:15:03.358180+00:00, run_duration=2.877181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:14:00+00:00, data_interval_end=2024-05-25 00:15:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:15:03.381301959Z [2024-05-25T00:15:03.379+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:15:00+00:00, run_after=2024-05-25T00:16:00+00:00 2024-05-25T00:15:03.484857793Z [2024-05-25T00:15:03.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:14:00+00:00 exited with status success for try_number 1 2024-05-25T00:15:03.493359577Z [2024-05-25T00:15:03.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:14:00+00:00, map_index=-1, run_start_date=2024-05-25 00:15:02.203045+00:00, run_end_date=2024-05-25 00:15:02.982631+00:00, run_duration=0.779586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:15:00.559528+00:00, queued_by_job_id=1, pid=5135 2024-05-25T00:15:04.686466256Z [2024-05-25T00:15:04.686+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:15:04.686491382Z 2024-05-25T00:15:04.686603591Z [2024-05-25T00:15:04.686+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:15:04.687519727Z [2024-05-25T00:15:04.687+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:15:04.687531152Z 2024-05-25T00:15:04.689799165Z [2024-05-25T00:15:04.689+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T00:15:04.689960261Z [2024-05-25T00:15:04.689+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:15:04.804726525Z [2024-05-25T00:15:04.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status queued for try_number 1 2024-05-25T00:15:04.804743205Z [2024-05-25T00:15:04.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status success for try_number 1 2024-05-25T00:15:04.825559029Z [2024-05-25T00:15:04.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a3231fb-2759-46c2-8908-ba4d12418476 2024-05-25T00:15:04.825582750Z [2024-05-25T00:15:04.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T00:10:00+00:00, map_index=-1, run_start_date=2024-05-25 00:15:03.936842+00:00, run_end_date=2024-05-25 00:15:04.532346+00:00, run_duration=0.595504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:15:00.559528+00:00, queued_by_job_id=1, pid=5154 2024-05-25T00:15:06.053569576Z [2024-05-25T00:15:06.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:15:06.053624787Z [2024-05-25T00:15:06.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:14:00+00:00, run_id=scheduled__2024-05-25T00:14:00+00:00, run_start_date=2024-05-25 00:15:00.482098+00:00, run_end_date=2024-05-25 00:15:06.051753+00:00, run_duration=5.569655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:14:00+00:00, data_interval_end=2024-05-25 00:15:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:15:06.069393553Z [2024-05-25T00:15:06.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:15:00+00:00, run_after=2024-05-25T00:16:00+00:00 2024-05-25T00:15:06.146381538Z [2024-05-25T00:15:06.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:14:00+00:00 exited with status success for try_number 1 2024-05-25T00:15:06.153181897Z [2024-05-25T00:15:06.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:14:00+00:00, map_index=-1, run_start_date=2024-05-25 00:15:04.215707+00:00, run_end_date=2024-05-25 00:15:05.730482+00:00, run_duration=1.514775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:15:00.559528+00:00, queued_by_job_id=1, pid=5160 2024-05-25T00:15:06.810730075Z [2024-05-25T00:15:06.810+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:15:06.813707179Z [2024-05-25T00:15:06.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:14:00+00:00, run_id=scheduled__2024-05-25T00:14:00+00:00, run_start_date=2024-05-25 00:15:00.483294+00:00, run_end_date=2024-05-25 00:15:06.810628+00:00, run_duration=6.327334, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:14:00+00:00, data_interval_end=2024-05-25 00:15:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:15:06.831580184Z [2024-05-25T00:15:06.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:15:00+00:00, run_after=2024-05-25T00:16:00+00:00 2024-05-25T00:15:07.024412499Z [2024-05-25T00:15:07.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:14:00+00:00 exited with status success for try_number 1 2024-05-25T00:15:07.038720512Z [2024-05-25T00:15:07.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:14:00+00:00, map_index=-1, run_start_date=2024-05-25 00:15:04.496279+00:00, run_end_date=2024-05-25 00:15:06.423506+00:00, run_duration=1.927227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:15:00.559528+00:00, queued_by_job_id=1, pid=5166 2024-05-25T00:15:08.173526212Z [2024-05-25T00:15:08.169+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:15:08.173557100Z 2024-05-25T00:15:08.173561596Z [2024-05-25T00:15:08.169+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:15:08.173565966Z [2024-05-25T00:15:08.169+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:15:08.173569723Z 2024-05-25T00:15:08.176408532Z [2024-05-25T00:15:08.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T00:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T00:15:08.176475334Z [2024-05-25T00:15:08.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:15:08.369431688Z [2024-05-25T00:15:08.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status queued for try_number 1 2024-05-25T00:15:08.369460525Z [2024-05-25T00:15:08.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status success for try_number 1 2024-05-25T00:15:08.381635855Z [2024-05-25T00:15:08.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8e919b9-85fe-4a6b-92fd-541530632dbb 2024-05-25T00:15:08.390196711Z [2024-05-25T00:15:08.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T00:10:00+00:00, map_index=-1, run_start_date=2024-05-25 00:15:06.846983+00:00, run_end_date=2024-05-25 00:15:07.227753+00:00, run_duration=0.38077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:15:04.687843+00:00, queued_by_job_id=1, pid=5194 2024-05-25T00:15:10.842109373Z [2024-05-25T00:15:10.840+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:15:10.842135487Z 2024-05-25T00:15:10.842142250Z [2024-05-25T00:15:10.841+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:15:10.842792752Z [2024-05-25T00:15:10.842+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:15:10.842808784Z 2024-05-25T00:15:10.846618951Z [2024-05-25T00:15:10.845+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:15:10.846652814Z [2024-05-25T00:15:10.845+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:15:10.944643742Z [2024-05-25T00:15:10.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status queued for try_number 1 2024-05-25T00:15:10.951074063Z [2024-05-25T00:15:10.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to a564392e-79f1-4507-99dd-5ffa762a4a89 2024-05-25T00:15:11.052346990Z [2024-05-25T00:15:11.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status success for try_number 1 2024-05-25T00:15:11.057884555Z [2024-05-25T00:15:11.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T00:10:00+00:00, map_index=0, run_start_date=2024-05-25 00:15:10.466417+00:00, run_end_date=2024-05-25 00:15:10.794906+00:00, run_duration=0.328489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:15:08.170420+00:00, queued_by_job_id=1, pid=5205 2024-05-25T00:15:13.207019536Z [2024-05-25T00:15:13.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:15:13.207864784Z [2024-05-25T00:15:13.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:10:00+00:00, run_id=scheduled__2024-05-25T00:10:00+00:00, run_start_date=2024-05-25 00:15:00.479794+00:00, run_end_date=2024-05-25 00:15:13.206909+00:00, run_duration=12.727115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:10:00+00:00, data_interval_end=2024-05-25 00:15:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T00:15:13.213958613Z [2024-05-25T00:15:13.213+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:15:00+00:00, run_after=2024-05-25T00:20:00+00:00 2024-05-25T00:15:13.701945154Z [2024-05-25T00:15:13.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:10:00+00:00 exited with status success for try_number 1 2024-05-25T00:15:13.710000951Z [2024-05-25T00:15:13.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T00:10:00+00:00, map_index=-1, run_start_date=2024-05-25 00:15:12.664308+00:00, run_end_date=2024-05-25 00:15:13.119439+00:00, run_duration=0.455131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:15:10.843284+00:00, queued_by_job_id=1, pid=5213 2024-05-25T00:15:28.213230817Z [2024-05-25T00:15:28.212+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T00:16:00.532675700Z [2024-05-25T00:16:00.532+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:16:00+00:00, run_after=2024-05-25T00:17:00+00:00 2024-05-25T00:16:00.551100557Z [2024-05-25T00:16:00.550+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:16:00.571657522Z [2024-05-25T00:16:00.571+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:16:00.585731139Z [2024-05-25T00:16:00.585+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:16:00+00:00, run_after=2024-05-25T00:17:00+00:00 2024-05-25T00:16:00.679389836Z [2024-05-25T00:16:00.678+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:16:00.679423508Z 2024-05-25T00:16:00.679431616Z 2024-05-25T00:16:00.679437607Z 2024-05-25T00:16:00.679442844Z 2024-05-25T00:16:00.679643698Z [2024-05-25T00:16:00.679+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:16:00.680028172Z [2024-05-25T00:16:00.679+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:16:00.680334409Z [2024-05-25T00:16:00.679+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:16:00.680727410Z [2024-05-25T00:16:00.680+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:16:00.682223858Z [2024-05-25T00:16:00.681+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:16:00.682249714Z 2024-05-25T00:16:00.682259489Z 2024-05-25T00:16:00.682268733Z 2024-05-25T00:16:00.682277395Z 2024-05-25T00:16:00.700217741Z [2024-05-25T00:16:00.699+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:16:00.700913492Z [2024-05-25T00:16:00.700+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:16:00.701669475Z [2024-05-25T00:16:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:16:00.702110640Z [2024-05-25T00:16:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:16:00.703189023Z [2024-05-25T00:16:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:16:00.703550869Z [2024-05-25T00:16:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:16:00.704209412Z [2024-05-25T00:16:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:16:00.704518354Z [2024-05-25T00:16:00.704+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:16:01.165505133Z [2024-05-25T00:16:01.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:14:00+00:00 exited with status queued for try_number 1 2024-05-25T00:16:01.165643735Z [2024-05-25T00:16:01.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status queued for try_number 1 2024-05-25T00:16:01.165783208Z [2024-05-25T00:16:01.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status queued for try_number 1 2024-05-25T00:16:01.165850156Z [2024-05-25T00:16:01.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status queued for try_number 1 2024-05-25T00:16:01.174675039Z [2024-05-25T00:16:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3032e1a-2ca0-4aa6-89aa-e3b36d0e6fd4 2024-05-25T00:16:01.174938913Z [2024-05-25T00:16:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52cec9fb-dee9-4d0a-a4a3-a43e82867520 2024-05-25T00:16:01.175108139Z [2024-05-25T00:16:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 048bbd79-e466-4881-bfbb-cc3098a05bde 2024-05-25T00:16:01.175298701Z [2024-05-25T00:16:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b16ed5a-19ae-4ce2-9a59-c85ab5c23359 2024-05-25T00:16:02.442294463Z [2024-05-25T00:16:02.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:16:02.442976177Z [2024-05-25T00:16:02.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:14:00+00:00, run_id=scheduled__2024-05-25T00:14:00+00:00, run_start_date=2024-05-25 00:16:00.597487+00:00, run_end_date=2024-05-25 00:16:02.442566+00:00, run_duration=1.845079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:14:00+00:00, data_interval_end=2024-05-25 00:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:16:02.454772847Z [2024-05-25T00:16:02.454+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:16:00+00:00, run_after=2024-05-25T00:18:00+00:00 2024-05-25T00:16:02.565426786Z [2024-05-25T00:16:02.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:14:00+00:00 exited with status success for try_number 1 2024-05-25T00:16:02.573723817Z [2024-05-25T00:16:02.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:14:00+00:00, map_index=-1, run_start_date=2024-05-25 00:16:01.714675+00:00, run_end_date=2024-05-25 00:16:02.228854+00:00, run_duration=0.514179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:16:00.684252+00:00, queued_by_job_id=1, pid=5223 2024-05-25T00:16:03.619646011Z [2024-05-25T00:16:03.619+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:16:03.620178365Z [2024-05-25T00:16:03.619+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:15:00+00:00, run_id=scheduled__2024-05-25T00:15:00+00:00, run_start_date=2024-05-25 00:16:00.598919+00:00, run_end_date=2024-05-25 00:16:03.619795+00:00, run_duration=3.020876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:15:00+00:00, data_interval_end=2024-05-25 00:16:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:16:03.635150762Z [2024-05-25T00:16:03.634+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:16:00+00:00, run_after=2024-05-25T00:17:00+00:00 2024-05-25T00:16:03.708288407Z [2024-05-25T00:16:03.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status success for try_number 1 2024-05-25T00:16:03.717504497Z [2024-05-25T00:16:03.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:15:00+00:00, map_index=-1, run_start_date=2024-05-25 00:16:01.960017+00:00, run_end_date=2024-05-25 00:16:02.596547+00:00, run_duration=0.63653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:16:00.684252+00:00, queued_by_job_id=1, pid=5226 2024-05-25T00:16:05.645977036Z [2024-05-25T00:16:05.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:16:05.646412734Z [2024-05-25T00:16:05.646+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:15:00+00:00, run_id=scheduled__2024-05-25T00:15:00+00:00, run_start_date=2024-05-25 00:16:00.599891+00:00, run_end_date=2024-05-25 00:16:05.645822+00:00, run_duration=5.045931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:15:00+00:00, data_interval_end=2024-05-25 00:16:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:16:05.665163642Z [2024-05-25T00:16:05.664+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:16:00+00:00, run_after=2024-05-25T00:17:00+00:00 2024-05-25T00:16:05.710732983Z [2024-05-25T00:16:05.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status success for try_number 1 2024-05-25T00:16:05.718124213Z [2024-05-25T00:16:05.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:15:00+00:00, map_index=-1, run_start_date=2024-05-25 00:16:03.240288+00:00, run_end_date=2024-05-25 00:16:05.131407+00:00, run_duration=1.891119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:16:00.684252+00:00, queued_by_job_id=1, pid=5247 2024-05-25T00:16:06.758402640Z [2024-05-25T00:16:06.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:16:06.758705575Z [2024-05-25T00:16:06.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:15:00+00:00, run_id=scheduled__2024-05-25T00:15:00+00:00, run_start_date=2024-05-25 00:16:00.600930+00:00, run_end_date=2024-05-25 00:16:06.758262+00:00, run_duration=6.157332, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:15:00+00:00, data_interval_end=2024-05-25 00:16:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:16:06.770308087Z [2024-05-25T00:16:06.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:16:00+00:00, run_after=2024-05-25T00:17:00+00:00 2024-05-25T00:16:06.811542369Z [2024-05-25T00:16:06.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status success for try_number 1 2024-05-25T00:16:06.821870759Z [2024-05-25T00:16:06.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:15:00+00:00, map_index=-1, run_start_date=2024-05-25 00:16:03.384128+00:00, run_end_date=2024-05-25 00:16:05.530744+00:00, run_duration=2.146616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:16:00.684252+00:00, queued_by_job_id=1, pid=5248 2024-05-25T00:17:00.359523099Z [2024-05-25T00:17:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:17:00+00:00, run_after=2024-05-25T00:18:00+00:00 2024-05-25T00:17:00.365479003Z [2024-05-25T00:17:00.365+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:17:00.396245620Z [2024-05-25T00:17:00.390+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:17:00+00:00, run_after=2024-05-25T00:18:00+00:00 2024-05-25T00:17:00.482454496Z [2024-05-25T00:17:00.481+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:17:00.482488228Z 2024-05-25T00:17:00.482494027Z 2024-05-25T00:17:00.482499117Z 2024-05-25T00:17:00.482795681Z [2024-05-25T00:17:00.482+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:17:00.483201533Z [2024-05-25T00:17:00.482+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:17:00.483527423Z [2024-05-25T00:17:00.483+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:17:00.484830199Z [2024-05-25T00:17:00.484+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:17:00.484851687Z 2024-05-25T00:17:00.484859045Z 2024-05-25T00:17:00.484865283Z 2024-05-25T00:17:00.491692076Z [2024-05-25T00:17:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:17:00.491826570Z [2024-05-25T00:17:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:17:00.492603183Z [2024-05-25T00:17:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:17:00.492636421Z [2024-05-25T00:17:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:17:00.492839380Z [2024-05-25T00:17:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:17:00.492910199Z [2024-05-25T00:17:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:17:00.727268905Z [2024-05-25T00:17:00.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:16:00+00:00 exited with status queued for try_number 1 2024-05-25T00:17:00.727321821Z [2024-05-25T00:17:00.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:16:00+00:00 exited with status queued for try_number 1 2024-05-25T00:17:00.727326707Z [2024-05-25T00:17:00.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:16:00+00:00 exited with status queued for try_number 1 2024-05-25T00:17:00.735524177Z [2024-05-25T00:17:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 955720a9-1c9a-4d52-abbc-26ec257c4c42 2024-05-25T00:17:00.735582740Z [2024-05-25T00:17:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad4d3970-0303-4ba2-8e5a-53d474b08f99 2024-05-25T00:17:00.735842658Z [2024-05-25T00:17:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d553f81-687e-4221-8228-8eff53aab4a2 2024-05-25T00:17:01.894541550Z [2024-05-25T00:17:01.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:17:01.894769895Z [2024-05-25T00:17:01.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:16:00+00:00, run_id=scheduled__2024-05-25T00:16:00+00:00, run_start_date=2024-05-25 00:17:00.406668+00:00, run_end_date=2024-05-25 00:17:01.894382+00:00, run_duration=1.487714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:16:00+00:00, data_interval_end=2024-05-25 00:17:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:17:01.912274239Z [2024-05-25T00:17:01.911+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:17:00+00:00, run_after=2024-05-25T00:18:00+00:00 2024-05-25T00:17:01.963223223Z [2024-05-25T00:17:01.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:16:00+00:00 exited with status success for try_number 1 2024-05-25T00:17:01.974049454Z [2024-05-25T00:17:01.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:16:00+00:00, map_index=-1, run_start_date=2024-05-25 00:17:01.215051+00:00, run_end_date=2024-05-25 00:17:01.600736+00:00, run_duration=0.385685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:17:00.486675+00:00, queued_by_job_id=1, pid=5280 2024-05-25T00:17:04.149008286Z [2024-05-25T00:17:04.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:17:04.149354847Z [2024-05-25T00:17:04.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:16:00+00:00, run_id=scheduled__2024-05-25T00:16:00+00:00, run_start_date=2024-05-25 00:17:00.408407+00:00, run_end_date=2024-05-25 00:17:04.148943+00:00, run_duration=3.740536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:16:00+00:00, data_interval_end=2024-05-25 00:17:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:17:04.160252811Z [2024-05-25T00:17:04.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:17:00+00:00, run_after=2024-05-25T00:18:00+00:00 2024-05-25T00:17:04.170209889Z [2024-05-25T00:17:04.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:17:04.170486054Z [2024-05-25T00:17:04.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:16:00+00:00, run_id=scheduled__2024-05-25T00:16:00+00:00, run_start_date=2024-05-25 00:17:00.409940+00:00, run_end_date=2024-05-25 00:17:04.170189+00:00, run_duration=3.760249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:16:00+00:00, data_interval_end=2024-05-25 00:17:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:17:04.180875123Z [2024-05-25T00:17:04.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:17:00+00:00, run_after=2024-05-25T00:18:00+00:00 2024-05-25T00:17:04.226309640Z [2024-05-25T00:17:04.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:16:00+00:00 exited with status success for try_number 1 2024-05-25T00:17:04.226579349Z [2024-05-25T00:17:04.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:16:00+00:00 exited with status success for try_number 1 2024-05-25T00:17:04.237793809Z [2024-05-25T00:17:04.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:16:00+00:00, map_index=-1, run_start_date=2024-05-25 00:17:02.320973+00:00, run_end_date=2024-05-25 00:17:03.743625+00:00, run_duration=1.422652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:17:00.486675+00:00, queued_by_job_id=1, pid=5298 2024-05-25T00:17:04.238217391Z [2024-05-25T00:17:04.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:16:00+00:00, map_index=-1, run_start_date=2024-05-25 00:17:02.403308+00:00, run_end_date=2024-05-25 00:17:04.014281+00:00, run_duration=1.610973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:17:00.486675+00:00, queued_by_job_id=1, pid=5299 2024-05-25T00:18:00.757962735Z [2024-05-25T00:18:00.757+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:18:00+00:00, run_after=2024-05-25T00:19:00+00:00 2024-05-25T00:18:00.767763054Z [2024-05-25T00:18:00.767+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:18:00.781470866Z [2024-05-25T00:18:00.780+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:18:00+00:00, run_after=2024-05-25T00:19:00+00:00 2024-05-25T00:18:00.790027182Z [2024-05-25T00:18:00.789+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:18:00.883892864Z [2024-05-25T00:18:00.883+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:18:00.883996632Z 2024-05-25T00:18:00.884009416Z 2024-05-25T00:18:00.884018212Z 2024-05-25T00:18:00.884026582Z 2024-05-25T00:18:00.884068394Z [2024-05-25T00:18:00.883+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:18:00.884227326Z [2024-05-25T00:18:00.883+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:18:00.884271261Z [2024-05-25T00:18:00.883+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:18:00.884315339Z [2024-05-25T00:18:00.884+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:18:00.885231586Z [2024-05-25T00:18:00.884+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:18:00.885263590Z 2024-05-25T00:18:00.885272945Z 2024-05-25T00:18:00.885280298Z 2024-05-25T00:18:00.885287399Z 2024-05-25T00:18:00.891255459Z [2024-05-25T00:18:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:18:00.891327821Z [2024-05-25T00:18:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:18:00.891562935Z [2024-05-25T00:18:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:18:00.891622256Z [2024-05-25T00:18:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:18:00.892141540Z [2024-05-25T00:18:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:18:00.892240023Z [2024-05-25T00:18:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:18:00.892520564Z [2024-05-25T00:18:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:18:00.892540869Z [2024-05-25T00:18:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:18:01.308371576Z [2024-05-25T00:18:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:16:00+00:00 exited with status queued for try_number 1 2024-05-25T00:18:01.308574982Z [2024-05-25T00:18:01.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:17:00+00:00 exited with status queued for try_number 1 2024-05-25T00:18:01.308661807Z [2024-05-25T00:18:01.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:17:00+00:00 exited with status queued for try_number 1 2024-05-25T00:18:01.308800825Z [2024-05-25T00:18:01.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:17:00+00:00 exited with status queued for try_number 1 2024-05-25T00:18:01.317395397Z [2024-05-25T00:18:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5862b70f-9bb4-433d-9f9b-245f9b5834a0 2024-05-25T00:18:01.317479988Z [2024-05-25T00:18:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1f2943b-f388-47f1-944f-b16af99011d3 2024-05-25T00:18:01.317711259Z [2024-05-25T00:18:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82078046-ebd7-497a-98fc-1cfd58c608ff 2024-05-25T00:18:01.317812046Z [2024-05-25T00:18:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5a031ee-5f36-4d15-8003-ab04427b6a56 2024-05-25T00:18:02.893226075Z [2024-05-25T00:18:02.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:18:02.893673548Z [2024-05-25T00:18:02.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:16:00+00:00, run_id=scheduled__2024-05-25T00:16:00+00:00, run_start_date=2024-05-25 00:18:00.802510+00:00, run_end_date=2024-05-25 00:18:02.893146+00:00, run_duration=2.090636, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:16:00+00:00, data_interval_end=2024-05-25 00:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:18:02.901103770Z [2024-05-25T00:18:02.900+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:18:00+00:00, run_after=2024-05-25T00:20:00+00:00 2024-05-25T00:18:02.907824989Z [2024-05-25T00:18:02.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:18:02.908237450Z [2024-05-25T00:18:02.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:17:00+00:00, run_id=scheduled__2024-05-25T00:17:00+00:00, run_start_date=2024-05-25 00:18:00.804166+00:00, run_end_date=2024-05-25 00:18:02.907754+00:00, run_duration=2.103588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:17:00+00:00, data_interval_end=2024-05-25 00:18:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:18:02.917585790Z [2024-05-25T00:18:02.917+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:18:00+00:00, run_after=2024-05-25T00:19:00+00:00 2024-05-25T00:18:02.960540308Z [2024-05-25T00:18:02.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:16:00+00:00 exited with status success for try_number 1 2024-05-25T00:18:02.962621501Z [2024-05-25T00:18:02.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:17:00+00:00 exited with status success for try_number 1 2024-05-25T00:18:02.968859640Z [2024-05-25T00:18:02.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:17:00+00:00, map_index=-1, run_start_date=2024-05-25 00:18:01.875001+00:00, run_end_date=2024-05-25 00:18:02.301415+00:00, run_duration=0.426414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:18:00.886676+00:00, queued_by_job_id=1, pid=5333 2024-05-25T00:18:02.969277168Z [2024-05-25T00:18:02.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:16:00+00:00, map_index=-1, run_start_date=2024-05-25 00:18:01.768720+00:00, run_end_date=2024-05-25 00:18:02.190840+00:00, run_duration=0.42212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:18:00.886676+00:00, queued_by_job_id=1, pid=5332 2024-05-25T00:18:05.161635782Z [2024-05-25T00:18:05.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:18:05.163755989Z [2024-05-25T00:18:05.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:17:00+00:00, run_id=scheduled__2024-05-25T00:17:00+00:00, run_start_date=2024-05-25 00:18:00.805409+00:00, run_end_date=2024-05-25 00:18:05.161663+00:00, run_duration=4.356254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:17:00+00:00, data_interval_end=2024-05-25 00:18:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:18:05.178789595Z [2024-05-25T00:18:05.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:18:00+00:00, run_after=2024-05-25T00:19:00+00:00 2024-05-25T00:18:05.247397982Z [2024-05-25T00:18:05.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:17:00+00:00 exited with status success for try_number 1 2024-05-25T00:18:05.256841180Z [2024-05-25T00:18:05.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:17:00+00:00, map_index=-1, run_start_date=2024-05-25 00:18:03.034113+00:00, run_end_date=2024-05-25 00:18:04.627825+00:00, run_duration=1.593712, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:18:00.886676+00:00, queued_by_job_id=1, pid=5356 2024-05-25T00:18:06.307451680Z [2024-05-25T00:18:06.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:18:06.307758739Z [2024-05-25T00:18:06.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:17:00+00:00, run_id=scheduled__2024-05-25T00:17:00+00:00, run_start_date=2024-05-25 00:18:00.806552+00:00, run_end_date=2024-05-25 00:18:06.307352+00:00, run_duration=5.5008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:17:00+00:00, data_interval_end=2024-05-25 00:18:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:18:06.317430180Z [2024-05-25T00:18:06.316+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:18:00+00:00, run_after=2024-05-25T00:19:00+00:00 2024-05-25T00:18:06.362646587Z [2024-05-25T00:18:06.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:17:00+00:00 exited with status success for try_number 1 2024-05-25T00:18:06.373864802Z [2024-05-25T00:18:06.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:17:00+00:00, map_index=-1, run_start_date=2024-05-25 00:18:03.094040+00:00, run_end_date=2024-05-25 00:18:05.220937+00:00, run_duration=2.126897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:18:00.886676+00:00, queued_by_job_id=1, pid=5357 2024-05-25T00:19:00.105319683Z [2024-05-25T00:19:00.100+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:19:00.112816920Z [2024-05-25T00:19:00.112+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:19:00+00:00, run_after=2024-05-25T00:20:00+00:00 2024-05-25T00:19:00.126356400Z [2024-05-25T00:19:00.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:19:00+00:00, run_after=2024-05-25T00:20:00+00:00 2024-05-25T00:19:00.283669381Z [2024-05-25T00:19:00.283+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:19:00.283711533Z 2024-05-25T00:19:00.283715416Z 2024-05-25T00:19:00.283718709Z 2024-05-25T00:19:00.283998672Z [2024-05-25T00:19:00.283+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:19:00.284280321Z [2024-05-25T00:19:00.284+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:19:00.284499194Z [2024-05-25T00:19:00.284+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:19:00.286204404Z [2024-05-25T00:19:00.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:19:00.286219048Z 2024-05-25T00:19:00.286222539Z 2024-05-25T00:19:00.286225875Z 2024-05-25T00:19:00.294125971Z [2024-05-25T00:19:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:19:00.294270194Z [2024-05-25T00:19:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:19:00.294649013Z [2024-05-25T00:19:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:19:00.294798774Z [2024-05-25T00:19:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:19:00.295152398Z [2024-05-25T00:19:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:19:00.295307670Z [2024-05-25T00:19:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:19:00.665466771Z [2024-05-25T00:19:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:18:00+00:00 exited with status queued for try_number 1 2024-05-25T00:19:00.665494975Z [2024-05-25T00:19:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:18:00+00:00 exited with status queued for try_number 1 2024-05-25T00:19:00.665498821Z [2024-05-25T00:19:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:18:00+00:00 exited with status queued for try_number 1 2024-05-25T00:19:00.681312040Z [2024-05-25T00:19:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51ff2087-4555-4f58-945d-974f12e169a9 2024-05-25T00:19:00.681325825Z [2024-05-25T00:19:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b6e6cf5-2c73-4909-bd6e-6e999596bd4b 2024-05-25T00:19:00.681329157Z [2024-05-25T00:19:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15d52c1f-f9bc-410a-bc2f-c8d2611f9d23 2024-05-25T00:19:01.955533395Z [2024-05-25T00:19:01.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:19:01.955552706Z [2024-05-25T00:19:01.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:18:00+00:00, run_id=scheduled__2024-05-25T00:18:00+00:00, run_start_date=2024-05-25 00:19:00.170064+00:00, run_end_date=2024-05-25 00:19:01.954566+00:00, run_duration=1.784502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:18:00+00:00, data_interval_end=2024-05-25 00:19:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:19:01.966050908Z [2024-05-25T00:19:01.964+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:19:00+00:00, run_after=2024-05-25T00:20:00+00:00 2024-05-25T00:19:02.018209131Z [2024-05-25T00:19:02.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:18:00+00:00 exited with status success for try_number 1 2024-05-25T00:19:02.023456032Z [2024-05-25T00:19:02.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:18:00+00:00, map_index=-1, run_start_date=2024-05-25 00:19:01.266724+00:00, run_end_date=2024-05-25 00:19:01.760496+00:00, run_duration=0.493772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:19:00.285885+00:00, queued_by_job_id=1, pid=5391 2024-05-25T00:19:03.989552750Z [2024-05-25T00:19:03.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:19:03.989570964Z [2024-05-25T00:19:03.988+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:18:00+00:00, run_id=scheduled__2024-05-25T00:18:00+00:00, run_start_date=2024-05-25 00:19:00.171436+00:00, run_end_date=2024-05-25 00:19:03.987841+00:00, run_duration=3.816405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:18:00+00:00, data_interval_end=2024-05-25 00:19:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:19:04.006408222Z [2024-05-25T00:19:04.003+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:19:00+00:00, run_after=2024-05-25T00:20:00+00:00 2024-05-25T00:19:04.053000110Z [2024-05-25T00:19:04.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:18:00+00:00 exited with status success for try_number 1 2024-05-25T00:19:04.067084420Z [2024-05-25T00:19:04.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:18:00+00:00, map_index=-1, run_start_date=2024-05-25 00:19:02.279931+00:00, run_end_date=2024-05-25 00:19:03.570337+00:00, run_duration=1.290406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:19:00.285885+00:00, queued_by_job_id=1, pid=5404 2024-05-25T00:19:06.209300221Z [2024-05-25T00:19:06.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:19:06.209327447Z [2024-05-25T00:19:06.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:18:00+00:00, run_id=scheduled__2024-05-25T00:18:00+00:00, run_start_date=2024-05-25 00:19:00.172550+00:00, run_end_date=2024-05-25 00:19:06.204342+00:00, run_duration=6.031792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:18:00+00:00, data_interval_end=2024-05-25 00:19:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:19:06.226303361Z [2024-05-25T00:19:06.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:19:00+00:00, run_after=2024-05-25T00:20:00+00:00 2024-05-25T00:19:06.260302675Z [2024-05-25T00:19:06.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:18:00+00:00 exited with status success for try_number 1 2024-05-25T00:19:06.268021274Z [2024-05-25T00:19:06.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:18:00+00:00, map_index=-1, run_start_date=2024-05-25 00:19:02.645652+00:00, run_end_date=2024-05-25 00:19:05.364142+00:00, run_duration=2.71849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:19:00.285885+00:00, queued_by_job_id=1, pid=5415 2024-05-25T00:20:00.913695332Z [2024-05-25T00:20:00.913+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:20:00.934995873Z [2024-05-25T00:20:00.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:20:00+00:00, run_after=2024-05-25T00:25:00+00:00 2024-05-25T00:20:00.954675944Z [2024-05-25T00:20:00.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:20:00+00:00, run_after=2024-05-25T00:21:00+00:00 2024-05-25T00:20:00.963387632Z [2024-05-25T00:20:00.963+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:20:00.979832173Z [2024-05-25T00:20:00.979+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:20:00+00:00, run_after=2024-05-25T00:21:00+00:00 2024-05-25T00:20:01.113750118Z [2024-05-25T00:20:01.113+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T00:20:01.113797941Z 2024-05-25T00:20:01.113809562Z 2024-05-25T00:20:01.113821090Z 2024-05-25T00:20:01.113831731Z 2024-05-25T00:20:01.113844713Z 2024-05-25T00:20:01.114039045Z [2024-05-25T00:20:01.113+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:20:01.114203050Z [2024-05-25T00:20:01.114+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:20:01.114378484Z [2024-05-25T00:20:01.114+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:20:01.114537499Z [2024-05-25T00:20:01.114+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:20:01.114700985Z [2024-05-25T00:20:01.114+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:20:01.115434820Z [2024-05-25T00:20:01.115+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:20:01.115452031Z 2024-05-25T00:20:01.115460461Z 2024-05-25T00:20:01.115468453Z 2024-05-25T00:20:01.115476314Z 2024-05-25T00:20:01.115484354Z 2024-05-25T00:20:01.120893681Z [2024-05-25T00:20:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T00:20:01.121268936Z [2024-05-25T00:20:01.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:20:01.121580869Z [2024-05-25T00:20:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:20:01.121829214Z [2024-05-25T00:20:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:20:01.122199125Z [2024-05-25T00:20:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:20:01.122332713Z [2024-05-25T00:20:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:20:01.122603859Z [2024-05-25T00:20:01.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:20:01.122751616Z [2024-05-25T00:20:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:20:01.123212830Z [2024-05-25T00:20:01.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:20:01.123425196Z [2024-05-25T00:20:01.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:20:01.647563934Z [2024-05-25T00:20:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status queued for try_number 1 2024-05-25T00:20:01.647946733Z [2024-05-25T00:20:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:18:00+00:00 exited with status queued for try_number 1 2024-05-25T00:20:01.648137374Z [2024-05-25T00:20:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:19:00+00:00 exited with status queued for try_number 1 2024-05-25T00:20:01.648361490Z [2024-05-25T00:20:01.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:19:00+00:00 exited with status queued for try_number 1 2024-05-25T00:20:01.648537034Z [2024-05-25T00:20:01.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:19:00+00:00 exited with status queued for try_number 1 2024-05-25T00:20:01.660992661Z [2024-05-25T00:20:01.660+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a73e9e8-e209-41b9-a3b8-f01253246cda 2024-05-25T00:20:01.661390141Z [2024-05-25T00:20:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61ea3e63-f6f8-48af-bcdd-edd4d011572e 2024-05-25T00:20:01.661635611Z [2024-05-25T00:20:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcd53ed8-1d63-44e9-8915-5fdb4985971c 2024-05-25T00:20:01.661880557Z [2024-05-25T00:20:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcdd4755-be47-43be-bb00-014ee9c78a7d 2024-05-25T00:20:01.662114705Z [2024-05-25T00:20:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 681bada7-e9c2-46f7-9428-df7f949444e7 2024-05-25T00:20:03.008543983Z [2024-05-25T00:20:03.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:19:00+00:00 exited with status success for try_number 1 2024-05-25T00:20:03.018263599Z [2024-05-25T00:20:03.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:19:00+00:00, map_index=-1, run_start_date=2024-05-25 00:20:02.422143+00:00, run_end_date=2024-05-25 00:20:02.812540+00:00, run_duration=0.390397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:20:01.116727+00:00, queued_by_job_id=1, pid=5444 2024-05-25T00:20:03.850718035Z [2024-05-25T00:20:03.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:20:03.851096876Z [2024-05-25T00:20:03.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:19:00+00:00, run_id=scheduled__2024-05-25T00:19:00+00:00, run_start_date=2024-05-25 00:20:01.001630+00:00, run_end_date=2024-05-25 00:20:03.850661+00:00, run_duration=2.849031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:19:00+00:00, data_interval_end=2024-05-25 00:20:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:20:03.864360303Z [2024-05-25T00:20:03.864+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:20:00+00:00, run_after=2024-05-25T00:21:00+00:00 2024-05-25T00:20:03.899072890Z [2024-05-25T00:20:03.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:20:03.899096308Z [2024-05-25T00:20:03.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:18:00+00:00, run_id=scheduled__2024-05-25T00:18:00+00:00, run_start_date=2024-05-25 00:20:00.999061+00:00, run_end_date=2024-05-25 00:20:03.892359+00:00, run_duration=2.893298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:18:00+00:00, data_interval_end=2024-05-25 00:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:20:03.918050277Z [2024-05-25T00:20:03.916+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:20:00+00:00, run_after=2024-05-25T00:22:00+00:00 2024-05-25T00:20:04.042139735Z [2024-05-25T00:20:04.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:18:00+00:00 exited with status success for try_number 1 2024-05-25T00:20:04.042209662Z [2024-05-25T00:20:04.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:18:00+00:00, map_index=-1, run_start_date=2024-05-25 00:20:02.929472+00:00, run_end_date=2024-05-25 00:20:03.512689+00:00, run_duration=0.583217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:20:01.116727+00:00, queued_by_job_id=1, pid=5452 2024-05-25T00:20:05.171918638Z [2024-05-25T00:20:05.171+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:20:05.171986929Z 2024-05-25T00:20:05.171991705Z [2024-05-25T00:20:05.171+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:20:05.172660916Z [2024-05-25T00:20:05.172+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:20:05.172671090Z 2024-05-25T00:20:05.175101608Z [2024-05-25T00:20:05.174+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T00:20:05.175372398Z [2024-05-25T00:20:05.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:20:05.232369691Z [2024-05-25T00:20:05.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status queued for try_number 1 2024-05-25T00:20:05.232672353Z [2024-05-25T00:20:05.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status success for try_number 1 2024-05-25T00:20:05.240071578Z [2024-05-25T00:20:05.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48756e02-5e5d-4398-aa46-21682e878bb7 2024-05-25T00:20:05.240489049Z [2024-05-25T00:20:05.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T00:15:00+00:00, map_index=-1, run_start_date=2024-05-25 00:20:04.087637+00:00, run_end_date=2024-05-25 00:20:04.549471+00:00, run_duration=0.461834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:20:01.116727+00:00, queued_by_job_id=1, pid=5475 2024-05-25T00:20:06.399733203Z [2024-05-25T00:20:06.399+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:20:06.399955372Z [2024-05-25T00:20:06.399+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:19:00+00:00, run_id=scheduled__2024-05-25T00:19:00+00:00, run_start_date=2024-05-25 00:20:01.004363+00:00, run_end_date=2024-05-25 00:20:06.399606+00:00, run_duration=5.395243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:19:00+00:00, data_interval_end=2024-05-25 00:20:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:20:06.417112991Z [2024-05-25T00:20:06.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:20:00+00:00, run_after=2024-05-25T00:21:00+00:00 2024-05-25T00:20:06.432165258Z [2024-05-25T00:20:06.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:20:06.432570274Z [2024-05-25T00:20:06.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:19:00+00:00, run_id=scheduled__2024-05-25T00:19:00+00:00, run_start_date=2024-05-25 00:20:01.006737+00:00, run_end_date=2024-05-25 00:20:06.432097+00:00, run_duration=5.42536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:19:00+00:00, data_interval_end=2024-05-25 00:20:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:20:06.447498211Z [2024-05-25T00:20:06.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:20:00+00:00, run_after=2024-05-25T00:21:00+00:00 2024-05-25T00:20:06.535360998Z [2024-05-25T00:20:06.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:19:00+00:00 exited with status success for try_number 1 2024-05-25T00:20:06.535390683Z [2024-05-25T00:20:06.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:19:00+00:00 exited with status success for try_number 1 2024-05-25T00:20:06.545142216Z [2024-05-25T00:20:06.544+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:19:00+00:00, map_index=-1, run_start_date=2024-05-25 00:20:04.181620+00:00, run_end_date=2024-05-25 00:20:05.536973+00:00, run_duration=1.355353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:20:01.116727+00:00, queued_by_job_id=1, pid=5476 2024-05-25T00:20:06.545670329Z [2024-05-25T00:20:06.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:19:00+00:00, map_index=-1, run_start_date=2024-05-25 00:20:03.932865+00:00, run_end_date=2024-05-25 00:20:05.652034+00:00, run_duration=1.719169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:20:01.116727+00:00, queued_by_job_id=1, pid=5474 2024-05-25T00:20:07.622565190Z [2024-05-25T00:20:07.622+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:20:07.622602564Z 2024-05-25T00:20:07.622992499Z [2024-05-25T00:20:07.622+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:20:07.624166170Z [2024-05-25T00:20:07.623+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:20:07.624185680Z 2024-05-25T00:20:07.628487857Z [2024-05-25T00:20:07.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T00:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T00:20:07.629100524Z [2024-05-25T00:20:07.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:20:07.718156117Z [2024-05-25T00:20:07.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status queued for try_number 1 2024-05-25T00:20:07.718442393Z [2024-05-25T00:20:07.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status success for try_number 1 2024-05-25T00:20:07.726233131Z [2024-05-25T00:20:07.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to f22511ac-574c-41f7-b925-1138a3ed8479 2024-05-25T00:20:07.726346831Z [2024-05-25T00:20:07.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T00:15:00+00:00, map_index=-1, run_start_date=2024-05-25 00:20:06.977644+00:00, run_end_date=2024-05-25 00:20:07.405668+00:00, run_duration=0.428024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:20:05.173022+00:00, queued_by_job_id=1, pid=5510 2024-05-25T00:20:10.273366309Z [2024-05-25T00:20:10.272+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:20:10.273427273Z 2024-05-25T00:20:10.273609415Z [2024-05-25T00:20:10.273+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:20:10.274232583Z [2024-05-25T00:20:10.274+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:20:10.274242444Z 2024-05-25T00:20:10.276654156Z [2024-05-25T00:20:10.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:20:10.276809272Z [2024-05-25T00:20:10.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:20:10.338286666Z [2024-05-25T00:20:10.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status queued for try_number 1 2024-05-25T00:20:10.338399311Z [2024-05-25T00:20:10.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status success for try_number 1 2024-05-25T00:20:10.344117541Z [2024-05-25T00:20:10.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to b38656ae-5401-4841-8ed6-ad323579f4f5 2024-05-25T00:20:10.344520278Z [2024-05-25T00:20:10.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T00:15:00+00:00, map_index=0, run_start_date=2024-05-25 00:20:09.485504+00:00, run_end_date=2024-05-25 00:20:09.859398+00:00, run_duration=0.373894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:20:07.624967+00:00, queued_by_job_id=1, pid=5521 2024-05-25T00:20:12.588070861Z [2024-05-25T00:20:12.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:20:12.589068818Z [2024-05-25T00:20:12.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:15:00+00:00, run_id=scheduled__2024-05-25T00:15:00+00:00, run_start_date=2024-05-25 00:20:00.996337+00:00, run_end_date=2024-05-25 00:20:12.588060+00:00, run_duration=11.591723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:15:00+00:00, data_interval_end=2024-05-25 00:20:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T00:20:12.597382588Z [2024-05-25T00:20:12.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:20:00+00:00, run_after=2024-05-25T00:25:00+00:00 2024-05-25T00:20:12.637968641Z [2024-05-25T00:20:12.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:15:00+00:00 exited with status success for try_number 1 2024-05-25T00:20:12.646697581Z [2024-05-25T00:20:12.646+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T00:15:00+00:00, map_index=-1, run_start_date=2024-05-25 00:20:11.898105+00:00, run_end_date=2024-05-25 00:20:12.299475+00:00, run_duration=0.40137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:20:10.274675+00:00, queued_by_job_id=1, pid=5529 2024-05-25T00:20:28.286905074Z [2024-05-25T00:20:28.285+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T00:21:00.993435782Z [2024-05-25T00:21:00.992+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:21:01.010628333Z [2024-05-25T00:21:01.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:21:00+00:00, run_after=2024-05-25T00:22:00+00:00 2024-05-25T00:21:01.026989882Z [2024-05-25T00:21:01.026+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:21:00+00:00, run_after=2024-05-25T00:22:00+00:00 2024-05-25T00:21:01.106786849Z [2024-05-25T00:21:01.106+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:21:01.106847997Z 2024-05-25T00:21:01.106926442Z 2024-05-25T00:21:01.106938108Z 2024-05-25T00:21:01.106972987Z [2024-05-25T00:21:01.106+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:21:01.107373473Z [2024-05-25T00:21:01.106+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:21:01.107554920Z [2024-05-25T00:21:01.107+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:21:01.108284899Z [2024-05-25T00:21:01.107+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:21:01.108307562Z 2024-05-25T00:21:01.108316941Z 2024-05-25T00:21:01.108325558Z 2024-05-25T00:21:01.113916327Z [2024-05-25T00:21:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:21:01.113996143Z [2024-05-25T00:21:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:21:01.114359238Z [2024-05-25T00:21:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:21:01.114429575Z [2024-05-25T00:21:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:21:01.114628304Z [2024-05-25T00:21:01.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:21:01.114866109Z [2024-05-25T00:21:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:21:01.466017584Z [2024-05-25T00:21:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status queued for try_number 1 2024-05-25T00:21:01.466316091Z [2024-05-25T00:21:01.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status queued for try_number 1 2024-05-25T00:21:01.468441645Z [2024-05-25T00:21:01.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status queued for try_number 1 2024-05-25T00:21:01.483905762Z [2024-05-25T00:21:01.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4af808a8-f2ce-4939-b198-05e19a6c3da7 2024-05-25T00:21:01.484252478Z [2024-05-25T00:21:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ebafd8f-4074-40ae-a63d-a27c4330cb27 2024-05-25T00:21:01.484423627Z [2024-05-25T00:21:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4791dc92-252a-4944-a363-26efe55924ae 2024-05-25T00:21:02.638363658Z [2024-05-25T00:21:02.637+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:21:02.638963245Z [2024-05-25T00:21:02.638+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:20:00+00:00, run_id=scheduled__2024-05-25T00:20:00+00:00, run_start_date=2024-05-25 00:21:01.037864+00:00, run_end_date=2024-05-25 00:21:02.638416+00:00, run_duration=1.600552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:20:00+00:00, data_interval_end=2024-05-25 00:21:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:21:02.656277017Z [2024-05-25T00:21:02.655+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:21:00+00:00, run_after=2024-05-25T00:22:00+00:00 2024-05-25T00:21:02.725401101Z [2024-05-25T00:21:02.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status success for try_number 1 2024-05-25T00:21:02.737106396Z [2024-05-25T00:21:02.736+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:20:00+00:00, map_index=-1, run_start_date=2024-05-25 00:21:01.874315+00:00, run_end_date=2024-05-25 00:21:02.268343+00:00, run_duration=0.394028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:21:01.109342+00:00, queued_by_job_id=1, pid=5538 2024-05-25T00:21:04.907882167Z [2024-05-25T00:21:04.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:21:04.908428124Z [2024-05-25T00:21:04.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:20:00+00:00, run_id=scheduled__2024-05-25T00:20:00+00:00, run_start_date=2024-05-25 00:21:01.039654+00:00, run_end_date=2024-05-25 00:21:04.907703+00:00, run_duration=3.868049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:20:00+00:00, data_interval_end=2024-05-25 00:21:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:21:04.919185004Z [2024-05-25T00:21:04.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:21:00+00:00, run_after=2024-05-25T00:22:00+00:00 2024-05-25T00:21:04.960218814Z [2024-05-25T00:21:04.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status success for try_number 1 2024-05-25T00:21:04.966789116Z [2024-05-25T00:21:04.966+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:20:00+00:00, map_index=-1, run_start_date=2024-05-25 00:21:03.090719+00:00, run_end_date=2024-05-25 00:21:04.553654+00:00, run_duration=1.462935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:21:01.109342+00:00, queued_by_job_id=1, pid=5556 2024-05-25T00:21:06.029965392Z [2024-05-25T00:21:06.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:21:06.030027640Z [2024-05-25T00:21:06.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:20:00+00:00, run_id=scheduled__2024-05-25T00:20:00+00:00, run_start_date=2024-05-25 00:21:01.040754+00:00, run_end_date=2024-05-25 00:21:06.029767+00:00, run_duration=4.989013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:20:00+00:00, data_interval_end=2024-05-25 00:21:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:21:06.039802094Z [2024-05-25T00:21:06.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:21:00+00:00, run_after=2024-05-25T00:22:00+00:00 2024-05-25T00:21:06.094195156Z [2024-05-25T00:21:06.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status success for try_number 1 2024-05-25T00:21:06.102045994Z [2024-05-25T00:21:06.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:20:00+00:00, map_index=-1, run_start_date=2024-05-25 00:21:03.224747+00:00, run_end_date=2024-05-25 00:21:04.927045+00:00, run_duration=1.702298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:21:01.109342+00:00, queued_by_job_id=1, pid=5557 2024-05-25T00:22:00.351081122Z [2024-05-25T00:22:00.350+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:22:00+00:00, run_after=2024-05-25T00:23:00+00:00 2024-05-25T00:22:00.363418993Z [2024-05-25T00:22:00.363+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:22:00.371247319Z [2024-05-25T00:22:00.370+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:22:00.399560426Z [2024-05-25T00:22:00.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:22:00+00:00, run_after=2024-05-25T00:23:00+00:00 2024-05-25T00:22:00.505111028Z [2024-05-25T00:22:00.504+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:22:00.505290869Z 2024-05-25T00:22:00.505325218Z 2024-05-25T00:22:00.505332285Z 2024-05-25T00:22:00.505362973Z 2024-05-25T00:22:00.505771692Z [2024-05-25T00:22:00.504+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:22:00.506190804Z [2024-05-25T00:22:00.505+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:22:00.506688324Z [2024-05-25T00:22:00.506+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:22:00.507153695Z [2024-05-25T00:22:00.506+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:22:00.508451274Z [2024-05-25T00:22:00.508+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:22:00.508471878Z 2024-05-25T00:22:00.508479986Z 2024-05-25T00:22:00.508553111Z 2024-05-25T00:22:00.508560647Z 2024-05-25T00:22:00.514747739Z [2024-05-25T00:22:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:22:00.515074672Z [2024-05-25T00:22:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:22:00.515545452Z [2024-05-25T00:22:00.515+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:22:00.515951644Z [2024-05-25T00:22:00.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:22:00.516443619Z [2024-05-25T00:22:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:22:00.516739712Z [2024-05-25T00:22:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:22:00.517202340Z [2024-05-25T00:22:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:22:00.517541539Z [2024-05-25T00:22:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:22:00.818790906Z [2024-05-25T00:22:00.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status queued for try_number 1 2024-05-25T00:22:00.819073661Z [2024-05-25T00:22:00.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:21:00+00:00 exited with status queued for try_number 1 2024-05-25T00:22:00.819283420Z [2024-05-25T00:22:00.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:21:00+00:00 exited with status queued for try_number 1 2024-05-25T00:22:00.819482659Z [2024-05-25T00:22:00.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:21:00+00:00 exited with status queued for try_number 1 2024-05-25T00:22:00.840676663Z [2024-05-25T00:22:00.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to d716517c-5619-4dee-bbd3-e1ba17c76a6d 2024-05-25T00:22:00.840836165Z [2024-05-25T00:22:00.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0305d659-36f0-4966-a388-a60bfbef2709 2024-05-25T00:22:00.840983091Z [2024-05-25T00:22:00.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c9bdc25-8b2b-462e-9b09-787fda00aae5 2024-05-25T00:22:00.841140561Z [2024-05-25T00:22:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccc565e2-b9bf-437d-80ed-16c25b0d9726 2024-05-25T00:22:02.038341692Z [2024-05-25T00:22:02.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:22:02.038766686Z [2024-05-25T00:22:02.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:20:00+00:00, run_id=scheduled__2024-05-25T00:20:00+00:00, run_start_date=2024-05-25 00:22:00.416640+00:00, run_end_date=2024-05-25 00:22:02.038396+00:00, run_duration=1.621756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:20:00+00:00, data_interval_end=2024-05-25 00:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:22:02.046339904Z [2024-05-25T00:22:02.046+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:22:00+00:00, run_after=2024-05-25T00:24:00+00:00 2024-05-25T00:22:02.052504139Z [2024-05-25T00:22:02.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:22:02.052796846Z [2024-05-25T00:22:02.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:21:00+00:00, run_id=scheduled__2024-05-25T00:21:00+00:00, run_start_date=2024-05-25 00:22:00.418823+00:00, run_end_date=2024-05-25 00:22:02.052485+00:00, run_duration=1.633662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:21:00+00:00, data_interval_end=2024-05-25 00:22:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:22:02.063003700Z [2024-05-25T00:22:02.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:22:00+00:00, run_after=2024-05-25T00:23:00+00:00 2024-05-25T00:22:02.108881220Z [2024-05-25T00:22:02.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status success for try_number 1 2024-05-25T00:22:02.113963987Z [2024-05-25T00:22:02.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:20:00+00:00, map_index=-1, run_start_date=2024-05-25 00:22:01.213872+00:00, run_end_date=2024-05-25 00:22:01.705448+00:00, run_duration=0.491576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:22:00.510675+00:00, queued_by_job_id=1, pid=5585 2024-05-25T00:22:03.213678228Z [2024-05-25T00:22:03.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:21:00+00:00 exited with status success for try_number 1 2024-05-25T00:22:03.222064103Z [2024-05-25T00:22:03.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:21:00+00:00, map_index=-1, run_start_date=2024-05-25 00:22:01.552618+00:00, run_end_date=2024-05-25 00:22:01.990802+00:00, run_duration=0.438184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:22:00.510675+00:00, queued_by_job_id=1, pid=5592 2024-05-25T00:22:05.404935159Z [2024-05-25T00:22:05.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:22:05.405701783Z [2024-05-25T00:22:05.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:21:00+00:00, run_id=scheduled__2024-05-25T00:21:00+00:00, run_start_date=2024-05-25 00:22:00.421322+00:00, run_end_date=2024-05-25 00:22:05.404805+00:00, run_duration=4.983483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:21:00+00:00, data_interval_end=2024-05-25 00:22:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:22:05.426135643Z [2024-05-25T00:22:05.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:22:00+00:00, run_after=2024-05-25T00:23:00+00:00 2024-05-25T00:22:05.435757797Z [2024-05-25T00:22:05.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:22:05.436842432Z [2024-05-25T00:22:05.435+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:21:00+00:00, run_id=scheduled__2024-05-25T00:21:00+00:00, run_start_date=2024-05-25 00:22:00.423752+00:00, run_end_date=2024-05-25 00:22:05.435601+00:00, run_duration=5.011849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:21:00+00:00, data_interval_end=2024-05-25 00:22:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:22:05.446060657Z [2024-05-25T00:22:05.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:22:00+00:00, run_after=2024-05-25T00:23:00+00:00 2024-05-25T00:22:05.496650666Z [2024-05-25T00:22:05.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:21:00+00:00 exited with status success for try_number 1 2024-05-25T00:22:05.496992253Z [2024-05-25T00:22:05.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:21:00+00:00 exited with status success for try_number 1 2024-05-25T00:22:05.508681461Z [2024-05-25T00:22:05.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:21:00+00:00, map_index=-1, run_start_date=2024-05-25 00:22:02.580927+00:00, run_end_date=2024-05-25 00:22:04.710742+00:00, run_duration=2.129815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:22:00.510675+00:00, queued_by_job_id=1, pid=5615 2024-05-25T00:22:05.509083703Z [2024-05-25T00:22:05.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:21:00+00:00, map_index=-1, run_start_date=2024-05-25 00:22:02.574932+00:00, run_end_date=2024-05-25 00:22:05.048306+00:00, run_duration=2.473374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:22:00.510675+00:00, queued_by_job_id=1, pid=5614 2024-05-25T00:23:00.786447759Z [2024-05-25T00:23:00.785+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:23:00+00:00, run_after=2024-05-25T00:24:00+00:00 2024-05-25T00:23:00.797101229Z [2024-05-25T00:23:00.796+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:23:00.812568206Z [2024-05-25T00:23:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:23:00+00:00, run_after=2024-05-25T00:24:00+00:00 2024-05-25T00:23:00.899460675Z [2024-05-25T00:23:00.898+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:23:00.899494391Z 2024-05-25T00:23:00.899501067Z 2024-05-25T00:23:00.899526821Z 2024-05-25T00:23:00.899843260Z [2024-05-25T00:23:00.899+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:23:00.900183340Z [2024-05-25T00:23:00.899+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:23:00.900477162Z [2024-05-25T00:23:00.900+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:23:00.901517229Z [2024-05-25T00:23:00.901+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:23:00.901538473Z 2024-05-25T00:23:00.901544896Z 2024-05-25T00:23:00.901550544Z 2024-05-25T00:23:00.906857538Z [2024-05-25T00:23:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:23:00.906880470Z [2024-05-25T00:23:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:23:00.907421700Z [2024-05-25T00:23:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:23:00.907696443Z [2024-05-25T00:23:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:23:00.908195723Z [2024-05-25T00:23:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:23:00.908484766Z [2024-05-25T00:23:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:23:01.162884870Z [2024-05-25T00:23:01.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:22:00+00:00 exited with status queued for try_number 1 2024-05-25T00:23:01.162910732Z [2024-05-25T00:23:01.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:22:00+00:00 exited with status queued for try_number 1 2024-05-25T00:23:01.162985249Z [2024-05-25T00:23:01.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:22:00+00:00 exited with status queued for try_number 1 2024-05-25T00:23:01.182865669Z [2024-05-25T00:23:01.182+0000] {scheduler_job.py:635} INFO - Setting external_id for to 386ffdc1-a0bd-4d87-946d-bb9041488d4c 2024-05-25T00:23:01.183061494Z [2024-05-25T00:23:01.182+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b7b1257-a6cc-4c8e-8c17-55109c59099a 2024-05-25T00:23:01.183284634Z [2024-05-25T00:23:01.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to 270c2181-fd15-440e-b335-7b86f5616f61 2024-05-25T00:23:02.876395780Z [2024-05-25T00:23:02.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:23:02.877271706Z [2024-05-25T00:23:02.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:22:00+00:00, run_id=scheduled__2024-05-25T00:22:00+00:00, run_start_date=2024-05-25 00:23:00.825292+00:00, run_end_date=2024-05-25 00:23:02.876308+00:00, run_duration=2.051016, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:22:00+00:00, data_interval_end=2024-05-25 00:23:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:23:02.895179493Z [2024-05-25T00:23:02.894+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:23:00+00:00, run_after=2024-05-25T00:24:00+00:00 2024-05-25T00:23:02.959295197Z [2024-05-25T00:23:02.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:22:00+00:00 exited with status success for try_number 1 2024-05-25T00:23:02.967694987Z [2024-05-25T00:23:02.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:22:00+00:00, map_index=-1, run_start_date=2024-05-25 00:23:01.709967+00:00, run_end_date=2024-05-25 00:23:02.159308+00:00, run_duration=0.449341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:23:00.902729+00:00, queued_by_job_id=1, pid=5647 2024-05-25T00:23:05.130866207Z [2024-05-25T00:23:05.130+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:23:05.131147094Z [2024-05-25T00:23:05.130+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:22:00+00:00, run_id=scheduled__2024-05-25T00:22:00+00:00, run_start_date=2024-05-25 00:23:00.826455+00:00, run_end_date=2024-05-25 00:23:05.130651+00:00, run_duration=4.304196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:22:00+00:00, data_interval_end=2024-05-25 00:23:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:23:05.142039784Z [2024-05-25T00:23:05.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:23:00+00:00, run_after=2024-05-25T00:24:00+00:00 2024-05-25T00:23:05.217107388Z [2024-05-25T00:23:05.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:22:00+00:00 exited with status success for try_number 1 2024-05-25T00:23:05.227197626Z [2024-05-25T00:23:05.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:22:00+00:00, map_index=-1, run_start_date=2024-05-25 00:23:02.849101+00:00, run_end_date=2024-05-25 00:23:04.629811+00:00, run_duration=1.78071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:23:00.902729+00:00, queued_by_job_id=1, pid=5665 2024-05-25T00:23:06.276937940Z [2024-05-25T00:23:06.276+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:23:06.277422132Z [2024-05-25T00:23:06.277+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:22:00+00:00, run_id=scheduled__2024-05-25T00:22:00+00:00, run_start_date=2024-05-25 00:23:00.827537+00:00, run_end_date=2024-05-25 00:23:06.276833+00:00, run_duration=5.449296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:22:00+00:00, data_interval_end=2024-05-25 00:23:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:23:06.288257346Z [2024-05-25T00:23:06.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:23:00+00:00, run_after=2024-05-25T00:24:00+00:00 2024-05-25T00:23:06.329433113Z [2024-05-25T00:23:06.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:22:00+00:00 exited with status success for try_number 1 2024-05-25T00:23:06.334798070Z [2024-05-25T00:23:06.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:22:00+00:00, map_index=-1, run_start_date=2024-05-25 00:23:02.852828+00:00, run_end_date=2024-05-25 00:23:05.211269+00:00, run_duration=2.358441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:23:00.902729+00:00, queued_by_job_id=1, pid=5666 2024-05-25T00:24:00.146550880Z [2024-05-25T00:24:00.145+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:24:00.165846965Z [2024-05-25T00:24:00.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:24:00+00:00, run_after=2024-05-25T00:25:00+00:00 2024-05-25T00:24:00.174728604Z [2024-05-25T00:24:00.174+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:24:00.187614429Z [2024-05-25T00:24:00.187+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:24:00+00:00, run_after=2024-05-25T00:25:00+00:00 2024-05-25T00:24:00.277380553Z [2024-05-25T00:24:00.276+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:24:00.277406304Z 2024-05-25T00:24:00.277410879Z 2024-05-25T00:24:00.277414175Z 2024-05-25T00:24:00.277417270Z 2024-05-25T00:24:00.277906771Z [2024-05-25T00:24:00.277+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:24:00.278279322Z [2024-05-25T00:24:00.278+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:24:00.278623192Z [2024-05-25T00:24:00.278+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:24:00.278972286Z [2024-05-25T00:24:00.278+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:24:00.280807037Z [2024-05-25T00:24:00.280+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:24:00.280823573Z 2024-05-25T00:24:00.280829083Z 2024-05-25T00:24:00.280833745Z 2024-05-25T00:24:00.280838533Z 2024-05-25T00:24:00.287976883Z [2024-05-25T00:24:00.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:24:00.288484512Z [2024-05-25T00:24:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:24:00.289104887Z [2024-05-25T00:24:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:24:00.289551128Z [2024-05-25T00:24:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:24:00.290267207Z [2024-05-25T00:24:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:24:00.290653297Z [2024-05-25T00:24:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:24:00.291262621Z [2024-05-25T00:24:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:24:00.291635844Z [2024-05-25T00:24:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:24:00.686091331Z [2024-05-25T00:24:00.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:22:00+00:00 exited with status queued for try_number 1 2024-05-25T00:24:00.686384800Z [2024-05-25T00:24:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:23:00+00:00 exited with status queued for try_number 1 2024-05-25T00:24:00.686705011Z [2024-05-25T00:24:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:23:00+00:00 exited with status queued for try_number 1 2024-05-25T00:24:00.686894270Z [2024-05-25T00:24:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:23:00+00:00 exited with status queued for try_number 1 2024-05-25T00:24:00.702817083Z [2024-05-25T00:24:00.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68ae60c2-5999-439d-a631-0989a1e7b1cb 2024-05-25T00:24:00.703068561Z [2024-05-25T00:24:00.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b282496-e207-495b-8499-95fb02cb3cb1 2024-05-25T00:24:00.703263086Z [2024-05-25T00:24:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f5dd685-afdf-4d70-a0d8-3c934dddea03 2024-05-25T00:24:00.703464365Z [2024-05-25T00:24:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0c94ab3-7f37-48d7-bc8e-96bf38598d42 2024-05-25T00:24:01.896278476Z [2024-05-25T00:24:01.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:24:01.898120330Z [2024-05-25T00:24:01.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:22:00+00:00, run_id=scheduled__2024-05-25T00:22:00+00:00, run_start_date=2024-05-25 00:24:00.206809+00:00, run_end_date=2024-05-25 00:24:01.897509+00:00, run_duration=1.6907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:22:00+00:00, data_interval_end=2024-05-25 00:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:24:01.914514016Z [2024-05-25T00:24:01.914+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:24:00+00:00, run_after=2024-05-25T00:26:00+00:00 2024-05-25T00:24:02.054325971Z [2024-05-25T00:24:02.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:22:00+00:00 exited with status success for try_number 1 2024-05-25T00:24:02.059730448Z [2024-05-25T00:24:02.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:22:00+00:00, map_index=-1, run_start_date=2024-05-25 00:24:01.219193+00:00, run_end_date=2024-05-25 00:24:01.731630+00:00, run_duration=0.512437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:24:00.283656+00:00, queued_by_job_id=1, pid=5695 2024-05-25T00:24:02.676771080Z [2024-05-25T00:24:02.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:24:02.677430336Z [2024-05-25T00:24:02.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:23:00+00:00, run_id=scheduled__2024-05-25T00:23:00+00:00, run_start_date=2024-05-25 00:24:00.208236+00:00, run_end_date=2024-05-25 00:24:02.676680+00:00, run_duration=2.468444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:23:00+00:00, data_interval_end=2024-05-25 00:24:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:24:02.691067132Z [2024-05-25T00:24:02.690+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:24:00+00:00, run_after=2024-05-25T00:25:00+00:00 2024-05-25T00:24:02.761974922Z [2024-05-25T00:24:02.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:23:00+00:00 exited with status success for try_number 1 2024-05-25T00:24:02.772091586Z [2024-05-25T00:24:02.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:23:00+00:00, map_index=-1, run_start_date=2024-05-25 00:24:01.866366+00:00, run_end_date=2024-05-25 00:24:02.485842+00:00, run_duration=0.619476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:24:00.283656+00:00, queued_by_job_id=1, pid=5707 2024-05-25T00:24:04.981890254Z [2024-05-25T00:24:04.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:24:04.982187483Z [2024-05-25T00:24:04.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:23:00+00:00, run_id=scheduled__2024-05-25T00:23:00+00:00, run_start_date=2024-05-25 00:24:00.209570+00:00, run_end_date=2024-05-25 00:24:04.981559+00:00, run_duration=4.771989, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:23:00+00:00, data_interval_end=2024-05-25 00:24:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:24:05.001802886Z [2024-05-25T00:24:05.001+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:24:00+00:00, run_after=2024-05-25T00:25:00+00:00 2024-05-25T00:24:05.059836072Z [2024-05-25T00:24:05.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:23:00+00:00 exited with status success for try_number 1 2024-05-25T00:24:05.067538223Z [2024-05-25T00:24:05.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:23:00+00:00, map_index=-1, run_start_date=2024-05-25 00:24:02.928404+00:00, run_end_date=2024-05-25 00:24:04.600769+00:00, run_duration=1.672365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:24:00.283656+00:00, queued_by_job_id=1, pid=5725 2024-05-25T00:24:06.119724714Z [2024-05-25T00:24:06.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:24:06.122286540Z [2024-05-25T00:24:06.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:23:00+00:00, run_id=scheduled__2024-05-25T00:23:00+00:00, run_start_date=2024-05-25 00:24:00.211456+00:00, run_end_date=2024-05-25 00:24:06.121374+00:00, run_duration=5.909918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:23:00+00:00, data_interval_end=2024-05-25 00:24:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:24:06.142484919Z [2024-05-25T00:24:06.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:24:00+00:00, run_after=2024-05-25T00:25:00+00:00 2024-05-25T00:24:06.175716731Z [2024-05-25T00:24:06.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:23:00+00:00 exited with status success for try_number 1 2024-05-25T00:24:06.185325487Z [2024-05-25T00:24:06.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:23:00+00:00, map_index=-1, run_start_date=2024-05-25 00:24:02.863623+00:00, run_end_date=2024-05-25 00:24:05.189110+00:00, run_duration=2.325487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:24:00.283656+00:00, queued_by_job_id=1, pid=5724 2024-05-25T00:25:00.725302251Z [2024-05-25T00:25:00.724+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:25:00.745076518Z [2024-05-25T00:25:00.744+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:25:00+00:00, run_after=2024-05-25T00:30:00+00:00 2024-05-25T00:25:00.770663859Z [2024-05-25T00:25:00.770+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:25:00+00:00, run_after=2024-05-25T00:26:00+00:00 2024-05-25T00:25:00.790257408Z [2024-05-25T00:25:00.789+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:25:00+00:00, run_after=2024-05-25T00:26:00+00:00 2024-05-25T00:25:00.914515540Z [2024-05-25T00:25:00.913+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:25:00.914564364Z 2024-05-25T00:25:00.914574140Z 2024-05-25T00:25:00.914581982Z 2024-05-25T00:25:00.914589154Z 2024-05-25T00:25:00.914954680Z [2024-05-25T00:25:00.914+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:25:00.915247594Z [2024-05-25T00:25:00.914+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:25:00.915421047Z [2024-05-25T00:25:00.915+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:25:00.915635134Z [2024-05-25T00:25:00.915+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:25:00.916856453Z [2024-05-25T00:25:00.916+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:25:00.916868655Z 2024-05-25T00:25:00.916873030Z 2024-05-25T00:25:00.916876819Z 2024-05-25T00:25:00.916880385Z 2024-05-25T00:25:00.922517639Z [2024-05-25T00:25:00.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T00:25:00.922849006Z [2024-05-25T00:25:00.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:25:00.923290653Z [2024-05-25T00:25:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:25:00.923458424Z [2024-05-25T00:25:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:25:00.923804225Z [2024-05-25T00:25:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:25:00.923983103Z [2024-05-25T00:25:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:25:00.924346633Z [2024-05-25T00:25:00.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:25:00.924519905Z [2024-05-25T00:25:00.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:25:01.207896846Z [2024-05-25T00:25:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status queued for try_number 1 2024-05-25T00:25:01.207944316Z [2024-05-25T00:25:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:24:00+00:00 exited with status queued for try_number 1 2024-05-25T00:25:01.210007750Z [2024-05-25T00:25:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:24:00+00:00 exited with status queued for try_number 1 2024-05-25T00:25:01.210088108Z [2024-05-25T00:25:01.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:24:00+00:00 exited with status queued for try_number 1 2024-05-25T00:25:01.222766814Z [2024-05-25T00:25:01.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66e5159c-9ddb-4ca6-ab76-20d4cbaeb7a5 2024-05-25T00:25:01.222887996Z [2024-05-25T00:25:01.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e657a3d-3d10-43d8-999f-c22b8d44d50a 2024-05-25T00:25:01.223046948Z [2024-05-25T00:25:01.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to 910ecab0-68d0-4065-ae71-b1df9c750c39 2024-05-25T00:25:01.223368553Z [2024-05-25T00:25:01.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70777a7e-2e86-4646-92bf-467b878b2d39 2024-05-25T00:25:03.654124876Z [2024-05-25T00:25:03.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:25:03.654839754Z [2024-05-25T00:25:03.654+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:24:00+00:00, run_id=scheduled__2024-05-25T00:24:00+00:00, run_start_date=2024-05-25 00:25:00.809979+00:00, run_end_date=2024-05-25 00:25:03.654422+00:00, run_duration=2.844443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:24:00+00:00, data_interval_end=2024-05-25 00:25:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:25:03.665185011Z [2024-05-25T00:25:03.664+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:25:00+00:00, run_after=2024-05-25T00:26:00+00:00 2024-05-25T00:25:03.705718185Z [2024-05-25T00:25:03.705+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:25:03.705743828Z 2024-05-25T00:25:03.706000891Z [2024-05-25T00:25:03.705+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:25:03.706609354Z [2024-05-25T00:25:03.706+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:25:03.706620679Z 2024-05-25T00:25:03.708749081Z [2024-05-25T00:25:03.708+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T00:25:03.708996223Z [2024-05-25T00:25:03.708+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:25:03.759896434Z [2024-05-25T00:25:03.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status queued for try_number 1 2024-05-25T00:25:03.760192103Z [2024-05-25T00:25:03.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:24:00+00:00 exited with status success for try_number 1 2024-05-25T00:25:03.769046399Z [2024-05-25T00:25:03.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17805b1b-0ac5-46d5-98a7-91534d70078b 2024-05-25T00:25:03.769416491Z [2024-05-25T00:25:03.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:24:00+00:00, map_index=-1, run_start_date=2024-05-25 00:25:02.071173+00:00, run_end_date=2024-05-25 00:25:02.746173+00:00, run_duration=0.675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:25:00.918550+00:00, queued_by_job_id=1, pid=5761 2024-05-25T00:25:04.013900752Z [2024-05-25T00:25:04.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status success for try_number 1 2024-05-25T00:25:04.021326149Z [2024-05-25T00:25:04.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T00:20:00+00:00, map_index=-1, run_start_date=2024-05-25 00:25:03.166811+00:00, run_end_date=2024-05-25 00:25:03.583102+00:00, run_duration=0.416291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:25:00.918550+00:00, queued_by_job_id=1, pid=5782 2024-05-25T00:25:05.085412102Z [2024-05-25T00:25:05.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:25:05.085487872Z [2024-05-25T00:25:05.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:24:00+00:00, run_id=scheduled__2024-05-25T00:24:00+00:00, run_start_date=2024-05-25 00:25:00.813327+00:00, run_end_date=2024-05-25 00:25:05.084513+00:00, run_duration=4.271186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:24:00+00:00, data_interval_end=2024-05-25 00:25:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:25:05.114079871Z [2024-05-25T00:25:05.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:25:00+00:00, run_after=2024-05-25T00:26:00+00:00 2024-05-25T00:25:05.125203487Z [2024-05-25T00:25:05.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:25:05.125657774Z [2024-05-25T00:25:05.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:24:00+00:00, run_id=scheduled__2024-05-25T00:24:00+00:00, run_start_date=2024-05-25 00:25:00.815444+00:00, run_end_date=2024-05-25 00:25:05.125337+00:00, run_duration=4.309893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:24:00+00:00, data_interval_end=2024-05-25 00:25:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:25:05.137671221Z [2024-05-25T00:25:05.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:25:00+00:00, run_after=2024-05-25T00:26:00+00:00 2024-05-25T00:25:05.210955022Z [2024-05-25T00:25:05.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:24:00+00:00 exited with status success for try_number 1 2024-05-25T00:25:05.211080817Z [2024-05-25T00:25:05.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:24:00+00:00 exited with status success for try_number 1 2024-05-25T00:25:05.218836284Z [2024-05-25T00:25:05.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:24:00+00:00, map_index=-1, run_start_date=2024-05-25 00:25:03.189489+00:00, run_end_date=2024-05-25 00:25:04.532252+00:00, run_duration=1.342763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:25:00.918550+00:00, queued_by_job_id=1, pid=5784 2024-05-25T00:25:05.219183896Z [2024-05-25T00:25:05.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:24:00+00:00, map_index=-1, run_start_date=2024-05-25 00:25:03.214996+00:00, run_end_date=2024-05-25 00:25:04.914203+00:00, run_duration=1.699207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:25:00.918550+00:00, queued_by_job_id=1, pid=5783 2024-05-25T00:25:06.284271182Z [2024-05-25T00:25:06.283+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:25:06.284303938Z 2024-05-25T00:25:06.284501777Z [2024-05-25T00:25:06.284+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:25:06.285594843Z [2024-05-25T00:25:06.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:25:06.285614868Z 2024-05-25T00:25:06.289298143Z [2024-05-25T00:25:06.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T00:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T00:25:06.289570652Z [2024-05-25T00:25:06.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:25:06.357270818Z [2024-05-25T00:25:06.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status queued for try_number 1 2024-05-25T00:25:06.357294301Z [2024-05-25T00:25:06.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status success for try_number 1 2024-05-25T00:25:06.363135238Z [2024-05-25T00:25:06.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to e87acca7-cacf-4729-a3c4-10334fe965e0 2024-05-25T00:25:06.363322203Z [2024-05-25T00:25:06.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T00:20:00+00:00, map_index=-1, run_start_date=2024-05-25 00:25:05.488625+00:00, run_end_date=2024-05-25 00:25:05.823714+00:00, run_duration=0.335089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:25:03.706980+00:00, queued_by_job_id=1, pid=5807 2024-05-25T00:25:08.654389763Z [2024-05-25T00:25:08.654+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:25:08.654418942Z 2024-05-25T00:25:08.654430199Z [2024-05-25T00:25:08.654+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:25:08.655016066Z [2024-05-25T00:25:08.654+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:25:08.655027938Z 2024-05-25T00:25:08.658299884Z [2024-05-25T00:25:08.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:25:08.658595523Z [2024-05-25T00:25:08.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:25:08.716553591Z [2024-05-25T00:25:08.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status queued for try_number 1 2024-05-25T00:25:08.716605947Z [2024-05-25T00:25:08.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status success for try_number 1 2024-05-25T00:25:08.724254491Z [2024-05-25T00:25:08.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fdc5988-3f8b-4578-93bd-c1b090d054c1 2024-05-25T00:25:08.724419358Z [2024-05-25T00:25:08.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T00:20:00+00:00, map_index=0, run_start_date=2024-05-25 00:25:07.954945+00:00, run_end_date=2024-05-25 00:25:08.385515+00:00, run_duration=0.43057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:25:06.286277+00:00, queued_by_job_id=1, pid=5828 2024-05-25T00:25:10.980079779Z [2024-05-25T00:25:10.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:25:10.980731927Z [2024-05-25T00:25:10.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:20:00+00:00, run_id=scheduled__2024-05-25T00:20:00+00:00, run_start_date=2024-05-25 00:25:00.806433+00:00, run_end_date=2024-05-25 00:25:10.980290+00:00, run_duration=10.173857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:20:00+00:00, data_interval_end=2024-05-25 00:25:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T00:25:10.988239845Z [2024-05-25T00:25:10.987+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:25:00+00:00, run_after=2024-05-25T00:30:00+00:00 2024-05-25T00:25:11.028600393Z [2024-05-25T00:25:11.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:20:00+00:00 exited with status success for try_number 1 2024-05-25T00:25:11.034348539Z [2024-05-25T00:25:11.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T00:20:00+00:00, map_index=-1, run_start_date=2024-05-25 00:25:10.208456+00:00, run_end_date=2024-05-25 00:25:10.559272+00:00, run_duration=0.350816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:25:08.655386+00:00, queued_by_job_id=1, pid=5836 2024-05-25T00:25:28.355072499Z [2024-05-25T00:25:28.354+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T00:26:00.697968806Z [2024-05-25T00:26:00.697+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:26:00.708171768Z [2024-05-25T00:26:00.707+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:26:00.731069395Z [2024-05-25T00:26:00.730+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:26:00+00:00, run_after=2024-05-25T00:27:00+00:00 2024-05-25T00:26:00.755126738Z [2024-05-25T00:26:00.754+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:26:00+00:00, run_after=2024-05-25T00:27:00+00:00 2024-05-25T00:26:00.896927020Z [2024-05-25T00:26:00.896+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:26:00.897011693Z 2024-05-25T00:26:00.897023545Z 2024-05-25T00:26:00.897031764Z 2024-05-25T00:26:00.897039731Z 2024-05-25T00:26:00.897269917Z [2024-05-25T00:26:00.896+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:26:00.897393140Z [2024-05-25T00:26:00.896+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:26:00.897467399Z [2024-05-25T00:26:00.897+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:26:00.897661811Z [2024-05-25T00:26:00.897+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:26:00.899047972Z [2024-05-25T00:26:00.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:26:00.899070149Z 2024-05-25T00:26:00.899078885Z 2024-05-25T00:26:00.899143206Z 2024-05-25T00:26:00.899152005Z 2024-05-25T00:26:00.908190932Z [2024-05-25T00:26:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:26:00.908595536Z [2024-05-25T00:26:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:26:00.909196659Z [2024-05-25T00:26:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:26:00.909733185Z [2024-05-25T00:26:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:26:00.910767146Z [2024-05-25T00:26:00.910+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:26:00.911562253Z [2024-05-25T00:26:00.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:26:00.912751750Z [2024-05-25T00:26:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:26:00.913163056Z [2024-05-25T00:26:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:26:01.425489943Z [2024-05-25T00:26:01.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:24:00+00:00 exited with status queued for try_number 1 2024-05-25T00:26:01.425524927Z [2024-05-25T00:26:01.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status queued for try_number 1 2024-05-25T00:26:01.425528555Z [2024-05-25T00:26:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status queued for try_number 1 2024-05-25T00:26:01.425531870Z [2024-05-25T00:26:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status queued for try_number 1 2024-05-25T00:26:01.445748152Z [2024-05-25T00:26:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20e048eb-44f8-4c45-b8d2-e2481d4fbe5e 2024-05-25T00:26:01.445895474Z [2024-05-25T00:26:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf8e666c-3441-4da7-81de-6187392def31 2024-05-25T00:26:01.446021023Z [2024-05-25T00:26:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00de29ac-a6b0-4dfe-aebe-0e2cc4680344 2024-05-25T00:26:01.446155034Z [2024-05-25T00:26:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6fd5c07-df9d-4da3-93dc-d3d675bf1843 2024-05-25T00:26:02.741156859Z [2024-05-25T00:26:02.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:26:02.741424665Z [2024-05-25T00:26:02.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:24:00+00:00, run_id=scheduled__2024-05-25T00:24:00+00:00, run_start_date=2024-05-25 00:26:00.771035+00:00, run_end_date=2024-05-25 00:26:02.741014+00:00, run_duration=1.969979, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:24:00+00:00, data_interval_end=2024-05-25 00:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:26:02.749968446Z [2024-05-25T00:26:02.749+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:26:00+00:00, run_after=2024-05-25T00:28:00+00:00 2024-05-25T00:26:02.758581172Z [2024-05-25T00:26:02.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:26:02.758716608Z [2024-05-25T00:26:02.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:25:00+00:00, run_id=scheduled__2024-05-25T00:25:00+00:00, run_start_date=2024-05-25 00:26:00.773299+00:00, run_end_date=2024-05-25 00:26:02.758445+00:00, run_duration=1.985146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:25:00+00:00, data_interval_end=2024-05-25 00:26:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:26:02.769775455Z [2024-05-25T00:26:02.769+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:26:00+00:00, run_after=2024-05-25T00:27:00+00:00 2024-05-25T00:26:02.841608313Z [2024-05-25T00:26:02.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:24:00+00:00 exited with status success for try_number 1 2024-05-25T00:26:02.843838325Z [2024-05-25T00:26:02.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status success for try_number 1 2024-05-25T00:26:02.855440967Z [2024-05-25T00:26:02.854+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:24:00+00:00, map_index=-1, run_start_date=2024-05-25 00:26:01.759161+00:00, run_end_date=2024-05-25 00:26:02.177898+00:00, run_duration=0.418737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:26:00.900940+00:00, queued_by_job_id=1, pid=5846 2024-05-25T00:26:02.856059003Z [2024-05-25T00:26:02.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:25:00+00:00, map_index=-1, run_start_date=2024-05-25 00:26:01.976402+00:00, run_end_date=2024-05-25 00:26:02.413780+00:00, run_duration=0.437378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:26:00.900940+00:00, queued_by_job_id=1, pid=5847 2024-05-25T00:26:04.716689566Z [2024-05-25T00:26:04.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:26:04.717703866Z [2024-05-25T00:26:04.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:25:00+00:00, run_id=scheduled__2024-05-25T00:25:00+00:00, run_start_date=2024-05-25 00:26:00.774509+00:00, run_end_date=2024-05-25 00:26:04.716556+00:00, run_duration=3.942047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:25:00+00:00, data_interval_end=2024-05-25 00:26:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:26:04.727640904Z [2024-05-25T00:26:04.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:26:00+00:00, run_after=2024-05-25T00:27:00+00:00 2024-05-25T00:26:04.800605420Z [2024-05-25T00:26:04.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status success for try_number 1 2024-05-25T00:26:04.806235425Z [2024-05-25T00:26:04.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:25:00+00:00, map_index=-1, run_start_date=2024-05-25 00:26:02.834130+00:00, run_end_date=2024-05-25 00:26:04.206724+00:00, run_duration=1.372594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:26:00.900940+00:00, queued_by_job_id=1, pid=5865 2024-05-25T00:26:05.856846636Z [2024-05-25T00:26:05.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:26:05.857062746Z [2024-05-25T00:26:05.856+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:25:00+00:00, run_id=scheduled__2024-05-25T00:25:00+00:00, run_start_date=2024-05-25 00:26:00.775705+00:00, run_end_date=2024-05-25 00:26:05.856685+00:00, run_duration=5.08098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:25:00+00:00, data_interval_end=2024-05-25 00:26:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:26:05.865469713Z [2024-05-25T00:26:05.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:26:00+00:00, run_after=2024-05-25T00:27:00+00:00 2024-05-25T00:26:05.898042523Z [2024-05-25T00:26:05.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status success for try_number 1 2024-05-25T00:26:05.915868294Z [2024-05-25T00:26:05.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:25:00+00:00, map_index=-1, run_start_date=2024-05-25 00:26:03.066960+00:00, run_end_date=2024-05-25 00:26:04.991429+00:00, run_duration=1.924469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:26:00.900940+00:00, queued_by_job_id=1, pid=5871 2024-05-25T00:27:00.660687219Z [2024-05-25T00:27:00.660+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:27:00+00:00, run_after=2024-05-25T00:28:00+00:00 2024-05-25T00:27:00.669888363Z [2024-05-25T00:27:00.669+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:27:00.681151147Z [2024-05-25T00:27:00.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:27:00+00:00, run_after=2024-05-25T00:28:00+00:00 2024-05-25T00:27:00.748325972Z [2024-05-25T00:27:00.747+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:27:00.748404279Z 2024-05-25T00:27:00.748411816Z 2024-05-25T00:27:00.748418702Z 2024-05-25T00:27:00.748424505Z [2024-05-25T00:27:00.748+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:27:00.748442830Z [2024-05-25T00:27:00.748+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:27:00.748449149Z [2024-05-25T00:27:00.748+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:27:00.748948839Z [2024-05-25T00:27:00.748+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:27:00.748964378Z 2024-05-25T00:27:00.748970684Z 2024-05-25T00:27:00.748976566Z 2024-05-25T00:27:00.751836832Z [2024-05-25T00:27:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:27:00.751893413Z [2024-05-25T00:27:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:27:00.752060858Z [2024-05-25T00:27:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:27:00.752081123Z [2024-05-25T00:27:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:27:00.752368802Z [2024-05-25T00:27:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:27:00.752382485Z [2024-05-25T00:27:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:27:00.951979310Z [2024-05-25T00:27:00.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:26:00+00:00 exited with status queued for try_number 1 2024-05-25T00:27:00.952299146Z [2024-05-25T00:27:00.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:26:00+00:00 exited with status queued for try_number 1 2024-05-25T00:27:00.952489211Z [2024-05-25T00:27:00.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:26:00+00:00 exited with status queued for try_number 1 2024-05-25T00:27:00.960992756Z [2024-05-25T00:27:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d5b53a9-bcdd-4996-b3af-145548b9c73a 2024-05-25T00:27:00.961399172Z [2024-05-25T00:27:00.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09c253f9-a5da-42c1-ac7c-f80f3d29bde6 2024-05-25T00:27:00.961725063Z [2024-05-25T00:27:00.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06d70319-dac4-4912-b714-a85f6ce164a9 2024-05-25T00:27:02.112429667Z [2024-05-25T00:27:02.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:27:02.114273993Z [2024-05-25T00:27:02.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:26:00+00:00, run_id=scheduled__2024-05-25T00:26:00+00:00, run_start_date=2024-05-25 00:27:00.690208+00:00, run_end_date=2024-05-25 00:27:02.112349+00:00, run_duration=1.422141, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:26:00+00:00, data_interval_end=2024-05-25 00:27:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:27:02.124291859Z [2024-05-25T00:27:02.123+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:27:00+00:00, run_after=2024-05-25T00:28:00+00:00 2024-05-25T00:27:02.190334581Z [2024-05-25T00:27:02.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:26:00+00:00 exited with status success for try_number 1 2024-05-25T00:27:02.202227377Z [2024-05-25T00:27:02.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:26:00+00:00, map_index=-1, run_start_date=2024-05-25 00:27:01.525458+00:00, run_end_date=2024-05-25 00:27:01.947607+00:00, run_duration=0.422149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:27:00.749518+00:00, queued_by_job_id=1, pid=5903 2024-05-25T00:27:04.433586239Z [2024-05-25T00:27:04.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:27:04.433626991Z [2024-05-25T00:27:04.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:26:00+00:00, run_id=scheduled__2024-05-25T00:26:00+00:00, run_start_date=2024-05-25 00:27:00.691364+00:00, run_end_date=2024-05-25 00:27:04.432602+00:00, run_duration=3.741238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:26:00+00:00, data_interval_end=2024-05-25 00:27:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:27:04.444969902Z [2024-05-25T00:27:04.444+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:27:00+00:00, run_after=2024-05-25T00:28:00+00:00 2024-05-25T00:27:04.453809168Z [2024-05-25T00:27:04.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:27:04.454959525Z [2024-05-25T00:27:04.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:26:00+00:00, run_id=scheduled__2024-05-25T00:26:00+00:00, run_start_date=2024-05-25 00:27:00.692315+00:00, run_end_date=2024-05-25 00:27:04.453707+00:00, run_duration=3.761392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:26:00+00:00, data_interval_end=2024-05-25 00:27:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:27:04.464979003Z [2024-05-25T00:27:04.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:27:00+00:00, run_after=2024-05-25T00:28:00+00:00 2024-05-25T00:27:04.508639251Z [2024-05-25T00:27:04.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:26:00+00:00 exited with status success for try_number 1 2024-05-25T00:27:04.508727832Z [2024-05-25T00:27:04.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:26:00+00:00 exited with status success for try_number 1 2024-05-25T00:27:04.516167792Z [2024-05-25T00:27:04.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:26:00+00:00, map_index=-1, run_start_date=2024-05-25 00:27:02.605529+00:00, run_end_date=2024-05-25 00:27:03.967152+00:00, run_duration=1.361623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:27:00.749518+00:00, queued_by_job_id=1, pid=5922 2024-05-25T00:27:04.516226356Z [2024-05-25T00:27:04.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:26:00+00:00, map_index=-1, run_start_date=2024-05-25 00:27:02.556472+00:00, run_end_date=2024-05-25 00:27:04.265829+00:00, run_duration=1.709357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:27:00.749518+00:00, queued_by_job_id=1, pid=5921 2024-05-25T00:28:00.065898329Z [2024-05-25T00:28:00.065+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:28:00+00:00, run_after=2024-05-25T00:29:00+00:00 2024-05-25T00:28:00.073019460Z [2024-05-25T00:28:00.072+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:28:00.079559633Z [2024-05-25T00:28:00.079+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:28:00.091409721Z [2024-05-25T00:28:00.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:28:00+00:00, run_after=2024-05-25T00:29:00+00:00 2024-05-25T00:28:00.158282959Z [2024-05-25T00:28:00.157+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:28:00.158324437Z 2024-05-25T00:28:00.158335388Z 2024-05-25T00:28:00.158344282Z 2024-05-25T00:28:00.158353007Z 2024-05-25T00:28:00.158556894Z [2024-05-25T00:28:00.158+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:28:00.158579662Z [2024-05-25T00:28:00.158+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:28:00.158592537Z [2024-05-25T00:28:00.158+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:28:00.158631382Z [2024-05-25T00:28:00.158+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:28:00.159128006Z [2024-05-25T00:28:00.158+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:28:00.159149954Z 2024-05-25T00:28:00.159162006Z 2024-05-25T00:28:00.159170536Z 2024-05-25T00:28:00.159178767Z 2024-05-25T00:28:00.162672827Z [2024-05-25T00:28:00.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:28:00.162708194Z [2024-05-25T00:28:00.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:28:00.162977003Z [2024-05-25T00:28:00.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:28:00.163018976Z [2024-05-25T00:28:00.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:28:00.163254716Z [2024-05-25T00:28:00.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:28:00.163473249Z [2024-05-25T00:28:00.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:28:00.163648298Z [2024-05-25T00:28:00.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:28:00.163693942Z [2024-05-25T00:28:00.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:28:00.786361351Z [2024-05-25T00:28:00.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:26:00+00:00 exited with status queued for try_number 1 2024-05-25T00:28:00.787544188Z [2024-05-25T00:28:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:27:00+00:00 exited with status queued for try_number 1 2024-05-25T00:28:00.788759276Z [2024-05-25T00:28:00.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:27:00+00:00 exited with status queued for try_number 1 2024-05-25T00:28:00.788939976Z [2024-05-25T00:28:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:27:00+00:00 exited with status queued for try_number 1 2024-05-25T00:28:00.797990788Z [2024-05-25T00:28:00.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10049ea8-b7ad-4ef8-af35-8367836f665b 2024-05-25T00:28:00.798281015Z [2024-05-25T00:28:00.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80220c2d-9859-497f-b7a7-cd191934209c 2024-05-25T00:28:00.798464806Z [2024-05-25T00:28:00.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05e17378-70d9-4ca5-b1cb-1090763d518b 2024-05-25T00:28:00.798628114Z [2024-05-25T00:28:00.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59267aaa-7f3f-47c1-93fa-a9fb3d3792b4 2024-05-25T00:28:01.952851069Z [2024-05-25T00:28:01.952+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:28:01.953141636Z [2024-05-25T00:28:01.952+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:26:00+00:00, run_id=scheduled__2024-05-25T00:26:00+00:00, run_start_date=2024-05-25 00:28:00.101915+00:00, run_end_date=2024-05-25 00:28:01.952750+00:00, run_duration=1.850835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:26:00+00:00, data_interval_end=2024-05-25 00:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:28:01.960980908Z [2024-05-25T00:28:01.960+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:28:00+00:00, run_after=2024-05-25T00:30:00+00:00 2024-05-25T00:28:01.968251901Z [2024-05-25T00:28:01.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:28:01.968553701Z [2024-05-25T00:28:01.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:27:00+00:00, run_id=scheduled__2024-05-25T00:27:00+00:00, run_start_date=2024-05-25 00:28:00.103146+00:00, run_end_date=2024-05-25 00:28:01.968196+00:00, run_duration=1.86505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:27:00+00:00, data_interval_end=2024-05-25 00:28:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:28:01.983514071Z [2024-05-25T00:28:01.983+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:28:00+00:00, run_after=2024-05-25T00:29:00+00:00 2024-05-25T00:28:02.027253666Z [2024-05-25T00:28:02.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:26:00+00:00 exited with status success for try_number 1 2024-05-25T00:28:02.027315440Z [2024-05-25T00:28:02.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:27:00+00:00 exited with status success for try_number 1 2024-05-25T00:28:02.032919431Z [2024-05-25T00:28:02.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:26:00+00:00, map_index=-1, run_start_date=2024-05-25 00:28:01.051029+00:00, run_end_date=2024-05-25 00:28:01.449003+00:00, run_duration=0.397974, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:28:00.159946+00:00, queued_by_job_id=1, pid=5955 2024-05-25T00:28:02.033040129Z [2024-05-25T00:28:02.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:27:00+00:00, map_index=-1, run_start_date=2024-05-25 00:28:01.059289+00:00, run_end_date=2024-05-25 00:28:01.565819+00:00, run_duration=0.50653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:28:00.159946+00:00, queued_by_job_id=1, pid=5956 2024-05-25T00:28:04.846920537Z [2024-05-25T00:28:04.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:28:04.847182537Z [2024-05-25T00:28:04.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:27:00+00:00, run_id=scheduled__2024-05-25T00:27:00+00:00, run_start_date=2024-05-25 00:28:00.105061+00:00, run_end_date=2024-05-25 00:28:04.846748+00:00, run_duration=4.741687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:27:00+00:00, data_interval_end=2024-05-25 00:28:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:28:04.857745210Z [2024-05-25T00:28:04.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:28:00+00:00, run_after=2024-05-25T00:29:00+00:00 2024-05-25T00:28:04.868077518Z [2024-05-25T00:28:04.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:28:04.868344817Z [2024-05-25T00:28:04.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:27:00+00:00, run_id=scheduled__2024-05-25T00:27:00+00:00, run_start_date=2024-05-25 00:28:00.104106+00:00, run_end_date=2024-05-25 00:28:04.867904+00:00, run_duration=4.763798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:27:00+00:00, data_interval_end=2024-05-25 00:28:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:28:04.881135222Z [2024-05-25T00:28:04.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:28:00+00:00, run_after=2024-05-25T00:29:00+00:00 2024-05-25T00:28:04.933553744Z [2024-05-25T00:28:04.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:27:00+00:00 exited with status success for try_number 1 2024-05-25T00:28:04.934009660Z [2024-05-25T00:28:04.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:27:00+00:00 exited with status success for try_number 1 2024-05-25T00:28:04.947400347Z [2024-05-25T00:28:04.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:27:00+00:00, map_index=-1, run_start_date=2024-05-25 00:28:02.305374+00:00, run_end_date=2024-05-25 00:28:03.948203+00:00, run_duration=1.642829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:28:00.159946+00:00, queued_by_job_id=1, pid=5979 2024-05-25T00:28:04.948508593Z [2024-05-25T00:28:04.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:27:00+00:00, map_index=-1, run_start_date=2024-05-25 00:28:02.459168+00:00, run_end_date=2024-05-25 00:28:03.751972+00:00, run_duration=1.292804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:28:00.159946+00:00, queued_by_job_id=1, pid=5980 2024-05-25T00:29:01.078124876Z [2024-05-25T00:29:01.077+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:29:00+00:00, run_after=2024-05-25T00:30:00+00:00 2024-05-25T00:29:01.095617167Z [2024-05-25T00:29:01.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:29:00+00:00, run_after=2024-05-25T00:30:00+00:00 2024-05-25T00:29:01.104492739Z [2024-05-25T00:29:01.104+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:29:01.185314683Z [2024-05-25T00:29:01.184+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:29:01.185353400Z 2024-05-25T00:29:01.185361231Z 2024-05-25T00:29:01.185368056Z 2024-05-25T00:29:01.185520204Z [2024-05-25T00:29:01.185+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:29:01.185842782Z [2024-05-25T00:29:01.185+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:29:01.186097271Z [2024-05-25T00:29:01.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:29:01.187035975Z [2024-05-25T00:29:01.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:29:01.187053030Z 2024-05-25T00:29:01.187084094Z 2024-05-25T00:29:01.187090953Z 2024-05-25T00:29:01.193405077Z [2024-05-25T00:29:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:29:01.193956116Z [2024-05-25T00:29:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:29:01.194925493Z [2024-05-25T00:29:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:29:01.195415482Z [2024-05-25T00:29:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:29:01.196204667Z [2024-05-25T00:29:01.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:29:01.196685980Z [2024-05-25T00:29:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:29:01.480853564Z [2024-05-25T00:29:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:28:00+00:00 exited with status queued for try_number 1 2024-05-25T00:29:01.481019683Z [2024-05-25T00:29:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:28:00+00:00 exited with status queued for try_number 1 2024-05-25T00:29:01.481131214Z [2024-05-25T00:29:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:28:00+00:00 exited with status queued for try_number 1 2024-05-25T00:29:01.493613086Z [2024-05-25T00:29:01.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5222382a-e5b1-4560-a528-a093f78626c4 2024-05-25T00:29:01.494602802Z [2024-05-25T00:29:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05e64890-89c5-4d90-a850-7467fb68317f 2024-05-25T00:29:01.494972085Z [2024-05-25T00:29:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6929450-9f8a-47e5-b9a1-415ee397f97c 2024-05-25T00:29:02.640312387Z [2024-05-25T00:29:02.639+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:29:02.640650608Z [2024-05-25T00:29:02.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:28:00+00:00, run_id=scheduled__2024-05-25T00:28:00+00:00, run_start_date=2024-05-25 00:29:01.116859+00:00, run_end_date=2024-05-25 00:29:02.640259+00:00, run_duration=1.5234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:28:00+00:00, data_interval_end=2024-05-25 00:29:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:29:02.649348054Z [2024-05-25T00:29:02.649+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:29:00+00:00, run_after=2024-05-25T00:30:00+00:00 2024-05-25T00:29:02.694253991Z [2024-05-25T00:29:02.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:28:00+00:00 exited with status success for try_number 1 2024-05-25T00:29:02.698879944Z [2024-05-25T00:29:02.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:28:00+00:00, map_index=-1, run_start_date=2024-05-25 00:29:02.054638+00:00, run_end_date=2024-05-25 00:29:02.447872+00:00, run_duration=0.393234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:29:01.188172+00:00, queued_by_job_id=1, pid=6012 2024-05-25T00:29:05.203535005Z [2024-05-25T00:29:05.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:29:05.203739289Z [2024-05-25T00:29:05.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:28:00+00:00, run_id=scheduled__2024-05-25T00:28:00+00:00, run_start_date=2024-05-25 00:29:01.118248+00:00, run_end_date=2024-05-25 00:29:05.203431+00:00, run_duration=4.085183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:28:00+00:00, data_interval_end=2024-05-25 00:29:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:29:05.212774666Z [2024-05-25T00:29:05.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:29:00+00:00, run_after=2024-05-25T00:30:00+00:00 2024-05-25T00:29:06.304230210Z [2024-05-25T00:29:06.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:29:06.304459049Z [2024-05-25T00:29:06.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:28:00+00:00, run_id=scheduled__2024-05-25T00:28:00+00:00, run_start_date=2024-05-25 00:29:01.119406+00:00, run_end_date=2024-05-25 00:29:06.304095+00:00, run_duration=5.184689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:28:00+00:00, data_interval_end=2024-05-25 00:29:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:29:06.314127757Z [2024-05-25T00:29:06.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:29:00+00:00, run_after=2024-05-25T00:30:00+00:00 2024-05-25T00:29:06.363499801Z [2024-05-25T00:29:06.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:28:00+00:00 exited with status success for try_number 1 2024-05-25T00:29:06.363611128Z [2024-05-25T00:29:06.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:28:00+00:00 exited with status success for try_number 1 2024-05-25T00:29:06.373754581Z [2024-05-25T00:29:06.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:28:00+00:00, map_index=-1, run_start_date=2024-05-25 00:29:03.360318+00:00, run_end_date=2024-05-25 00:29:05.092127+00:00, run_duration=1.731809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:29:01.188172+00:00, queued_by_job_id=1, pid=6031 2024-05-25T00:29:06.374125383Z [2024-05-25T00:29:06.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:28:00+00:00, map_index=-1, run_start_date=2024-05-25 00:29:03.230132+00:00, run_end_date=2024-05-25 00:29:05.360546+00:00, run_duration=2.130414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:29:01.188172+00:00, queued_by_job_id=1, pid=6030 2024-05-25T00:30:01.070309397Z [2024-05-25T00:30:01.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:30:00+00:00, run_after=2024-05-25T00:35:00+00:00 2024-05-25T00:30:01.087771116Z [2024-05-25T00:30:01.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:30:00+00:00, run_after=2024-05-25T00:31:00+00:00 2024-05-25T00:30:01.097910100Z [2024-05-25T00:30:01.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:30:01.107015710Z [2024-05-25T00:30:01.106+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:30:01.119410467Z [2024-05-25T00:30:01.119+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:30:00+00:00, run_after=2024-05-25T00:31:00+00:00 2024-05-25T00:30:01.202974066Z [2024-05-25T00:30:01.202+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T00:30:01.202998821Z 2024-05-25T00:30:01.203002863Z 2024-05-25T00:30:01.203008120Z 2024-05-25T00:30:01.203028352Z 2024-05-25T00:30:01.203031602Z 2024-05-25T00:30:01.203280870Z [2024-05-25T00:30:01.203+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:30:01.203516767Z [2024-05-25T00:30:01.203+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:30:01.203713550Z [2024-05-25T00:30:01.203+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:30:01.203918482Z [2024-05-25T00:30:01.203+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:30:01.204139832Z [2024-05-25T00:30:01.203+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:30:01.204832618Z [2024-05-25T00:30:01.204+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:30:01.204845517Z 2024-05-25T00:30:01.204849468Z 2024-05-25T00:30:01.204853066Z 2024-05-25T00:30:01.204856381Z 2024-05-25T00:30:01.204859643Z 2024-05-25T00:30:01.208676316Z [2024-05-25T00:30:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T00:30:01.208966343Z [2024-05-25T00:30:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:30:01.209340240Z [2024-05-25T00:30:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:30:01.209572304Z [2024-05-25T00:30:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:30:01.209901492Z [2024-05-25T00:30:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:30:01.210141794Z [2024-05-25T00:30:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:30:01.210492359Z [2024-05-25T00:30:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:30:01.210699499Z [2024-05-25T00:30:01.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:30:01.211025630Z [2024-05-25T00:30:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:30:01.211237068Z [2024-05-25T00:30:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:30:01.848273079Z [2024-05-25T00:30:01.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status queued for try_number 1 2024-05-25T00:30:01.848368430Z [2024-05-25T00:30:01.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:28:00+00:00 exited with status queued for try_number 1 2024-05-25T00:30:01.848374241Z [2024-05-25T00:30:01.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:29:00+00:00 exited with status queued for try_number 1 2024-05-25T00:30:01.848424095Z [2024-05-25T00:30:01.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:29:00+00:00 exited with status queued for try_number 1 2024-05-25T00:30:01.848469864Z [2024-05-25T00:30:01.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:29:00+00:00 exited with status queued for try_number 1 2024-05-25T00:30:01.869244783Z [2024-05-25T00:30:01.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to d10f8c71-c1bc-4dd2-a5ff-526d2607cc35 2024-05-25T00:30:01.869433794Z [2024-05-25T00:30:01.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d32f8ef-2bfe-41b7-ae94-63d360ff08d5 2024-05-25T00:30:01.869543256Z [2024-05-25T00:30:01.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b487567-70a9-4afe-8185-3ca234198c34 2024-05-25T00:30:01.869642788Z [2024-05-25T00:30:01.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6dd40749-386b-422d-b009-9eba571b7f26 2024-05-25T00:30:01.869744317Z [2024-05-25T00:30:01.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to d61805a9-3859-4159-823f-80e34ff444a8 2024-05-25T00:30:03.248538833Z [2024-05-25T00:30:03.248+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:30:03.248981269Z [2024-05-25T00:30:03.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:28:00+00:00, run_id=scheduled__2024-05-25T00:28:00+00:00, run_start_date=2024-05-25 00:30:01.131746+00:00, run_end_date=2024-05-25 00:30:03.248458+00:00, run_duration=2.116712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:28:00+00:00, data_interval_end=2024-05-25 00:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:30:03.257055452Z [2024-05-25T00:30:03.256+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:30:00+00:00, run_after=2024-05-25T00:32:00+00:00 2024-05-25T00:30:03.263541038Z [2024-05-25T00:30:03.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:30:03.263687919Z [2024-05-25T00:30:03.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:29:00+00:00, run_id=scheduled__2024-05-25T00:29:00+00:00, run_start_date=2024-05-25 00:30:01.132930+00:00, run_end_date=2024-05-25 00:30:03.263455+00:00, run_duration=2.130525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:29:00+00:00, data_interval_end=2024-05-25 00:30:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:30:03.274232886Z [2024-05-25T00:30:03.273+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:30:00+00:00, run_after=2024-05-25T00:31:00+00:00 2024-05-25T00:30:03.335382106Z [2024-05-25T00:30:03.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:28:00+00:00 exited with status success for try_number 1 2024-05-25T00:30:03.335403969Z [2024-05-25T00:30:03.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:29:00+00:00 exited with status success for try_number 1 2024-05-25T00:30:03.346109537Z [2024-05-25T00:30:03.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:29:00+00:00, map_index=-1, run_start_date=2024-05-25 00:30:02.430916+00:00, run_end_date=2024-05-25 00:30:02.888819+00:00, run_duration=0.457903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:30:01.205937+00:00, queued_by_job_id=1, pid=6067 2024-05-25T00:30:03.346319859Z [2024-05-25T00:30:03.346+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:28:00+00:00, map_index=-1, run_start_date=2024-05-25 00:30:02.388125+00:00, run_end_date=2024-05-25 00:30:02.767378+00:00, run_duration=0.379253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:30:01.205937+00:00, queued_by_job_id=1, pid=6066 2024-05-25T00:30:05.161899873Z [2024-05-25T00:30:05.161+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:30:05.161973167Z 2024-05-25T00:30:05.162001008Z [2024-05-25T00:30:05.161+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:30:05.162789143Z [2024-05-25T00:30:05.162+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:30:05.162812827Z 2024-05-25T00:30:05.166124911Z [2024-05-25T00:30:05.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T00:30:05.166165929Z [2024-05-25T00:30:05.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:30:05.227387036Z [2024-05-25T00:30:05.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status queued for try_number 1 2024-05-25T00:30:05.227417864Z [2024-05-25T00:30:05.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status success for try_number 1 2024-05-25T00:30:05.236242942Z [2024-05-25T00:30:05.235+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2c0570e-e3a7-47cc-a51a-562775a850c5 2024-05-25T00:30:05.236455030Z [2024-05-25T00:30:05.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T00:25:00+00:00, map_index=-1, run_start_date=2024-05-25 00:30:03.818658+00:00, run_end_date=2024-05-25 00:30:04.264646+00:00, run_duration=0.445988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:30:01.205937+00:00, queued_by_job_id=1, pid=6098 2024-05-25T00:30:06.438727466Z [2024-05-25T00:30:06.438+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:30:06.439802463Z [2024-05-25T00:30:06.439+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:29:00+00:00, run_id=scheduled__2024-05-25T00:29:00+00:00, run_start_date=2024-05-25 00:30:01.134811+00:00, run_end_date=2024-05-25 00:30:06.438950+00:00, run_duration=5.304139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:29:00+00:00, data_interval_end=2024-05-25 00:30:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:30:06.454356182Z [2024-05-25T00:30:06.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:30:00+00:00, run_after=2024-05-25T00:31:00+00:00 2024-05-25T00:30:06.461614911Z [2024-05-25T00:30:06.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:30:06.462165578Z [2024-05-25T00:30:06.461+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:29:00+00:00, run_id=scheduled__2024-05-25T00:29:00+00:00, run_start_date=2024-05-25 00:30:01.133875+00:00, run_end_date=2024-05-25 00:30:06.461836+00:00, run_duration=5.327961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:29:00+00:00, data_interval_end=2024-05-25 00:30:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:30:06.472705781Z [2024-05-25T00:30:06.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:30:00+00:00, run_after=2024-05-25T00:31:00+00:00 2024-05-25T00:30:06.553020093Z [2024-05-25T00:30:06.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:29:00+00:00 exited with status success for try_number 1 2024-05-25T00:30:06.553138188Z [2024-05-25T00:30:06.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:29:00+00:00 exited with status success for try_number 1 2024-05-25T00:30:06.559729544Z [2024-05-25T00:30:06.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:29:00+00:00, map_index=-1, run_start_date=2024-05-25 00:30:03.615142+00:00, run_end_date=2024-05-25 00:30:05.475296+00:00, run_duration=1.860154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:30:01.205937+00:00, queued_by_job_id=1, pid=6094 2024-05-25T00:30:06.559987836Z [2024-05-25T00:30:06.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:29:00+00:00, map_index=-1, run_start_date=2024-05-25 00:30:03.716484+00:00, run_end_date=2024-05-25 00:30:05.479043+00:00, run_duration=1.762559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:30:01.205937+00:00, queued_by_job_id=1, pid=6097 2024-05-25T00:30:07.620016068Z [2024-05-25T00:30:07.619+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:30:07.620069432Z 2024-05-25T00:30:07.620073624Z [2024-05-25T00:30:07.619+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:30:07.620640951Z [2024-05-25T00:30:07.620+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:30:07.620674228Z 2024-05-25T00:30:07.622880324Z [2024-05-25T00:30:07.622+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T00:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T00:30:07.623106279Z [2024-05-25T00:30:07.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:30:07.678940546Z [2024-05-25T00:30:07.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status queued for try_number 1 2024-05-25T00:30:07.679167375Z [2024-05-25T00:30:07.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status success for try_number 1 2024-05-25T00:30:07.684596765Z [2024-05-25T00:30:07.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60092d5b-feca-4f06-a5ad-ba6370144e0a 2024-05-25T00:30:07.684876593Z [2024-05-25T00:30:07.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T00:25:00+00:00, map_index=-1, run_start_date=2024-05-25 00:30:07.019125+00:00, run_end_date=2024-05-25 00:30:07.306751+00:00, run_duration=0.287626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:30:05.163074+00:00, queued_by_job_id=1, pid=6131 2024-05-25T00:30:10.248160607Z [2024-05-25T00:30:10.247+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:30:10.248190365Z 2024-05-25T00:30:10.248259118Z [2024-05-25T00:30:10.248+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:30:10.248835859Z [2024-05-25T00:30:10.248+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:30:10.248847892Z 2024-05-25T00:30:10.250829363Z [2024-05-25T00:30:10.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:30:10.250910562Z [2024-05-25T00:30:10.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:30:10.312861623Z [2024-05-25T00:30:10.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status queued for try_number 1 2024-05-25T00:30:10.312991737Z [2024-05-25T00:30:10.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status success for try_number 1 2024-05-25T00:30:10.320296410Z [2024-05-25T00:30:10.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5db64d84-8a7f-4c2a-8f87-2364dc277cca 2024-05-25T00:30:10.320408816Z [2024-05-25T00:30:10.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T00:25:00+00:00, map_index=0, run_start_date=2024-05-25 00:30:09.337137+00:00, run_end_date=2024-05-25 00:30:09.719551+00:00, run_duration=0.382414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:30:07.621066+00:00, queued_by_job_id=1, pid=6142 2024-05-25T00:30:12.379009504Z [2024-05-25T00:30:12.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:30:12.379168166Z [2024-05-25T00:30:12.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:25:00+00:00, run_id=scheduled__2024-05-25T00:25:00+00:00, run_start_date=2024-05-25 00:30:01.130393+00:00, run_end_date=2024-05-25 00:30:12.378848+00:00, run_duration=11.248455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:25:00+00:00, data_interval_end=2024-05-25 00:30:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T00:30:12.384509806Z [2024-05-25T00:30:12.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:30:00+00:00, run_after=2024-05-25T00:35:00+00:00 2024-05-25T00:30:13.505757840Z [2024-05-25T00:30:13.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:25:00+00:00 exited with status success for try_number 1 2024-05-25T00:30:13.512611981Z [2024-05-25T00:30:13.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T00:25:00+00:00, map_index=-1, run_start_date=2024-05-25 00:30:11.943262+00:00, run_end_date=2024-05-25 00:30:12.334022+00:00, run_duration=0.39076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:30:10.249111+00:00, queued_by_job_id=1, pid=6150 2024-05-25T00:30:28.435823205Z [2024-05-25T00:30:28.435+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T00:31:00.980416181Z [2024-05-25T00:31:00.980+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:31:00.995782412Z [2024-05-25T00:31:00.995+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:31:00+00:00, run_after=2024-05-25T00:32:00+00:00 2024-05-25T00:31:01.015058990Z [2024-05-25T00:31:01.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:31:00+00:00, run_after=2024-05-25T00:32:00+00:00 2024-05-25T00:31:01.115067370Z [2024-05-25T00:31:01.114+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:31:01.115107496Z 2024-05-25T00:31:01.115116415Z 2024-05-25T00:31:01.115123140Z 2024-05-25T00:31:01.116101382Z [2024-05-25T00:31:01.115+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:31:01.117120242Z [2024-05-25T00:31:01.116+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:31:01.117628043Z [2024-05-25T00:31:01.117+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:31:01.118678115Z [2024-05-25T00:31:01.118+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:31:01.118699605Z 2024-05-25T00:31:01.118708739Z 2024-05-25T00:31:01.118716743Z 2024-05-25T00:31:01.124963283Z [2024-05-25T00:31:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:31:01.125639322Z [2024-05-25T00:31:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:31:01.126389262Z [2024-05-25T00:31:01.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:31:01.126802966Z [2024-05-25T00:31:01.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:31:01.127526766Z [2024-05-25T00:31:01.127+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:31:01.128332314Z [2024-05-25T00:31:01.127+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:31:01.410352625Z [2024-05-25T00:31:01.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status queued for try_number 1 2024-05-25T00:31:01.410551929Z [2024-05-25T00:31:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status queued for try_number 1 2024-05-25T00:31:01.410710416Z [2024-05-25T00:31:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status queued for try_number 1 2024-05-25T00:31:01.423264535Z [2024-05-25T00:31:01.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to 990cca6a-81fe-4914-956a-8436cbb497ab 2024-05-25T00:31:01.423578915Z [2024-05-25T00:31:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to da88d88c-be81-4b85-8759-821a713baeab 2024-05-25T00:31:01.423815301Z [2024-05-25T00:31:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b7124cc-6f4f-451f-83de-f34fd124d6a5 2024-05-25T00:31:02.636845604Z [2024-05-25T00:31:02.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:31:02.637044280Z [2024-05-25T00:31:02.636+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:30:00+00:00, run_id=scheduled__2024-05-25T00:30:00+00:00, run_start_date=2024-05-25 00:31:01.028415+00:00, run_end_date=2024-05-25 00:31:02.636683+00:00, run_duration=1.608268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:30:00+00:00, data_interval_end=2024-05-25 00:31:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:31:02.646071558Z [2024-05-25T00:31:02.645+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:31:00+00:00, run_after=2024-05-25T00:32:00+00:00 2024-05-25T00:31:02.700437484Z [2024-05-25T00:31:02.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status success for try_number 1 2024-05-25T00:31:02.707977748Z [2024-05-25T00:31:02.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:30:00+00:00, map_index=-1, run_start_date=2024-05-25 00:31:01.921195+00:00, run_end_date=2024-05-25 00:31:02.388814+00:00, run_duration=0.467619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:31:01.120301+00:00, queued_by_job_id=1, pid=6159 2024-05-25T00:31:04.980001327Z [2024-05-25T00:31:04.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:31:04.980479604Z [2024-05-25T00:31:04.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:30:00+00:00, run_id=scheduled__2024-05-25T00:30:00+00:00, run_start_date=2024-05-25 00:31:01.032045+00:00, run_end_date=2024-05-25 00:31:04.980127+00:00, run_duration=3.948082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:30:00+00:00, data_interval_end=2024-05-25 00:31:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:31:04.989582785Z [2024-05-25T00:31:04.989+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:31:00+00:00, run_after=2024-05-25T00:32:00+00:00 2024-05-25T00:31:04.996158802Z [2024-05-25T00:31:04.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:31:04.996438282Z [2024-05-25T00:31:04.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:30:00+00:00, run_id=scheduled__2024-05-25T00:30:00+00:00, run_start_date=2024-05-25 00:31:01.033684+00:00, run_end_date=2024-05-25 00:31:04.996131+00:00, run_duration=3.962447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:30:00+00:00, data_interval_end=2024-05-25 00:31:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:31:05.008001215Z [2024-05-25T00:31:05.007+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:31:00+00:00, run_after=2024-05-25T00:32:00+00:00 2024-05-25T00:31:05.056194671Z [2024-05-25T00:31:05.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status success for try_number 1 2024-05-25T00:31:05.062706331Z [2024-05-25T00:31:05.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:30:00+00:00, map_index=-1, run_start_date=2024-05-25 00:31:02.933026+00:00, run_end_date=2024-05-25 00:31:04.251050+00:00, run_duration=1.318024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:31:01.120301+00:00, queued_by_job_id=1, pid=6172 2024-05-25T00:31:06.145359523Z [2024-05-25T00:31:06.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status success for try_number 1 2024-05-25T00:31:06.152291657Z [2024-05-25T00:31:06.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:30:00+00:00, map_index=-1, run_start_date=2024-05-25 00:31:03.170540+00:00, run_end_date=2024-05-25 00:31:04.938431+00:00, run_duration=1.767891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:31:01.120301+00:00, queued_by_job_id=1, pid=6178 2024-05-25T00:32:00.925428210Z [2024-05-25T00:32:00.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:32:00+00:00, run_after=2024-05-25T00:33:00+00:00 2024-05-25T00:32:00.936129616Z [2024-05-25T00:32:00.935+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:32:00.952235784Z [2024-05-25T00:32:00.951+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:32:00+00:00, run_after=2024-05-25T00:33:00+00:00 2024-05-25T00:32:00.962196368Z [2024-05-25T00:32:00.961+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:32:01.072712270Z [2024-05-25T00:32:01.072+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:32:01.072763185Z 2024-05-25T00:32:01.072770534Z 2024-05-25T00:32:01.072776658Z 2024-05-25T00:32:01.072781955Z 2024-05-25T00:32:01.073262388Z [2024-05-25T00:32:01.072+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:32:01.073659649Z [2024-05-25T00:32:01.073+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:32:01.074056776Z [2024-05-25T00:32:01.073+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:32:01.074649904Z [2024-05-25T00:32:01.074+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:32:01.075903882Z [2024-05-25T00:32:01.075+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:32:01.075917150Z 2024-05-25T00:32:01.075948044Z 2024-05-25T00:32:01.075952662Z 2024-05-25T00:32:01.075957313Z 2024-05-25T00:32:01.085466397Z [2024-05-25T00:32:01.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:32:01.086385240Z [2024-05-25T00:32:01.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:32:01.087378695Z [2024-05-25T00:32:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:32:01.089144139Z [2024-05-25T00:32:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:32:01.090176714Z [2024-05-25T00:32:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:32:01.090859920Z [2024-05-25T00:32:01.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:32:01.091871768Z [2024-05-25T00:32:01.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:32:01.092731407Z [2024-05-25T00:32:01.092+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:32:01.491506420Z [2024-05-25T00:32:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status queued for try_number 1 2024-05-25T00:32:01.494719866Z [2024-05-25T00:32:01.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:31:00+00:00 exited with status queued for try_number 1 2024-05-25T00:32:01.494995336Z [2024-05-25T00:32:01.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:31:00+00:00 exited with status queued for try_number 1 2024-05-25T00:32:01.495213546Z [2024-05-25T00:32:01.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:31:00+00:00 exited with status queued for try_number 1 2024-05-25T00:32:01.516989931Z [2024-05-25T00:32:01.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84aa88ab-8d6a-409d-b4ec-e8ac1205d35e 2024-05-25T00:32:01.521870589Z [2024-05-25T00:32:01.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a16c410-e62b-450d-af09-c8a30a30f81b 2024-05-25T00:32:01.522269526Z [2024-05-25T00:32:01.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1e47067-b700-4a35-af79-ccd72dc3ee23 2024-05-25T00:32:01.522630156Z [2024-05-25T00:32:01.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb7553a4-7525-4fa4-9aa1-b84851077f2d 2024-05-25T00:32:02.775310876Z [2024-05-25T00:32:02.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:32:02.776150108Z [2024-05-25T00:32:02.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:30:00+00:00, run_id=scheduled__2024-05-25T00:30:00+00:00, run_start_date=2024-05-25 00:32:00.980875+00:00, run_end_date=2024-05-25 00:32:02.775572+00:00, run_duration=1.794697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:30:00+00:00, data_interval_end=2024-05-25 00:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:32:02.789068395Z [2024-05-25T00:32:02.788+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:32:00+00:00, run_after=2024-05-25T00:34:00+00:00 2024-05-25T00:32:02.852008805Z [2024-05-25T00:32:02.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status success for try_number 1 2024-05-25T00:32:02.861445465Z [2024-05-25T00:32:02.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:30:00+00:00, map_index=-1, run_start_date=2024-05-25 00:32:01.893045+00:00, run_end_date=2024-05-25 00:32:02.356391+00:00, run_duration=0.463346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:32:01.077817+00:00, queued_by_job_id=1, pid=6206 2024-05-25T00:32:03.953950954Z [2024-05-25T00:32:03.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:32:03.953978989Z [2024-05-25T00:32:03.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:31:00+00:00, run_id=scheduled__2024-05-25T00:31:00+00:00, run_start_date=2024-05-25 00:32:00.982244+00:00, run_end_date=2024-05-25 00:32:03.950690+00:00, run_duration=2.968446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:31:00+00:00, data_interval_end=2024-05-25 00:32:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:32:03.982657629Z [2024-05-25T00:32:03.982+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:32:00+00:00, run_after=2024-05-25T00:33:00+00:00 2024-05-25T00:32:04.059947642Z [2024-05-25T00:32:04.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:31:00+00:00 exited with status success for try_number 1 2024-05-25T00:32:04.066883775Z [2024-05-25T00:32:04.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:31:00+00:00, map_index=-1, run_start_date=2024-05-25 00:32:02.298660+00:00, run_end_date=2024-05-25 00:32:02.815329+00:00, run_duration=0.516669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:32:01.077817+00:00, queued_by_job_id=1, pid=6219 2024-05-25T00:32:05.631648411Z [2024-05-25T00:32:05.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:32:05.631995948Z [2024-05-25T00:32:05.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:31:00+00:00, run_id=scheduled__2024-05-25T00:31:00+00:00, run_start_date=2024-05-25 00:32:00.983473+00:00, run_end_date=2024-05-25 00:32:05.631640+00:00, run_duration=4.648167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:31:00+00:00, data_interval_end=2024-05-25 00:32:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:32:05.640963414Z [2024-05-25T00:32:05.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:32:00+00:00, run_after=2024-05-25T00:33:00+00:00 2024-05-25T00:32:05.648517898Z [2024-05-25T00:32:05.648+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:32:05.649014107Z [2024-05-25T00:32:05.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:31:00+00:00, run_id=scheduled__2024-05-25T00:31:00+00:00, run_start_date=2024-05-25 00:32:00.984668+00:00, run_end_date=2024-05-25 00:32:05.648516+00:00, run_duration=4.663848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:31:00+00:00, data_interval_end=2024-05-25 00:32:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:32:05.658331390Z [2024-05-25T00:32:05.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:32:00+00:00, run_after=2024-05-25T00:33:00+00:00 2024-05-25T00:32:05.711585245Z [2024-05-25T00:32:05.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:31:00+00:00 exited with status success for try_number 1 2024-05-25T00:32:05.711800205Z [2024-05-25T00:32:05.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:31:00+00:00 exited with status success for try_number 1 2024-05-25T00:32:05.724669123Z [2024-05-25T00:32:05.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:31:00+00:00, map_index=-1, run_start_date=2024-05-25 00:32:03.280259+00:00, run_end_date=2024-05-25 00:32:04.766683+00:00, run_duration=1.486424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:32:01.077817+00:00, queued_by_job_id=1, pid=6236 2024-05-25T00:32:05.725156086Z [2024-05-25T00:32:05.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:31:00+00:00, map_index=-1, run_start_date=2024-05-25 00:32:03.113203+00:00, run_end_date=2024-05-25 00:32:04.969071+00:00, run_duration=1.855868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:32:01.077817+00:00, queued_by_job_id=1, pid=6235 2024-05-25T00:33:00.649323876Z [2024-05-25T00:33:00.648+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:33:00+00:00, run_after=2024-05-25T00:34:00+00:00 2024-05-25T00:33:00.660322234Z [2024-05-25T00:33:00.659+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:33:00.676048796Z [2024-05-25T00:33:00.675+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:33:00+00:00, run_after=2024-05-25T00:34:00+00:00 2024-05-25T00:33:00.739431894Z [2024-05-25T00:33:00.738+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:33:00.739485394Z 2024-05-25T00:33:00.739496880Z 2024-05-25T00:33:00.739513558Z 2024-05-25T00:33:00.739626028Z [2024-05-25T00:33:00.739+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:33:00.739931123Z [2024-05-25T00:33:00.739+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:33:00.740191480Z [2024-05-25T00:33:00.739+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:33:00.741279563Z [2024-05-25T00:33:00.740+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:33:00.741297422Z 2024-05-25T00:33:00.741301360Z 2024-05-25T00:33:00.741304592Z 2024-05-25T00:33:00.746535795Z [2024-05-25T00:33:00.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:33:00.746804707Z [2024-05-25T00:33:00.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:33:00.747229521Z [2024-05-25T00:33:00.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:33:00.747476856Z [2024-05-25T00:33:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:33:00.747900582Z [2024-05-25T00:33:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:33:00.748174803Z [2024-05-25T00:33:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:33:01.096807266Z [2024-05-25T00:33:01.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:32:00+00:00 exited with status queued for try_number 1 2024-05-25T00:33:01.097308607Z [2024-05-25T00:33:01.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:32:00+00:00 exited with status queued for try_number 1 2024-05-25T00:33:01.097717817Z [2024-05-25T00:33:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:32:00+00:00 exited with status queued for try_number 1 2024-05-25T00:33:01.109272009Z [2024-05-25T00:33:01.108+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41d9a41b-b99a-4284-8177-9d5d4c05c7cb 2024-05-25T00:33:01.109620505Z [2024-05-25T00:33:01.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b0507e5-9f66-44cb-990a-853f13877192 2024-05-25T00:33:01.109929945Z [2024-05-25T00:33:01.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a22cbd2-fdb6-4bf8-aafc-8ee8528a2e97 2024-05-25T00:33:02.497146235Z [2024-05-25T00:33:02.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:33:02.497439468Z [2024-05-25T00:33:02.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:32:00+00:00, run_id=scheduled__2024-05-25T00:32:00+00:00, run_start_date=2024-05-25 00:33:00.688705+00:00, run_end_date=2024-05-25 00:33:02.497005+00:00, run_duration=1.8083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:32:00+00:00, data_interval_end=2024-05-25 00:33:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:33:02.505889108Z [2024-05-25T00:33:02.505+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:33:00+00:00, run_after=2024-05-25T00:34:00+00:00 2024-05-25T00:33:03.701965153Z [2024-05-25T00:33:03.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:32:00+00:00 exited with status success for try_number 1 2024-05-25T00:33:03.707910537Z [2024-05-25T00:33:03.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:32:00+00:00, map_index=-1, run_start_date=2024-05-25 00:33:01.825021+00:00, run_end_date=2024-05-25 00:33:02.395959+00:00, run_duration=0.570938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:33:00.742800+00:00, queued_by_job_id=1, pid=6268 2024-05-25T00:33:04.757070342Z [2024-05-25T00:33:04.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:33:04.757744971Z [2024-05-25T00:33:04.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:32:00+00:00, run_id=scheduled__2024-05-25T00:32:00+00:00, run_start_date=2024-05-25 00:33:00.691201+00:00, run_end_date=2024-05-25 00:33:04.756961+00:00, run_duration=4.06576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:32:00+00:00, data_interval_end=2024-05-25 00:33:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:33:04.771589457Z [2024-05-25T00:33:04.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:33:00+00:00, run_after=2024-05-25T00:34:00+00:00 2024-05-25T00:33:04.811380916Z [2024-05-25T00:33:04.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:32:00+00:00 exited with status success for try_number 1 2024-05-25T00:33:04.817136502Z [2024-05-25T00:33:04.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:32:00+00:00, map_index=-1, run_start_date=2024-05-25 00:33:02.947898+00:00, run_end_date=2024-05-25 00:33:04.673993+00:00, run_duration=1.726095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:33:00.742800+00:00, queued_by_job_id=1, pid=6287 2024-05-25T00:33:05.003603396Z [2024-05-25T00:33:05.002+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:33:05.003691137Z [2024-05-25T00:33:05.003+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:32:00+00:00, run_id=scheduled__2024-05-25T00:32:00+00:00, run_start_date=2024-05-25 00:33:00.690074+00:00, run_end_date=2024-05-25 00:33:05.003194+00:00, run_duration=4.31312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:32:00+00:00, data_interval_end=2024-05-25 00:33:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:33:05.013847207Z [2024-05-25T00:33:05.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:33:00+00:00, run_after=2024-05-25T00:34:00+00:00 2024-05-25T00:33:05.052884973Z [2024-05-25T00:33:05.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:32:00+00:00 exited with status success for try_number 1 2024-05-25T00:33:05.070652758Z [2024-05-25T00:33:05.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:32:00+00:00, map_index=-1, run_start_date=2024-05-25 00:33:02.920352+00:00, run_end_date=2024-05-25 00:33:04.689327+00:00, run_duration=1.768975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:33:00.742800+00:00, queued_by_job_id=1, pid=6286 2024-05-25T00:34:00.587011930Z [2024-05-25T00:34:00.586+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:34:00.601070991Z [2024-05-25T00:34:00.600+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:34:00+00:00, run_after=2024-05-25T00:35:00+00:00 2024-05-25T00:34:00.613533789Z [2024-05-25T00:34:00.613+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:34:00.626656523Z [2024-05-25T00:34:00.626+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:34:00+00:00, run_after=2024-05-25T00:35:00+00:00 2024-05-25T00:34:00.725459542Z [2024-05-25T00:34:00.724+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:34:00.725503550Z 2024-05-25T00:34:00.725514296Z 2024-05-25T00:34:00.725523152Z 2024-05-25T00:34:00.725531832Z 2024-05-25T00:34:00.725979513Z [2024-05-25T00:34:00.725+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:34:00.726349907Z [2024-05-25T00:34:00.725+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:34:00.726637269Z [2024-05-25T00:34:00.726+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:34:00.726843617Z [2024-05-25T00:34:00.726+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:34:00.728554685Z [2024-05-25T00:34:00.728+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:34:00.728562122Z 2024-05-25T00:34:00.728565849Z 2024-05-25T00:34:00.728569155Z 2024-05-25T00:34:00.728572886Z 2024-05-25T00:34:00.736444333Z [2024-05-25T00:34:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:34:00.736975303Z [2024-05-25T00:34:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:34:00.737753991Z [2024-05-25T00:34:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:34:00.739782698Z [2024-05-25T00:34:00.739+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:34:00.740239428Z [2024-05-25T00:34:00.739+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:34:00.741794863Z [2024-05-25T00:34:00.740+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:34:00.742545276Z [2024-05-25T00:34:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:34:00.742913515Z [2024-05-25T00:34:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:34:01.138041327Z [2024-05-25T00:34:01.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:32:00+00:00 exited with status queued for try_number 1 2024-05-25T00:34:01.138367723Z [2024-05-25T00:34:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:33:00+00:00 exited with status queued for try_number 1 2024-05-25T00:34:01.138565220Z [2024-05-25T00:34:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:33:00+00:00 exited with status queued for try_number 1 2024-05-25T00:34:01.138735401Z [2024-05-25T00:34:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:33:00+00:00 exited with status queued for try_number 1 2024-05-25T00:34:01.147472756Z [2024-05-25T00:34:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dcb6c68-3fa9-4893-a497-68430e0f94e6 2024-05-25T00:34:01.147784019Z [2024-05-25T00:34:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5952253f-f7e3-4598-b00b-cabd9e8e4610 2024-05-25T00:34:01.148092505Z [2024-05-25T00:34:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a539150-54fd-4b96-8263-054bb5ab6367 2024-05-25T00:34:01.148319947Z [2024-05-25T00:34:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2919cfe2-610c-4c44-9e49-cfa217388b9f 2024-05-25T00:34:02.335816468Z [2024-05-25T00:34:02.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:34:02.337299356Z [2024-05-25T00:34:02.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:32:00+00:00, run_id=scheduled__2024-05-25T00:32:00+00:00, run_start_date=2024-05-25 00:34:00.641172+00:00, run_end_date=2024-05-25 00:34:02.335713+00:00, run_duration=1.694541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:32:00+00:00, data_interval_end=2024-05-25 00:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:34:02.366659647Z [2024-05-25T00:34:02.357+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:34:00+00:00, run_after=2024-05-25T00:36:00+00:00 2024-05-25T00:34:02.385355066Z [2024-05-25T00:34:02.384+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:34:02.385678933Z [2024-05-25T00:34:02.385+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:33:00+00:00, run_id=scheduled__2024-05-25T00:33:00+00:00, run_start_date=2024-05-25 00:34:00.643718+00:00, run_end_date=2024-05-25 00:34:02.385250+00:00, run_duration=1.741532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:33:00+00:00, data_interval_end=2024-05-25 00:34:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:34:02.399110756Z [2024-05-25T00:34:02.398+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:34:00+00:00, run_after=2024-05-25T00:35:00+00:00 2024-05-25T00:34:02.445999963Z [2024-05-25T00:34:02.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:32:00+00:00 exited with status success for try_number 1 2024-05-25T00:34:02.446199823Z [2024-05-25T00:34:02.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:33:00+00:00 exited with status success for try_number 1 2024-05-25T00:34:02.453291449Z [2024-05-25T00:34:02.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:32:00+00:00, map_index=-1, run_start_date=2024-05-25 00:34:01.524712+00:00, run_end_date=2024-05-25 00:34:01.894275+00:00, run_duration=0.369563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:34:00.731701+00:00, queued_by_job_id=1, pid=6320 2024-05-25T00:34:02.453596364Z [2024-05-25T00:34:02.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:33:00+00:00, map_index=-1, run_start_date=2024-05-25 00:34:01.764599+00:00, run_end_date=2024-05-25 00:34:02.207248+00:00, run_duration=0.442649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:34:00.731701+00:00, queued_by_job_id=1, pid=6321 2024-05-25T00:34:04.634624539Z [2024-05-25T00:34:04.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:34:04.634808195Z [2024-05-25T00:34:04.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:33:00+00:00, run_id=scheduled__2024-05-25T00:33:00+00:00, run_start_date=2024-05-25 00:34:00.646045+00:00, run_end_date=2024-05-25 00:34:04.634318+00:00, run_duration=3.988273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:33:00+00:00, data_interval_end=2024-05-25 00:34:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:34:04.644478204Z [2024-05-25T00:34:04.644+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:34:00+00:00, run_after=2024-05-25T00:35:00+00:00 2024-05-25T00:34:04.697179422Z [2024-05-25T00:34:04.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:33:00+00:00 exited with status success for try_number 1 2024-05-25T00:34:04.707508049Z [2024-05-25T00:34:04.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:33:00+00:00, map_index=-1, run_start_date=2024-05-25 00:34:02.996445+00:00, run_end_date=2024-05-25 00:34:04.339398+00:00, run_duration=1.342953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:34:00.731701+00:00, queued_by_job_id=1, pid=6345 2024-05-25T00:34:05.430467313Z [2024-05-25T00:34:05.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:34:05.430622357Z [2024-05-25T00:34:05.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:33:00+00:00, run_id=scheduled__2024-05-25T00:33:00+00:00, run_start_date=2024-05-25 00:34:00.648193+00:00, run_end_date=2024-05-25 00:34:05.430338+00:00, run_duration=4.782145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:33:00+00:00, data_interval_end=2024-05-25 00:34:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:34:05.438910161Z [2024-05-25T00:34:05.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:34:00+00:00, run_after=2024-05-25T00:35:00+00:00 2024-05-25T00:34:05.475835011Z [2024-05-25T00:34:05.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:33:00+00:00 exited with status success for try_number 1 2024-05-25T00:34:05.486952629Z [2024-05-25T00:34:05.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:33:00+00:00, map_index=-1, run_start_date=2024-05-25 00:34:02.882420+00:00, run_end_date=2024-05-25 00:34:04.759456+00:00, run_duration=1.877036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:34:00.731701+00:00, queued_by_job_id=1, pid=6344 2024-05-25T00:35:00.524193717Z [2024-05-25T00:35:00.523+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:35:00.543236839Z [2024-05-25T00:35:00.542+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:35:00+00:00, run_after=2024-05-25T00:36:00+00:00 2024-05-25T00:35:00.557250781Z [2024-05-25T00:35:00.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:35:00+00:00, run_after=2024-05-25T00:40:00+00:00 2024-05-25T00:35:00.569191869Z [2024-05-25T00:35:00.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:35:00+00:00, run_after=2024-05-25T00:36:00+00:00 2024-05-25T00:35:00.689452554Z [2024-05-25T00:35:00.688+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:35:00.689513263Z 2024-05-25T00:35:00.689543327Z 2024-05-25T00:35:00.689550500Z 2024-05-25T00:35:00.689578737Z 2024-05-25T00:35:00.689835811Z [2024-05-25T00:35:00.689+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:35:00.690236740Z [2024-05-25T00:35:00.689+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:35:00.690489606Z [2024-05-25T00:35:00.690+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:35:00.690713285Z [2024-05-25T00:35:00.690+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:35:00.693123770Z [2024-05-25T00:35:00.692+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:35:00.693177633Z 2024-05-25T00:35:00.693188309Z 2024-05-25T00:35:00.693198164Z 2024-05-25T00:35:00.693276765Z 2024-05-25T00:35:00.700780875Z [2024-05-25T00:35:00.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T00:35:00.700932474Z [2024-05-25T00:35:00.700+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:35:00.701446138Z [2024-05-25T00:35:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:35:00.701580148Z [2024-05-25T00:35:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:35:00.702016313Z [2024-05-25T00:35:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:35:00.702045578Z [2024-05-25T00:35:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:35:00.702454396Z [2024-05-25T00:35:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:35:00.702613807Z [2024-05-25T00:35:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:35:01.071401240Z [2024-05-25T00:35:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status queued for try_number 1 2024-05-25T00:35:01.071486681Z [2024-05-25T00:35:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:34:00+00:00 exited with status queued for try_number 1 2024-05-25T00:35:01.071607481Z [2024-05-25T00:35:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:34:00+00:00 exited with status queued for try_number 1 2024-05-25T00:35:01.071715585Z [2024-05-25T00:35:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:34:00+00:00 exited with status queued for try_number 1 2024-05-25T00:35:01.080050078Z [2024-05-25T00:35:01.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to bac17c9f-1757-4ec5-8b68-2038a981832e 2024-05-25T00:35:01.080268429Z [2024-05-25T00:35:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74eb5193-5680-456d-843e-0f205bd58517 2024-05-25T00:35:01.080443339Z [2024-05-25T00:35:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec3cb5f4-cf6b-4838-b589-27469ef8e9e3 2024-05-25T00:35:01.080592484Z [2024-05-25T00:35:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c4ce57a-659a-4490-91f1-aa056cbc884c 2024-05-25T00:35:02.287018631Z [2024-05-25T00:35:02.286+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:35:02.289944260Z [2024-05-25T00:35:02.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:34:00+00:00, run_id=scheduled__2024-05-25T00:34:00+00:00, run_start_date=2024-05-25 00:35:00.586703+00:00, run_end_date=2024-05-25 00:35:02.289489+00:00, run_duration=1.702786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:34:00+00:00, data_interval_end=2024-05-25 00:35:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:35:02.323465897Z [2024-05-25T00:35:02.322+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:35:00+00:00, run_after=2024-05-25T00:36:00+00:00 2024-05-25T00:35:02.381913340Z [2024-05-25T00:35:02.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:34:00+00:00 exited with status success for try_number 1 2024-05-25T00:35:02.409884066Z [2024-05-25T00:35:02.409+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:34:00+00:00, map_index=-1, run_start_date=2024-05-25 00:35:01.588008+00:00, run_end_date=2024-05-25 00:35:01.915934+00:00, run_duration=0.327926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:35:00.695580+00:00, queued_by_job_id=1, pid=6378 2024-05-25T00:35:03.520461526Z [2024-05-25T00:35:03.519+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:35:03.520521536Z 2024-05-25T00:35:03.520536258Z [2024-05-25T00:35:03.520+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:35:03.521141393Z [2024-05-25T00:35:03.520+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:35:03.521165957Z 2024-05-25T00:35:03.524618657Z [2024-05-25T00:35:03.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T00:35:03.524697153Z [2024-05-25T00:35:03.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:35:03.589685581Z [2024-05-25T00:35:03.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status queued for try_number 1 2024-05-25T00:35:03.590049451Z [2024-05-25T00:35:03.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status success for try_number 1 2024-05-25T00:35:03.598449728Z [2024-05-25T00:35:03.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f610830-7e71-4adb-879d-238f2bb7054a 2024-05-25T00:35:03.598959483Z [2024-05-25T00:35:03.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T00:30:00+00:00, map_index=-1, run_start_date=2024-05-25 00:35:02.783814+00:00, run_end_date=2024-05-25 00:35:03.195885+00:00, run_duration=0.412071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:35:00.695580+00:00, queued_by_job_id=1, pid=6403 2024-05-25T00:35:04.546413665Z [2024-05-25T00:35:04.545+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:35:04.546615310Z [2024-05-25T00:35:04.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:34:00+00:00, run_id=scheduled__2024-05-25T00:34:00+00:00, run_start_date=2024-05-25 00:35:00.589432+00:00, run_end_date=2024-05-25 00:35:04.546301+00:00, run_duration=3.956869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:34:00+00:00, data_interval_end=2024-05-25 00:35:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:35:04.559461610Z [2024-05-25T00:35:04.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:35:00+00:00, run_after=2024-05-25T00:36:00+00:00 2024-05-25T00:35:04.567605931Z [2024-05-25T00:35:04.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:35:04.567823146Z [2024-05-25T00:35:04.567+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:34:00+00:00, run_id=scheduled__2024-05-25T00:34:00+00:00, run_start_date=2024-05-25 00:35:00.591297+00:00, run_end_date=2024-05-25 00:35:04.567532+00:00, run_duration=3.976235, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:34:00+00:00, data_interval_end=2024-05-25 00:35:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:35:04.579808189Z [2024-05-25T00:35:04.578+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:35:00+00:00, run_after=2024-05-25T00:36:00+00:00 2024-05-25T00:35:04.644632708Z [2024-05-25T00:35:04.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:34:00+00:00 exited with status success for try_number 1 2024-05-25T00:35:04.650843354Z [2024-05-25T00:35:04.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:34:00+00:00, map_index=-1, run_start_date=2024-05-25 00:35:02.570721+00:00, run_end_date=2024-05-25 00:35:03.983859+00:00, run_duration=1.413138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:35:00.695580+00:00, queued_by_job_id=1, pid=6397 2024-05-25T00:35:05.742277293Z [2024-05-25T00:35:05.741+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:35:05.742310690Z 2024-05-25T00:35:05.742704137Z [2024-05-25T00:35:05.742+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:35:05.744567974Z [2024-05-25T00:35:05.744+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:35:05.744584775Z 2024-05-25T00:35:05.748520921Z [2024-05-25T00:35:05.748+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T00:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T00:35:05.748813753Z [2024-05-25T00:35:05.748+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:35:05.814613860Z [2024-05-25T00:35:05.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status queued for try_number 1 2024-05-25T00:35:05.814921512Z [2024-05-25T00:35:05.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:34:00+00:00 exited with status success for try_number 1 2024-05-25T00:35:05.815091779Z [2024-05-25T00:35:05.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status success for try_number 1 2024-05-25T00:35:05.823532923Z [2024-05-25T00:35:05.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:34:00+00:00, map_index=-1, run_start_date=2024-05-25 00:35:02.808700+00:00, run_end_date=2024-05-25 00:35:04.497419+00:00, run_duration=1.688719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:35:00.695580+00:00, queued_by_job_id=1, pid=6404 2024-05-25T00:35:05.823906466Z [2024-05-25T00:35:05.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T00:30:00+00:00, map_index=-1, run_start_date=2024-05-25 00:35:05.139161+00:00, run_end_date=2024-05-25 00:35:05.507487+00:00, run_duration=0.368326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:35:03.521548+00:00, queued_by_job_id=1, pid=6427 2024-05-25T00:35:05.824220657Z [2024-05-25T00:35:05.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67b9783b-4b1f-4b82-bad6-9732dea7c14d 2024-05-25T00:35:08.117471983Z [2024-05-25T00:35:08.117+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:35:08.117522584Z 2024-05-25T00:35:08.117940398Z [2024-05-25T00:35:08.117+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:35:08.118740286Z [2024-05-25T00:35:08.118+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:35:08.118751079Z 2024-05-25T00:35:08.121849965Z [2024-05-25T00:35:08.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:35:08.122199257Z [2024-05-25T00:35:08.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:35:08.195965645Z [2024-05-25T00:35:08.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status queued for try_number 1 2024-05-25T00:35:08.196110469Z [2024-05-25T00:35:08.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status success for try_number 1 2024-05-25T00:35:08.209327104Z [2024-05-25T00:35:08.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86c9c55b-4164-49a1-8209-a24368f1fef9 2024-05-25T00:35:08.209439574Z [2024-05-25T00:35:08.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T00:30:00+00:00, map_index=0, run_start_date=2024-05-25 00:35:07.382068+00:00, run_end_date=2024-05-25 00:35:07.762397+00:00, run_duration=0.380329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:35:05.745543+00:00, queued_by_job_id=1, pid=6445 2024-05-25T00:35:10.863689956Z [2024-05-25T00:35:10.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:35:10.864191678Z [2024-05-25T00:35:10.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:30:00+00:00, run_id=scheduled__2024-05-25T00:30:00+00:00, run_start_date=2024-05-25 00:35:00.584135+00:00, run_end_date=2024-05-25 00:35:10.863586+00:00, run_duration=10.279451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:30:00+00:00, data_interval_end=2024-05-25 00:35:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T00:35:10.873069554Z [2024-05-25T00:35:10.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:35:00+00:00, run_after=2024-05-25T00:40:00+00:00 2024-05-25T00:35:10.920665101Z [2024-05-25T00:35:10.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:30:00+00:00 exited with status success for try_number 1 2024-05-25T00:35:10.928889237Z [2024-05-25T00:35:10.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T00:30:00+00:00, map_index=-1, run_start_date=2024-05-25 00:35:09.888830+00:00, run_end_date=2024-05-25 00:35:10.334397+00:00, run_duration=0.445567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:35:08.119237+00:00, queued_by_job_id=1, pid=6456 2024-05-25T00:35:28.515725077Z [2024-05-25T00:35:28.515+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T00:36:00.552121486Z [2024-05-25T00:36:00.551+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:36:00.565782967Z [2024-05-25T00:36:00.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:36:00+00:00, run_after=2024-05-25T00:37:00+00:00 2024-05-25T00:36:00.579247155Z [2024-05-25T00:36:00.578+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:36:00+00:00, run_after=2024-05-25T00:37:00+00:00 2024-05-25T00:36:00.586863716Z [2024-05-25T00:36:00.586+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:36:00.685701749Z [2024-05-25T00:36:00.685+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:36:00.685746259Z 2024-05-25T00:36:00.685764323Z 2024-05-25T00:36:00.685773630Z 2024-05-25T00:36:00.685782668Z 2024-05-25T00:36:00.686099883Z [2024-05-25T00:36:00.685+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:36:00.686529525Z [2024-05-25T00:36:00.686+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:36:00.687212030Z [2024-05-25T00:36:00.686+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:36:00.687517507Z [2024-05-25T00:36:00.687+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:36:00.689109481Z [2024-05-25T00:36:00.688+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:36:00.689129649Z 2024-05-25T00:36:00.689138315Z 2024-05-25T00:36:00.689144450Z 2024-05-25T00:36:00.689150356Z 2024-05-25T00:36:00.695396558Z [2024-05-25T00:36:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:36:00.695882704Z [2024-05-25T00:36:00.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:36:00.696427292Z [2024-05-25T00:36:00.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:36:00.696885428Z [2024-05-25T00:36:00.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:36:00.697422507Z [2024-05-25T00:36:00.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:36:00.698082631Z [2024-05-25T00:36:00.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:36:00.698512459Z [2024-05-25T00:36:00.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:36:00.698752173Z [2024-05-25T00:36:00.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:36:01.260247482Z [2024-05-25T00:36:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:34:00+00:00 exited with status queued for try_number 1 2024-05-25T00:36:01.260739892Z [2024-05-25T00:36:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status queued for try_number 1 2024-05-25T00:36:01.261008034Z [2024-05-25T00:36:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status queued for try_number 1 2024-05-25T00:36:01.261249733Z [2024-05-25T00:36:01.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status queued for try_number 1 2024-05-25T00:36:01.292586795Z [2024-05-25T00:36:01.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to 900f2b8b-25e7-4faa-8508-197517bbedfe 2024-05-25T00:36:01.292925048Z [2024-05-25T00:36:01.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5efeeded-c815-45bf-83ad-a2e82d1d14d4 2024-05-25T00:36:01.293139919Z [2024-05-25T00:36:01.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to a726389f-0bd6-42da-a298-1915d7c020e8 2024-05-25T00:36:01.293398308Z [2024-05-25T00:36:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a664b51-ad40-4229-9538-63bbc5c15a96 2024-05-25T00:36:02.630934282Z [2024-05-25T00:36:02.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:36:02.631429797Z [2024-05-25T00:36:02.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:34:00+00:00, run_id=scheduled__2024-05-25T00:34:00+00:00, run_start_date=2024-05-25 00:36:00.598571+00:00, run_end_date=2024-05-25 00:36:02.630891+00:00, run_duration=2.03232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:34:00+00:00, data_interval_end=2024-05-25 00:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:36:02.643130267Z [2024-05-25T00:36:02.642+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:36:00+00:00, run_after=2024-05-25T00:38:00+00:00 2024-05-25T00:36:02.650792086Z [2024-05-25T00:36:02.650+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:36:02.651182198Z [2024-05-25T00:36:02.650+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:35:00+00:00, run_id=scheduled__2024-05-25T00:35:00+00:00, run_start_date=2024-05-25 00:36:00.599936+00:00, run_end_date=2024-05-25 00:36:02.650717+00:00, run_duration=2.050781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:35:00+00:00, data_interval_end=2024-05-25 00:36:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:36:02.673424946Z [2024-05-25T00:36:02.672+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:36:00+00:00, run_after=2024-05-25T00:37:00+00:00 2024-05-25T00:36:02.744429299Z [2024-05-25T00:36:02.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:34:00+00:00 exited with status success for try_number 1 2024-05-25T00:36:02.744559063Z [2024-05-25T00:36:02.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status success for try_number 1 2024-05-25T00:36:02.760178898Z [2024-05-25T00:36:02.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:34:00+00:00, map_index=-1, run_start_date=2024-05-25 00:36:01.530413+00:00, run_end_date=2024-05-25 00:36:01.924370+00:00, run_duration=0.393957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:36:00.690680+00:00, queued_by_job_id=1, pid=6466 2024-05-25T00:36:02.760612173Z [2024-05-25T00:36:02.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:35:00+00:00, map_index=-1, run_start_date=2024-05-25 00:36:01.566162+00:00, run_end_date=2024-05-25 00:36:02.018458+00:00, run_duration=0.452296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:36:00.690680+00:00, queued_by_job_id=1, pid=6467 2024-05-25T00:36:04.950845746Z [2024-05-25T00:36:04.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:36:04.951249560Z [2024-05-25T00:36:04.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:35:00+00:00, run_id=scheduled__2024-05-25T00:35:00+00:00, run_start_date=2024-05-25 00:36:00.601198+00:00, run_end_date=2024-05-25 00:36:04.950830+00:00, run_duration=4.349632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:35:00+00:00, data_interval_end=2024-05-25 00:36:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:36:04.961529837Z [2024-05-25T00:36:04.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:36:00+00:00, run_after=2024-05-25T00:37:00+00:00 2024-05-25T00:36:05.017850997Z [2024-05-25T00:36:05.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status success for try_number 1 2024-05-25T00:36:05.027947260Z [2024-05-25T00:36:05.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:35:00+00:00, map_index=-1, run_start_date=2024-05-25 00:36:02.811055+00:00, run_end_date=2024-05-25 00:36:04.255997+00:00, run_duration=1.444942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:36:00.690680+00:00, queued_by_job_id=1, pid=6491 2024-05-25T00:36:06.082239771Z [2024-05-25T00:36:06.081+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:36:06.082568241Z [2024-05-25T00:36:06.082+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:35:00+00:00, run_id=scheduled__2024-05-25T00:35:00+00:00, run_start_date=2024-05-25 00:36:00.602459+00:00, run_end_date=2024-05-25 00:36:06.082143+00:00, run_duration=5.479684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:35:00+00:00, data_interval_end=2024-05-25 00:36:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:36:06.091830823Z [2024-05-25T00:36:06.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:36:00+00:00, run_after=2024-05-25T00:37:00+00:00 2024-05-25T00:36:06.143934805Z [2024-05-25T00:36:06.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status success for try_number 1 2024-05-25T00:36:06.154606193Z [2024-05-25T00:36:06.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:35:00+00:00, map_index=-1, run_start_date=2024-05-25 00:36:02.736252+00:00, run_end_date=2024-05-25 00:36:05.581962+00:00, run_duration=2.84571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:36:00.690680+00:00, queued_by_job_id=1, pid=6490 2024-05-25T00:37:00.189325729Z [2024-05-25T00:37:00.188+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:37:00+00:00, run_after=2024-05-25T00:38:00+00:00 2024-05-25T00:37:00.198883157Z [2024-05-25T00:37:00.198+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:37:00.211521276Z [2024-05-25T00:37:00.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:37:00+00:00, run_after=2024-05-25T00:38:00+00:00 2024-05-25T00:37:00.302775229Z [2024-05-25T00:37:00.302+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:37:00.302828218Z 2024-05-25T00:37:00.302838333Z 2024-05-25T00:37:00.302847144Z 2024-05-25T00:37:00.303228481Z [2024-05-25T00:37:00.302+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:37:00.303841988Z [2024-05-25T00:37:00.303+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:37:00.304469394Z [2024-05-25T00:37:00.304+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:37:00.305871937Z [2024-05-25T00:37:00.305+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:37:00.305898595Z 2024-05-25T00:37:00.305907674Z 2024-05-25T00:37:00.305916352Z 2024-05-25T00:37:00.312405671Z [2024-05-25T00:37:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:37:00.312633604Z [2024-05-25T00:37:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:37:00.313110643Z [2024-05-25T00:37:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:37:00.313475662Z [2024-05-25T00:37:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:37:00.313917197Z [2024-05-25T00:37:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:37:00.314124482Z [2024-05-25T00:37:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:37:00.522867462Z [2024-05-25T00:37:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:36:00+00:00 exited with status queued for try_number 1 2024-05-25T00:37:00.524798026Z [2024-05-25T00:37:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:36:00+00:00 exited with status queued for try_number 1 2024-05-25T00:37:00.525015672Z [2024-05-25T00:37:00.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:36:00+00:00 exited with status queued for try_number 1 2024-05-25T00:37:00.532035838Z [2024-05-25T00:37:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0af3498-343d-487e-a911-69d8d54fdef5 2024-05-25T00:37:00.532202496Z [2024-05-25T00:37:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06e6adda-1c02-4fb7-b274-e24d2305d0f2 2024-05-25T00:37:00.532357897Z [2024-05-25T00:37:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ee0dd84-acc5-415b-8062-e3158403a97d 2024-05-25T00:37:01.669557071Z [2024-05-25T00:37:01.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:37:01.669854421Z [2024-05-25T00:37:01.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:36:00+00:00, run_id=scheduled__2024-05-25T00:36:00+00:00, run_start_date=2024-05-25 00:37:00.221234+00:00, run_end_date=2024-05-25 00:37:01.669446+00:00, run_duration=1.448212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:36:00+00:00, data_interval_end=2024-05-25 00:37:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:37:01.679946166Z [2024-05-25T00:37:01.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:37:00+00:00, run_after=2024-05-25T00:38:00+00:00 2024-05-25T00:37:01.732503073Z [2024-05-25T00:37:01.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:36:00+00:00 exited with status success for try_number 1 2024-05-25T00:37:01.739772722Z [2024-05-25T00:37:01.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:36:00+00:00, map_index=-1, run_start_date=2024-05-25 00:37:01.057648+00:00, run_end_date=2024-05-25 00:37:01.530984+00:00, run_duration=0.473336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:37:00.307524+00:00, queued_by_job_id=1, pid=6523 2024-05-25T00:37:04.604677116Z [2024-05-25T00:37:04.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:37:04.604741382Z [2024-05-25T00:37:04.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:36:00+00:00, run_id=scheduled__2024-05-25T00:36:00+00:00, run_start_date=2024-05-25 00:37:00.222737+00:00, run_end_date=2024-05-25 00:37:04.604207+00:00, run_duration=4.38147, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:36:00+00:00, data_interval_end=2024-05-25 00:37:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:37:04.614031925Z [2024-05-25T00:37:04.613+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:37:00+00:00, run_after=2024-05-25T00:38:00+00:00 2024-05-25T00:37:04.653670449Z [2024-05-25T00:37:04.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:36:00+00:00 exited with status success for try_number 1 2024-05-25T00:37:04.665683987Z [2024-05-25T00:37:04.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:36:00+00:00, map_index=-1, run_start_date=2024-05-25 00:37:02.207760+00:00, run_end_date=2024-05-25 00:37:03.544508+00:00, run_duration=1.336748, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:37:00.307524+00:00, queued_by_job_id=1, pid=6541 2024-05-25T00:37:05.722039667Z [2024-05-25T00:37:05.721+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:37:05.722145140Z [2024-05-25T00:37:05.721+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:36:00+00:00, run_id=scheduled__2024-05-25T00:36:00+00:00, run_start_date=2024-05-25 00:37:00.223728+00:00, run_end_date=2024-05-25 00:37:05.721823+00:00, run_duration=5.498095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:36:00+00:00, data_interval_end=2024-05-25 00:37:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:37:05.734035043Z [2024-05-25T00:37:05.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:37:00+00:00, run_after=2024-05-25T00:38:00+00:00 2024-05-25T00:37:05.772118569Z [2024-05-25T00:37:05.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:36:00+00:00 exited with status success for try_number 1 2024-05-25T00:37:05.777956465Z [2024-05-25T00:37:05.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:36:00+00:00, map_index=-1, run_start_date=2024-05-25 00:37:02.226746+00:00, run_end_date=2024-05-25 00:37:04.580239+00:00, run_duration=2.353493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:37:00.307524+00:00, queued_by_job_id=1, pid=6542 2024-05-25T00:38:00.428129344Z [2024-05-25T00:38:00.427+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:38:00.436928935Z [2024-05-25T00:38:00.436+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:38:00.451111259Z [2024-05-25T00:38:00.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:38:00+00:00, run_after=2024-05-25T00:39:00+00:00 2024-05-25T00:38:00.464165455Z [2024-05-25T00:38:00.463+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:38:00+00:00, run_after=2024-05-25T00:39:00+00:00 2024-05-25T00:38:00.585291431Z [2024-05-25T00:38:00.584+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:38:00.585332781Z 2024-05-25T00:38:00.585378460Z 2024-05-25T00:38:00.585389696Z 2024-05-25T00:38:00.585400263Z 2024-05-25T00:38:00.585582827Z [2024-05-25T00:38:00.585+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:38:00.585921160Z [2024-05-25T00:38:00.585+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:38:00.586393963Z [2024-05-25T00:38:00.585+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:38:00.586772813Z [2024-05-25T00:38:00.586+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:38:00.588150891Z [2024-05-25T00:38:00.587+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:38:00.588276954Z 2024-05-25T00:38:00.588289517Z 2024-05-25T00:38:00.588298566Z 2024-05-25T00:38:00.588307483Z 2024-05-25T00:38:00.596631489Z [2024-05-25T00:38:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:38:00.596890352Z [2024-05-25T00:38:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:38:00.598599405Z [2024-05-25T00:38:00.598+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:38:00.598787356Z [2024-05-25T00:38:00.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:38:00.599573729Z [2024-05-25T00:38:00.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:38:00.599668565Z [2024-05-25T00:38:00.599+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:38:00.600151815Z [2024-05-25T00:38:00.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:38:00.600326113Z [2024-05-25T00:38:00.599+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:38:01.088909047Z [2024-05-25T00:38:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:36:00+00:00 exited with status queued for try_number 1 2024-05-25T00:38:01.089257689Z [2024-05-25T00:38:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:37:00+00:00 exited with status queued for try_number 1 2024-05-25T00:38:01.089374403Z [2024-05-25T00:38:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:37:00+00:00 exited with status queued for try_number 1 2024-05-25T00:38:01.089480971Z [2024-05-25T00:38:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:37:00+00:00 exited with status queued for try_number 1 2024-05-25T00:38:01.098854234Z [2024-05-25T00:38:01.098+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae824628-737a-46ac-aabe-6f84d1d03e32 2024-05-25T00:38:01.099018746Z [2024-05-25T00:38:01.098+0000] {scheduler_job.py:635} INFO - Setting external_id for to af33ed0b-93f2-4da5-9014-d9535d963bff 2024-05-25T00:38:01.099794653Z [2024-05-25T00:38:01.099+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12129301-5b0b-4d64-8df4-d5792d4d216c 2024-05-25T00:38:01.099938508Z [2024-05-25T00:38:01.099+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b54cce1-111d-4ede-8604-674fb7ca4169 2024-05-25T00:38:02.313488048Z [2024-05-25T00:38:02.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:38:02.313516280Z [2024-05-25T00:38:02.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:36:00+00:00, run_id=scheduled__2024-05-25T00:36:00+00:00, run_start_date=2024-05-25 00:38:00.474784+00:00, run_end_date=2024-05-25 00:38:02.309044+00:00, run_duration=1.83426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:36:00+00:00, data_interval_end=2024-05-25 00:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:38:02.327016588Z [2024-05-25T00:38:02.326+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:38:00+00:00, run_after=2024-05-25T00:40:00+00:00 2024-05-25T00:38:02.353833306Z [2024-05-25T00:38:02.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:38:02.354269147Z [2024-05-25T00:38:02.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:37:00+00:00, run_id=scheduled__2024-05-25T00:37:00+00:00, run_start_date=2024-05-25 00:38:00.475889+00:00, run_end_date=2024-05-25 00:38:02.353939+00:00, run_duration=1.87805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:37:00+00:00, data_interval_end=2024-05-25 00:38:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:38:02.376756046Z [2024-05-25T00:38:02.376+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:38:00+00:00, run_after=2024-05-25T00:39:00+00:00 2024-05-25T00:38:02.467211337Z [2024-05-25T00:38:02.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:36:00+00:00 exited with status success for try_number 1 2024-05-25T00:38:02.467724491Z [2024-05-25T00:38:02.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:37:00+00:00 exited with status success for try_number 1 2024-05-25T00:38:02.481308249Z [2024-05-25T00:38:02.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:36:00+00:00, map_index=-1, run_start_date=2024-05-25 00:38:01.463821+00:00, run_end_date=2024-05-25 00:38:01.790746+00:00, run_duration=0.326925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:38:00.590645+00:00, queued_by_job_id=1, pid=6576 2024-05-25T00:38:02.482044915Z [2024-05-25T00:38:02.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:37:00+00:00, map_index=-1, run_start_date=2024-05-25 00:38:01.619386+00:00, run_end_date=2024-05-25 00:38:02.030157+00:00, run_duration=0.410771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:38:00.590645+00:00, queued_by_job_id=1, pid=6577 2024-05-25T00:38:04.471942435Z [2024-05-25T00:38:04.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:38:04.472538145Z [2024-05-25T00:38:04.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:37:00+00:00, run_id=scheduled__2024-05-25T00:37:00+00:00, run_start_date=2024-05-25 00:38:00.476936+00:00, run_end_date=2024-05-25 00:38:04.472036+00:00, run_duration=3.9951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:37:00+00:00, data_interval_end=2024-05-25 00:38:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:38:04.487591498Z [2024-05-25T00:38:04.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:38:00+00:00, run_after=2024-05-25T00:39:00+00:00 2024-05-25T00:38:04.498152731Z [2024-05-25T00:38:04.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:38:04.498613250Z [2024-05-25T00:38:04.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:37:00+00:00, run_id=scheduled__2024-05-25T00:37:00+00:00, run_start_date=2024-05-25 00:38:00.478332+00:00, run_end_date=2024-05-25 00:38:04.498128+00:00, run_duration=4.019796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:37:00+00:00, data_interval_end=2024-05-25 00:38:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:38:04.519227081Z [2024-05-25T00:38:04.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:38:00+00:00, run_after=2024-05-25T00:39:00+00:00 2024-05-25T00:38:04.570632060Z [2024-05-25T00:38:04.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:37:00+00:00 exited with status success for try_number 1 2024-05-25T00:38:04.576918808Z [2024-05-25T00:38:04.576+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:37:00+00:00, map_index=-1, run_start_date=2024-05-25 00:38:02.999826+00:00, run_end_date=2024-05-25 00:38:04.342875+00:00, run_duration=1.343049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:38:00.590645+00:00, queued_by_job_id=1, pid=6601 2024-05-25T00:38:05.671826762Z [2024-05-25T00:38:05.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:37:00+00:00 exited with status success for try_number 1 2024-05-25T00:38:05.680835308Z [2024-05-25T00:38:05.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:37:00+00:00, map_index=-1, run_start_date=2024-05-25 00:38:02.853610+00:00, run_end_date=2024-05-25 00:38:04.391862+00:00, run_duration=1.538252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:38:00.590645+00:00, queued_by_job_id=1, pid=6600 2024-05-25T00:39:00.310256516Z [2024-05-25T00:39:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:39:00+00:00, run_after=2024-05-25T00:40:00+00:00 2024-05-25T00:39:00.325857687Z [2024-05-25T00:39:00.325+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:39:00+00:00, run_after=2024-05-25T00:40:00+00:00 2024-05-25T00:39:00.335623928Z [2024-05-25T00:39:00.335+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:39:00.417978357Z [2024-05-25T00:39:00.417+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:39:00.418020884Z 2024-05-25T00:39:00.418027047Z 2024-05-25T00:39:00.418054438Z 2024-05-25T00:39:00.418505984Z [2024-05-25T00:39:00.418+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:39:00.418863495Z [2024-05-25T00:39:00.418+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:39:00.419181477Z [2024-05-25T00:39:00.418+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:39:00.420189702Z [2024-05-25T00:39:00.419+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:39:00.420206996Z 2024-05-25T00:39:00.420212480Z 2024-05-25T00:39:00.420217589Z 2024-05-25T00:39:00.426061869Z [2024-05-25T00:39:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:39:00.426388684Z [2024-05-25T00:39:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:39:00.427122152Z [2024-05-25T00:39:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:39:00.427346256Z [2024-05-25T00:39:00.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:39:00.427638475Z [2024-05-25T00:39:00.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:39:00.427849847Z [2024-05-25T00:39:00.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:39:00.671628595Z [2024-05-25T00:39:00.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:38:00+00:00 exited with status queued for try_number 1 2024-05-25T00:39:00.674601447Z [2024-05-25T00:39:00.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:38:00+00:00 exited with status queued for try_number 1 2024-05-25T00:39:00.674777175Z [2024-05-25T00:39:00.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:38:00+00:00 exited with status queued for try_number 1 2024-05-25T00:39:00.684301713Z [2024-05-25T00:39:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to a01a89fe-7823-4517-bb59-152898c8da67 2024-05-25T00:39:00.684667787Z [2024-05-25T00:39:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a011a6d-9990-4e82-bba2-a7f60b230650 2024-05-25T00:39:00.684929359Z [2024-05-25T00:39:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 323168b9-0789-4298-8bcd-25eeea6fad6e 2024-05-25T00:39:01.804995108Z [2024-05-25T00:39:01.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:39:01.805412689Z [2024-05-25T00:39:01.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:38:00+00:00, run_id=scheduled__2024-05-25T00:38:00+00:00, run_start_date=2024-05-25 00:39:00.347660+00:00, run_end_date=2024-05-25 00:39:01.804998+00:00, run_duration=1.457338, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:38:00+00:00, data_interval_end=2024-05-25 00:39:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:39:01.814254681Z [2024-05-25T00:39:01.813+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:39:00+00:00, run_after=2024-05-25T00:40:00+00:00 2024-05-25T00:39:01.855241457Z [2024-05-25T00:39:01.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:38:00+00:00 exited with status success for try_number 1 2024-05-25T00:39:01.860342565Z [2024-05-25T00:39:01.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:38:00+00:00, map_index=-1, run_start_date=2024-05-25 00:39:01.165014+00:00, run_end_date=2024-05-25 00:39:01.516102+00:00, run_duration=0.351088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:39:00.421622+00:00, queued_by_job_id=1, pid=6634 2024-05-25T00:39:04.036283669Z [2024-05-25T00:39:04.035+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:39:04.036847742Z [2024-05-25T00:39:04.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:38:00+00:00, run_id=scheduled__2024-05-25T00:38:00+00:00, run_start_date=2024-05-25 00:39:00.350575+00:00, run_end_date=2024-05-25 00:39:04.036174+00:00, run_duration=3.685599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:38:00+00:00, data_interval_end=2024-05-25 00:39:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:39:04.045571089Z [2024-05-25T00:39:04.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:39:00+00:00, run_after=2024-05-25T00:40:00+00:00 2024-05-25T00:39:04.312590118Z [2024-05-25T00:39:04.312+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:39:04.312953596Z [2024-05-25T00:39:04.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:38:00+00:00, run_id=scheduled__2024-05-25T00:38:00+00:00, run_start_date=2024-05-25 00:39:00.349273+00:00, run_end_date=2024-05-25 00:39:04.312415+00:00, run_duration=3.963142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:38:00+00:00, data_interval_end=2024-05-25 00:39:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:39:04.333875200Z [2024-05-25T00:39:04.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:39:00+00:00, run_after=2024-05-25T00:40:00+00:00 2024-05-25T00:39:04.373982732Z [2024-05-25T00:39:04.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:38:00+00:00 exited with status success for try_number 1 2024-05-25T00:39:04.374134363Z [2024-05-25T00:39:04.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:38:00+00:00 exited with status success for try_number 1 2024-05-25T00:39:04.381321753Z [2024-05-25T00:39:04.380+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:38:00+00:00, map_index=-1, run_start_date=2024-05-25 00:39:02.240148+00:00, run_end_date=2024-05-25 00:39:03.998500+00:00, run_duration=1.758352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:39:00.421622+00:00, queued_by_job_id=1, pid=6652 2024-05-25T00:39:04.381496978Z [2024-05-25T00:39:04.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:38:00+00:00, map_index=-1, run_start_date=2024-05-25 00:39:02.355973+00:00, run_end_date=2024-05-25 00:39:03.958560+00:00, run_duration=1.602587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:39:00.421622+00:00, queued_by_job_id=1, pid=6653 2024-05-25T00:40:00.216755287Z [2024-05-25T00:40:00.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:40:00+00:00, run_after=2024-05-25T00:41:00+00:00 2024-05-25T00:40:00.225132040Z [2024-05-25T00:40:00.224+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:40:00.238328571Z [2024-05-25T00:40:00.237+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:40:00+00:00, run_after=2024-05-25T00:41:00+00:00 2024-05-25T00:40:00.246690906Z [2024-05-25T00:40:00.246+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:40:00.260255403Z [2024-05-25T00:40:00.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:40:00+00:00, run_after=2024-05-25T00:45:00+00:00 2024-05-25T00:40:00.401692866Z [2024-05-25T00:40:00.401+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T00:40:00.401722817Z 2024-05-25T00:40:00.401728672Z 2024-05-25T00:40:00.401734248Z 2024-05-25T00:40:00.401738778Z 2024-05-25T00:40:00.401743455Z 2024-05-25T00:40:00.402075722Z [2024-05-25T00:40:00.401+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:40:00.402445479Z [2024-05-25T00:40:00.402+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:40:00.402753221Z [2024-05-25T00:40:00.402+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:40:00.403072010Z [2024-05-25T00:40:00.402+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:40:00.403369143Z [2024-05-25T00:40:00.403+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:40:00.404582934Z [2024-05-25T00:40:00.404+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:40:00.404601381Z 2024-05-25T00:40:00.404607069Z 2024-05-25T00:40:00.404612414Z 2024-05-25T00:40:00.404617102Z 2024-05-25T00:40:00.404621768Z 2024-05-25T00:40:00.411220041Z [2024-05-25T00:40:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T00:40:00.411590612Z [2024-05-25T00:40:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:40:00.412143848Z [2024-05-25T00:40:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:40:00.412480541Z [2024-05-25T00:40:00.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:40:00.412960085Z [2024-05-25T00:40:00.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:40:00.413309873Z [2024-05-25T00:40:00.413+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:40:00.413759900Z [2024-05-25T00:40:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:40:00.414067907Z [2024-05-25T00:40:00.413+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:40:00.414507790Z [2024-05-25T00:40:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:40:00.414819327Z [2024-05-25T00:40:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:40:00.976947933Z [2024-05-25T00:40:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status queued for try_number 1 2024-05-25T00:40:00.977151967Z [2024-05-25T00:40:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:38:00+00:00 exited with status queued for try_number 1 2024-05-25T00:40:00.977330750Z [2024-05-25T00:40:00.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:39:00+00:00 exited with status queued for try_number 1 2024-05-25T00:40:00.977479638Z [2024-05-25T00:40:00.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:39:00+00:00 exited with status queued for try_number 1 2024-05-25T00:40:00.977619726Z [2024-05-25T00:40:00.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:39:00+00:00 exited with status queued for try_number 1 2024-05-25T00:40:00.991385498Z [2024-05-25T00:40:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5091cdf3-4b91-445f-bcff-b36b2b22d4d0 2024-05-25T00:40:00.991629445Z [2024-05-25T00:40:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 973bb11b-b599-4f14-ac38-283e8495a4d0 2024-05-25T00:40:00.991837969Z [2024-05-25T00:40:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f8f409c-ec58-4b86-a8fb-558a991444e3 2024-05-25T00:40:00.992033893Z [2024-05-25T00:40:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91028370-4d55-44f7-99d6-53a1afe32a70 2024-05-25T00:40:00.992261856Z [2024-05-25T00:40:00.992+0000] {scheduler_job.py:635} INFO - Setting external_id for to c201eeb7-5a2b-47a4-9161-56c789025484 2024-05-25T00:40:03.450334025Z [2024-05-25T00:40:03.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:40:03.450747930Z [2024-05-25T00:40:03.450+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:38:00+00:00, run_id=scheduled__2024-05-25T00:38:00+00:00, run_start_date=2024-05-25 00:40:00.275399+00:00, run_end_date=2024-05-25 00:40:03.450355+00:00, run_duration=3.174956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:38:00+00:00, data_interval_end=2024-05-25 00:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:40:03.458385599Z [2024-05-25T00:40:03.458+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:40:00+00:00, run_after=2024-05-25T00:42:00+00:00 2024-05-25T00:40:03.464537103Z [2024-05-25T00:40:03.464+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:40:03.464819088Z [2024-05-25T00:40:03.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:39:00+00:00, run_id=scheduled__2024-05-25T00:39:00+00:00, run_start_date=2024-05-25 00:40:00.276670+00:00, run_end_date=2024-05-25 00:40:03.464537+00:00, run_duration=3.187867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:39:00+00:00, data_interval_end=2024-05-25 00:40:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:40:03.474528964Z [2024-05-25T00:40:03.474+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:40:00+00:00, run_after=2024-05-25T00:41:00+00:00 2024-05-25T00:40:03.514729589Z [2024-05-25T00:40:03.514+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:40:03.514750885Z 2024-05-25T00:40:03.515250087Z [2024-05-25T00:40:03.515+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:40:03.515814117Z [2024-05-25T00:40:03.515+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:40:03.515825132Z 2024-05-25T00:40:03.518081023Z [2024-05-25T00:40:03.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T00:40:03.518257272Z [2024-05-25T00:40:03.518+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:40:03.595459871Z [2024-05-25T00:40:03.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status queued for try_number 1 2024-05-25T00:40:03.595633096Z [2024-05-25T00:40:03.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status success for try_number 1 2024-05-25T00:40:03.595788171Z [2024-05-25T00:40:03.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:38:00+00:00 exited with status success for try_number 1 2024-05-25T00:40:03.595934491Z [2024-05-25T00:40:03.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:39:00+00:00 exited with status success for try_number 1 2024-05-25T00:40:03.609269213Z [2024-05-25T00:40:03.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:39:00+00:00, map_index=-1, run_start_date=2024-05-25 00:40:01.512213+00:00, run_end_date=2024-05-25 00:40:02.317326+00:00, run_duration=0.805113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:40:00.406758+00:00, queued_by_job_id=1, pid=6688 2024-05-25T00:40:03.609560679Z [2024-05-25T00:40:03.609+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fe047df-0427-42b9-aa42-ff08bcedc870 2024-05-25T00:40:03.609871851Z [2024-05-25T00:40:03.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:38:00+00:00, map_index=-1, run_start_date=2024-05-25 00:40:01.492673+00:00, run_end_date=2024-05-25 00:40:02.404320+00:00, run_duration=0.911647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:40:00.406758+00:00, queued_by_job_id=1, pid=6687 2024-05-25T00:40:03.610391597Z [2024-05-25T00:40:03.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T00:35:00+00:00, map_index=-1, run_start_date=2024-05-25 00:40:02.851342+00:00, run_end_date=2024-05-25 00:40:03.255198+00:00, run_duration=0.403856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:40:00.406758+00:00, queued_by_job_id=1, pid=6707 2024-05-25T00:40:05.900711883Z [2024-05-25T00:40:05.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:40:05.901549755Z [2024-05-25T00:40:05.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:39:00+00:00, run_id=scheduled__2024-05-25T00:39:00+00:00, run_start_date=2024-05-25 00:40:00.278956+00:00, run_end_date=2024-05-25 00:40:05.900789+00:00, run_duration=5.621833, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:39:00+00:00, data_interval_end=2024-05-25 00:40:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:40:05.911673378Z [2024-05-25T00:40:05.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:40:00+00:00, run_after=2024-05-25T00:41:00+00:00 2024-05-25T00:40:05.920477367Z [2024-05-25T00:40:05.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:40:05.920900972Z [2024-05-25T00:40:05.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:39:00+00:00, run_id=scheduled__2024-05-25T00:39:00+00:00, run_start_date=2024-05-25 00:40:00.277890+00:00, run_end_date=2024-05-25 00:40:05.920581+00:00, run_duration=5.642691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:39:00+00:00, data_interval_end=2024-05-25 00:40:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:40:05.931800345Z [2024-05-25T00:40:05.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:40:00+00:00, run_after=2024-05-25T00:41:00+00:00 2024-05-25T00:40:05.994603933Z [2024-05-25T00:40:05.994+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:40:05.994634002Z 2024-05-25T00:40:05.998122948Z [2024-05-25T00:40:05.997+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:40:05.999930005Z [2024-05-25T00:40:05.999+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:40:05.999946939Z 2024-05-25T00:40:06.005964730Z [2024-05-25T00:40:06.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T00:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T00:40:06.006120726Z [2024-05-25T00:40:06.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:40:06.090914476Z [2024-05-25T00:40:06.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status queued for try_number 1 2024-05-25T00:40:06.091167465Z [2024-05-25T00:40:06.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:39:00+00:00 exited with status success for try_number 1 2024-05-25T00:40:06.091359510Z [2024-05-25T00:40:06.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:39:00+00:00 exited with status success for try_number 1 2024-05-25T00:40:06.091551401Z [2024-05-25T00:40:06.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status success for try_number 1 2024-05-25T00:40:06.099358969Z [2024-05-25T00:40:06.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:39:00+00:00, map_index=-1, run_start_date=2024-05-25 00:40:03.423522+00:00, run_end_date=2024-05-25 00:40:04.819073+00:00, run_duration=1.395551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:40:00.406758+00:00, queued_by_job_id=1, pid=6723 2024-05-25T00:40:06.099714690Z [2024-05-25T00:40:06.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T00:35:00+00:00, map_index=-1, run_start_date=2024-05-25 00:40:05.323671+00:00, run_end_date=2024-05-25 00:40:05.697948+00:00, run_duration=0.374277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:40:03.516194+00:00, queued_by_job_id=1, pid=6742 2024-05-25T00:40:06.100209152Z [2024-05-25T00:40:06.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:39:00+00:00, map_index=-1, run_start_date=2024-05-25 00:40:03.532246+00:00, run_end_date=2024-05-25 00:40:05.057425+00:00, run_duration=1.525179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:40:00.406758+00:00, queued_by_job_id=1, pid=6725 2024-05-25T00:40:06.100521737Z [2024-05-25T00:40:06.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to a85f1229-059e-4b6c-a372-bdefc7cfd68b 2024-05-25T00:40:09.266145437Z [2024-05-25T00:40:09.265+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:40:09.266192305Z 2024-05-25T00:40:09.266256171Z [2024-05-25T00:40:09.265+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:40:09.267114098Z [2024-05-25T00:40:09.266+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:40:09.267171551Z 2024-05-25T00:40:09.269937789Z [2024-05-25T00:40:09.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:40:09.270207262Z [2024-05-25T00:40:09.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:40:09.339033202Z [2024-05-25T00:40:09.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status queued for try_number 1 2024-05-25T00:40:09.339444829Z [2024-05-25T00:40:09.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status success for try_number 1 2024-05-25T00:40:09.349760044Z [2024-05-25T00:40:09.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05a9df9f-dfb3-4390-a94b-ce478612cf05 2024-05-25T00:40:09.350156207Z [2024-05-25T00:40:09.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T00:35:00+00:00, map_index=0, run_start_date=2024-05-25 00:40:07.845756+00:00, run_end_date=2024-05-25 00:40:08.181173+00:00, run_duration=0.335417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:40:06.000967+00:00, queued_by_job_id=1, pid=6760 2024-05-25T00:40:12.305448225Z [2024-05-25T00:40:12.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:40:12.305673018Z [2024-05-25T00:40:12.305+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:35:00+00:00, run_id=scheduled__2024-05-25T00:35:00+00:00, run_start_date=2024-05-25 00:40:00.274120+00:00, run_end_date=2024-05-25 00:40:12.305314+00:00, run_duration=12.031194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:35:00+00:00, data_interval_end=2024-05-25 00:40:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T00:40:12.312392370Z [2024-05-25T00:40:12.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:40:00+00:00, run_after=2024-05-25T00:45:00+00:00 2024-05-25T00:40:12.360254330Z [2024-05-25T00:40:12.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:35:00+00:00 exited with status success for try_number 1 2024-05-25T00:40:12.367217119Z [2024-05-25T00:40:12.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T00:35:00+00:00, map_index=-1, run_start_date=2024-05-25 00:40:10.895866+00:00, run_end_date=2024-05-25 00:40:11.256160+00:00, run_duration=0.360294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:40:09.267510+00:00, queued_by_job_id=1, pid=6771 2024-05-25T00:40:28.583583668Z [2024-05-25T00:40:28.583+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T00:41:00.228401114Z [2024-05-25T00:41:00.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:41:00+00:00, run_after=2024-05-25T00:42:00+00:00 2024-05-25T00:41:00.242945343Z [2024-05-25T00:41:00.242+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:41:00+00:00, run_after=2024-05-25T00:42:00+00:00 2024-05-25T00:41:00.253004565Z [2024-05-25T00:41:00.252+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:41:00.339647072Z [2024-05-25T00:41:00.339+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:41:00.339689781Z 2024-05-25T00:41:00.339699641Z 2024-05-25T00:41:00.339707942Z 2024-05-25T00:41:00.340004996Z [2024-05-25T00:41:00.339+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:41:00.340313856Z [2024-05-25T00:41:00.339+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:41:00.340549559Z [2024-05-25T00:41:00.340+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:41:00.341529472Z [2024-05-25T00:41:00.341+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:41:00.341551164Z 2024-05-25T00:41:00.341560044Z 2024-05-25T00:41:00.341568497Z 2024-05-25T00:41:00.346816715Z [2024-05-25T00:41:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:41:00.347194542Z [2024-05-25T00:41:00.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:41:00.347697720Z [2024-05-25T00:41:00.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:41:00.348040484Z [2024-05-25T00:41:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:41:00.348659416Z [2024-05-25T00:41:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:41:00.348965652Z [2024-05-25T00:41:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:41:00.606291581Z [2024-05-25T00:41:00.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status queued for try_number 1 2024-05-25T00:41:00.606322002Z [2024-05-25T00:41:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status queued for try_number 1 2024-05-25T00:41:00.606360330Z [2024-05-25T00:41:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status queued for try_number 1 2024-05-25T00:41:00.626494762Z [2024-05-25T00:41:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0912fefa-d642-435b-af61-3d838fb86c46 2024-05-25T00:41:00.626522910Z [2024-05-25T00:41:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to db64ced8-957e-469d-b8e8-3981dd565805 2024-05-25T00:41:00.626648261Z [2024-05-25T00:41:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to d44d4d46-466e-4084-8284-663b82a78ccc 2024-05-25T00:41:01.816334896Z [2024-05-25T00:41:01.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:41:01.816678187Z [2024-05-25T00:41:01.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:40:00+00:00, run_id=scheduled__2024-05-25T00:40:00+00:00, run_start_date=2024-05-25 00:41:00.265593+00:00, run_end_date=2024-05-25 00:41:01.816319+00:00, run_duration=1.550726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:40:00+00:00, data_interval_end=2024-05-25 00:41:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:41:01.826816752Z [2024-05-25T00:41:01.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:41:00+00:00, run_after=2024-05-25T00:42:00+00:00 2024-05-25T00:41:01.891291909Z [2024-05-25T00:41:01.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status success for try_number 1 2024-05-25T00:41:01.899357449Z [2024-05-25T00:41:01.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:40:00+00:00, map_index=-1, run_start_date=2024-05-25 00:41:01.093889+00:00, run_end_date=2024-05-25 00:41:01.510197+00:00, run_duration=0.416308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:41:00.342757+00:00, queued_by_job_id=1, pid=6780 2024-05-25T00:41:04.234254755Z [2024-05-25T00:41:04.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:41:04.234580105Z [2024-05-25T00:41:04.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:40:00+00:00, run_id=scheduled__2024-05-25T00:40:00+00:00, run_start_date=2024-05-25 00:41:00.266924+00:00, run_end_date=2024-05-25 00:41:04.234097+00:00, run_duration=3.967173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:40:00+00:00, data_interval_end=2024-05-25 00:41:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:41:04.243102761Z [2024-05-25T00:41:04.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:41:00+00:00, run_after=2024-05-25T00:42:00+00:00 2024-05-25T00:41:04.259914667Z [2024-05-25T00:41:04.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:41:04.260651164Z [2024-05-25T00:41:04.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:40:00+00:00, run_id=scheduled__2024-05-25T00:40:00+00:00, run_start_date=2024-05-25 00:41:00.268126+00:00, run_end_date=2024-05-25 00:41:04.259957+00:00, run_duration=3.991831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:40:00+00:00, data_interval_end=2024-05-25 00:41:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:41:04.277903158Z [2024-05-25T00:41:04.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:41:00+00:00, run_after=2024-05-25T00:42:00+00:00 2024-05-25T00:41:04.329720822Z [2024-05-25T00:41:04.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status success for try_number 1 2024-05-25T00:41:04.329986839Z [2024-05-25T00:41:04.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status success for try_number 1 2024-05-25T00:41:04.338953445Z [2024-05-25T00:41:04.338+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:40:00+00:00, map_index=-1, run_start_date=2024-05-25 00:41:02.130768+00:00, run_end_date=2024-05-25 00:41:03.551512+00:00, run_duration=1.420744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:41:00.342757+00:00, queued_by_job_id=1, pid=6798 2024-05-25T00:41:04.339358385Z [2024-05-25T00:41:04.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:40:00+00:00, map_index=-1, run_start_date=2024-05-25 00:41:02.289298+00:00, run_end_date=2024-05-25 00:41:03.968660+00:00, run_duration=1.679362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:41:00.342757+00:00, queued_by_job_id=1, pid=6799 2024-05-25T00:42:00.505198098Z [2024-05-25T00:42:00.504+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:42:00+00:00, run_after=2024-05-25T00:43:00+00:00 2024-05-25T00:42:00.561916130Z [2024-05-25T00:42:00.557+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:42:00+00:00, run_after=2024-05-25T00:43:00+00:00 2024-05-25T00:42:00.571660802Z [2024-05-25T00:42:00.570+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:42:00.580237847Z [2024-05-25T00:42:00.578+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:42:00.648755000Z [2024-05-25T00:42:00.648+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:42:00.648779952Z 2024-05-25T00:42:00.648784394Z 2024-05-25T00:42:00.648787635Z 2024-05-25T00:42:00.648791032Z 2024-05-25T00:42:00.648948698Z [2024-05-25T00:42:00.648+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:42:00.649111266Z [2024-05-25T00:42:00.648+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:42:00.649300975Z [2024-05-25T00:42:00.649+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:42:00.649434987Z [2024-05-25T00:42:00.649+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:42:00.650085752Z [2024-05-25T00:42:00.649+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:42:00.650094018Z 2024-05-25T00:42:00.650097881Z 2024-05-25T00:42:00.650115766Z 2024-05-25T00:42:00.650118829Z 2024-05-25T00:42:00.653703827Z [2024-05-25T00:42:00.653+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:42:00.653946619Z [2024-05-25T00:42:00.653+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:42:00.654247578Z [2024-05-25T00:42:00.654+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:42:00.654411120Z [2024-05-25T00:42:00.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:42:00.654665496Z [2024-05-25T00:42:00.654+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:42:00.654818563Z [2024-05-25T00:42:00.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:42:00.655090564Z [2024-05-25T00:42:00.654+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:42:00.655227571Z [2024-05-25T00:42:00.655+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:42:00.978032193Z [2024-05-25T00:42:00.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status queued for try_number 1 2024-05-25T00:42:00.978151091Z [2024-05-25T00:42:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:41:00+00:00 exited with status queued for try_number 1 2024-05-25T00:42:00.978266829Z [2024-05-25T00:42:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:41:00+00:00 exited with status queued for try_number 1 2024-05-25T00:42:00.978394509Z [2024-05-25T00:42:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:41:00+00:00 exited with status queued for try_number 1 2024-05-25T00:42:00.998152099Z [2024-05-25T00:42:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff5679da-c1e3-4d5e-b10a-9a196b730233 2024-05-25T00:42:00.998328194Z [2024-05-25T00:42:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c4db04a-ed76-408d-85b5-4e19cfa38722 2024-05-25T00:42:00.998497873Z [2024-05-25T00:42:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7418f1c5-0124-44be-9260-c0dfe6075f8f 2024-05-25T00:42:00.998699020Z [2024-05-25T00:42:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46eebbb1-7d83-42e4-92af-1e5dbe53a17f 2024-05-25T00:42:02.369892143Z [2024-05-25T00:42:02.369+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:42:02.370115045Z [2024-05-25T00:42:02.369+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:40:00+00:00, run_id=scheduled__2024-05-25T00:40:00+00:00, run_start_date=2024-05-25 00:42:00.589687+00:00, run_end_date=2024-05-25 00:42:02.369772+00:00, run_duration=1.780085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:40:00+00:00, data_interval_end=2024-05-25 00:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:42:02.379324297Z [2024-05-25T00:42:02.378+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:42:00+00:00, run_after=2024-05-25T00:44:00+00:00 2024-05-25T00:42:02.397910889Z [2024-05-25T00:42:02.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:42:02.398296317Z [2024-05-25T00:42:02.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:41:00+00:00, run_id=scheduled__2024-05-25T00:41:00+00:00, run_start_date=2024-05-25 00:42:00.590951+00:00, run_end_date=2024-05-25 00:42:02.397869+00:00, run_duration=1.806918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:41:00+00:00, data_interval_end=2024-05-25 00:42:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:42:02.410880839Z [2024-05-25T00:42:02.410+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:42:00+00:00, run_after=2024-05-25T00:43:00+00:00 2024-05-25T00:42:02.469989734Z [2024-05-25T00:42:02.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status success for try_number 1 2024-05-25T00:42:02.470106672Z [2024-05-25T00:42:02.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:41:00+00:00 exited with status success for try_number 1 2024-05-25T00:42:02.479862477Z [2024-05-25T00:42:02.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:40:00+00:00, map_index=-1, run_start_date=2024-05-25 00:42:01.409592+00:00, run_end_date=2024-05-25 00:42:01.721143+00:00, run_duration=0.311551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:42:00.651033+00:00, queued_by_job_id=1, pid=6827 2024-05-25T00:42:02.480074925Z [2024-05-25T00:42:02.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:41:00+00:00, map_index=-1, run_start_date=2024-05-25 00:42:01.774552+00:00, run_end_date=2024-05-25 00:42:02.203933+00:00, run_duration=0.429381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:42:00.651033+00:00, queued_by_job_id=1, pid=6838 2024-05-25T00:42:05.306824159Z [2024-05-25T00:42:05.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:42:05.307189490Z [2024-05-25T00:42:05.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:41:00+00:00, run_id=scheduled__2024-05-25T00:41:00+00:00, run_start_date=2024-05-25 00:42:00.591903+00:00, run_end_date=2024-05-25 00:42:05.306705+00:00, run_duration=4.714802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:41:00+00:00, data_interval_end=2024-05-25 00:42:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:42:05.317456685Z [2024-05-25T00:42:05.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:42:00+00:00, run_after=2024-05-25T00:43:00+00:00 2024-05-25T00:42:06.423191984Z [2024-05-25T00:42:06.422+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:42:06.423479650Z [2024-05-25T00:42:06.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:41:00+00:00, run_id=scheduled__2024-05-25T00:41:00+00:00, run_start_date=2024-05-25 00:42:00.592846+00:00, run_end_date=2024-05-25 00:42:06.423175+00:00, run_duration=5.830329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:41:00+00:00, data_interval_end=2024-05-25 00:42:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:42:06.432184802Z [2024-05-25T00:42:06.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:42:00+00:00, run_after=2024-05-25T00:43:00+00:00 2024-05-25T00:42:06.475279331Z [2024-05-25T00:42:06.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:41:00+00:00 exited with status success for try_number 1 2024-05-25T00:42:06.475312746Z [2024-05-25T00:42:06.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:41:00+00:00 exited with status success for try_number 1 2024-05-25T00:42:06.489035128Z [2024-05-25T00:42:06.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:41:00+00:00, map_index=-1, run_start_date=2024-05-25 00:42:03.028234+00:00, run_end_date=2024-05-25 00:42:05.233143+00:00, run_duration=2.204909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:42:00.651033+00:00, queued_by_job_id=1, pid=6857 2024-05-25T00:42:06.489068233Z [2024-05-25T00:42:06.485+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:41:00+00:00, map_index=-1, run_start_date=2024-05-25 00:42:03.015747+00:00, run_end_date=2024-05-25 00:42:05.383643+00:00, run_duration=2.367896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:42:00.651033+00:00, queued_by_job_id=1, pid=6856 2024-05-25T00:43:00.782488976Z [2024-05-25T00:43:00.781+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:43:00.797896763Z [2024-05-25T00:43:00.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:43:00+00:00, run_after=2024-05-25T00:44:00+00:00 2024-05-25T00:43:00.811728533Z [2024-05-25T00:43:00.811+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:43:00+00:00, run_after=2024-05-25T00:44:00+00:00 2024-05-25T00:43:00.892337402Z [2024-05-25T00:43:00.891+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:43:00.892367012Z 2024-05-25T00:43:00.892370756Z 2024-05-25T00:43:00.892373897Z 2024-05-25T00:43:00.892476066Z [2024-05-25T00:43:00.892+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:43:00.892652229Z [2024-05-25T00:43:00.892+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:43:00.892857073Z [2024-05-25T00:43:00.892+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:43:00.894064493Z [2024-05-25T00:43:00.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:43:00.894072183Z 2024-05-25T00:43:00.894075698Z 2024-05-25T00:43:00.894083823Z 2024-05-25T00:43:00.898385332Z [2024-05-25T00:43:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:43:00.898718463Z [2024-05-25T00:43:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:43:00.899228647Z [2024-05-25T00:43:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:43:00.899538397Z [2024-05-25T00:43:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:43:00.899950938Z [2024-05-25T00:43:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:43:00.900448455Z [2024-05-25T00:43:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:43:01.139775793Z [2024-05-25T00:43:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:42:00+00:00 exited with status queued for try_number 1 2024-05-25T00:43:01.140123947Z [2024-05-25T00:43:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:42:00+00:00 exited with status queued for try_number 1 2024-05-25T00:43:01.140901266Z [2024-05-25T00:43:01.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:42:00+00:00 exited with status queued for try_number 1 2024-05-25T00:43:01.148856061Z [2024-05-25T00:43:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd8e49a3-2b12-4197-8c24-8c2e209b423a 2024-05-25T00:43:01.149009518Z [2024-05-25T00:43:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5b71528-d4e5-4f2a-bec4-ad7445a77fba 2024-05-25T00:43:01.149291785Z [2024-05-25T00:43:01.149+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41e71e3d-e2b0-4aa1-b289-22652638ce89 2024-05-25T00:43:02.354759402Z [2024-05-25T00:43:02.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:43:02.355057185Z [2024-05-25T00:43:02.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:42:00+00:00, run_id=scheduled__2024-05-25T00:42:00+00:00, run_start_date=2024-05-25 00:43:00.828182+00:00, run_end_date=2024-05-25 00:43:02.354688+00:00, run_duration=1.526506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:42:00+00:00, data_interval_end=2024-05-25 00:43:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:43:02.370584642Z [2024-05-25T00:43:02.370+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:43:00+00:00, run_after=2024-05-25T00:44:00+00:00 2024-05-25T00:43:02.434562847Z [2024-05-25T00:43:02.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:42:00+00:00 exited with status success for try_number 1 2024-05-25T00:43:02.441529012Z [2024-05-25T00:43:02.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:42:00+00:00, map_index=-1, run_start_date=2024-05-25 00:43:01.795294+00:00, run_end_date=2024-05-25 00:43:02.167215+00:00, run_duration=0.371921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:43:00.895158+00:00, queued_by_job_id=1, pid=6889 2024-05-25T00:43:05.225625883Z [2024-05-25T00:43:05.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:43:05.226075935Z [2024-05-25T00:43:05.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:42:00+00:00, run_id=scheduled__2024-05-25T00:42:00+00:00, run_start_date=2024-05-25 00:43:00.829693+00:00, run_end_date=2024-05-25 00:43:05.225489+00:00, run_duration=4.395796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:42:00+00:00, data_interval_end=2024-05-25 00:43:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:43:05.236268801Z [2024-05-25T00:43:05.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:43:00+00:00, run_after=2024-05-25T00:44:00+00:00 2024-05-25T00:43:05.244396331Z [2024-05-25T00:43:05.244+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:43:05.244899298Z [2024-05-25T00:43:05.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:42:00+00:00, run_id=scheduled__2024-05-25T00:42:00+00:00, run_start_date=2024-05-25 00:43:00.830897+00:00, run_end_date=2024-05-25 00:43:05.244468+00:00, run_duration=4.413571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:42:00+00:00, data_interval_end=2024-05-25 00:43:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:43:05.253797325Z [2024-05-25T00:43:05.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:43:00+00:00, run_after=2024-05-25T00:44:00+00:00 2024-05-25T00:43:05.299409455Z [2024-05-25T00:43:05.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:42:00+00:00 exited with status success for try_number 1 2024-05-25T00:43:05.299850833Z [2024-05-25T00:43:05.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:42:00+00:00 exited with status success for try_number 1 2024-05-25T00:43:05.309721144Z [2024-05-25T00:43:05.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:42:00+00:00, map_index=-1, run_start_date=2024-05-25 00:43:02.843096+00:00, run_end_date=2024-05-25 00:43:04.610230+00:00, run_duration=1.767134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:43:00.895158+00:00, queued_by_job_id=1, pid=6908 2024-05-25T00:43:05.309982855Z [2024-05-25T00:43:05.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:42:00+00:00, map_index=-1, run_start_date=2024-05-25 00:43:02.794104+00:00, run_end_date=2024-05-25 00:43:05.000636+00:00, run_duration=2.206532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:43:00.895158+00:00, queued_by_job_id=1, pid=6907 2024-05-25T00:43:25.575294727Z [2024-05-25T00:43:25.574+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf to 2024-05-25T00:43:00+00:00, run_after=2024-05-25T00:44:00+00:00 2024-05-25T00:43:25.624353207Z [2024-05-25T00:43:25.623+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:43:25.624380713Z 2024-05-25T00:43:25.624687774Z [2024-05-25T00:43:25.624+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf has 0/16 running and queued tasks 2024-05-25T00:43:25.625226050Z [2024-05-25T00:43:25.625+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:43:25.625237697Z 2024-05-25T00:43:25.628128675Z [2024-05-25T00:43:25.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:43:25.628153082Z [2024-05-25T00:43:25.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:43:25.700739049Z [2024-05-25T00:43:25.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:42:00+00:00 exited with status queued for try_number 1 2024-05-25T00:43:25.711185643Z [2024-05-25T00:43:25.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50214810-2989-43cb-96ba-5c8e153c3249 2024-05-25T00:43:26.868123481Z [2024-05-25T00:43:26.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:43:26.869689729Z [2024-05-25T00:43:26.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf, execution_date=2024-05-25 00:42:00+00:00, run_id=scheduled__2024-05-25T00:42:00+00:00, run_start_date=2024-05-25 00:43:25.587883+00:00, run_end_date=2024-05-25 00:43:26.868224+00:00, run_duration=1.280341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:42:00+00:00, data_interval_end=2024-05-25 00:43:00+00:00, dag_hash=f5fa3e1db97bf0e0ce9184927fb9ffb7 2024-05-25T00:43:26.887331278Z [2024-05-25T00:43:26.886+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf to 2024-05-25T00:43:00+00:00, run_after=2024-05-25T00:44:00+00:00 2024-05-25T00:43:26.941902973Z [2024-05-25T00:43:26.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:42:00+00:00 exited with status success for try_number 1 2024-05-25T00:43:26.950721969Z [2024-05-25T00:43:26.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:42:00+00:00, map_index=-1, run_start_date=2024-05-25 00:43:26.300606+00:00, run_end_date=2024-05-25 00:43:26.729688+00:00, run_duration=0.429082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:43:25.625607+00:00, queued_by_job_id=1, pid=6938 2024-05-25T00:44:01.013411647Z [2024-05-25T00:44:01.012+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:44:01.026066345Z [2024-05-25T00:44:01.025+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:44:00+00:00, run_after=2024-05-25T00:45:00+00:00 2024-05-25T00:44:01.040430209Z [2024-05-25T00:44:01.040+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf to 2024-05-25T00:44:00+00:00, run_after=2024-05-25T00:45:00+00:00 2024-05-25T00:44:01.055064552Z [2024-05-25T00:44:01.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:44:00+00:00, run_after=2024-05-25T00:45:00+00:00 2024-05-25T00:44:01.064507692Z [2024-05-25T00:44:01.064+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:44:01.205463776Z [2024-05-25T00:44:01.204+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T00:44:01.205509632Z 2024-05-25T00:44:01.205520491Z 2024-05-25T00:44:01.205529497Z 2024-05-25T00:44:01.205547160Z 2024-05-25T00:44:01.205587048Z 2024-05-25T00:44:01.206088077Z [2024-05-25T00:44:01.205+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:44:01.206419471Z [2024-05-25T00:44:01.206+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:44:01.206936904Z [2024-05-25T00:44:01.206+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:44:01.207372164Z [2024-05-25T00:44:01.207+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf has 0/16 running and queued tasks 2024-05-25T00:44:01.207828705Z [2024-05-25T00:44:01.207+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:44:01.208759718Z [2024-05-25T00:44:01.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:44:01.208813616Z 2024-05-25T00:44:01.208822371Z 2024-05-25T00:44:01.208829495Z 2024-05-25T00:44:01.208837658Z 2024-05-25T00:44:01.208844706Z 2024-05-25T00:44:01.216710178Z [2024-05-25T00:44:01.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:44:01.216794102Z [2024-05-25T00:44:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:44:01.217374508Z [2024-05-25T00:44:01.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:44:01.217611589Z [2024-05-25T00:44:01.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:44:01.218053521Z [2024-05-25T00:44:01.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:44:01.218289078Z [2024-05-25T00:44:01.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:44:01.218748087Z [2024-05-25T00:44:01.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:44:01.219132433Z [2024-05-25T00:44:01.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:44:01.219412970Z [2024-05-25T00:44:01.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:44:01.219525924Z [2024-05-25T00:44:01.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:44:01.931430380Z [2024-05-25T00:44:01.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:42:00+00:00 exited with status queued for try_number 1 2024-05-25T00:44:01.931589657Z [2024-05-25T00:44:01.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:43:00+00:00 exited with status queued for try_number 1 2024-05-25T00:44:01.931771383Z [2024-05-25T00:44:01.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:43:00+00:00 exited with status queued for try_number 1 2024-05-25T00:44:01.931990371Z [2024-05-25T00:44:01.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:43:00+00:00 exited with status queued for try_number 1 2024-05-25T00:44:01.932167825Z [2024-05-25T00:44:01.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:43:00+00:00 exited with status queued for try_number 1 2024-05-25T00:44:01.941148629Z [2024-05-25T00:44:01.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86550394-b956-4b95-9b76-3dbad6720f9a 2024-05-25T00:44:01.942104767Z [2024-05-25T00:44:01.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21d4f429-777c-408c-8bb2-55ba67ba6516 2024-05-25T00:44:01.942457499Z [2024-05-25T00:44:01.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcf2095c-b741-4161-bfea-c2c83569e940 2024-05-25T00:44:01.942690030Z [2024-05-25T00:44:01.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8a04b68-331b-4a8f-9783-5d9eb78a7281 2024-05-25T00:44:01.943368593Z [2024-05-25T00:44:01.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to 263838db-cd37-4926-bbfe-97ed2ac4f911 2024-05-25T00:44:03.305239088Z [2024-05-25T00:44:03.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:44:03.305920126Z [2024-05-25T00:44:03.305+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf, execution_date=2024-05-25 00:43:00+00:00, run_id=scheduled__2024-05-25T00:43:00+00:00, run_start_date=2024-05-25 00:44:01.080566+00:00, run_end_date=2024-05-25 00:44:03.305140+00:00, run_duration=2.224574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:43:00+00:00, data_interval_end=2024-05-25 00:44:00+00:00, dag_hash=f5fa3e1db97bf0e0ce9184927fb9ffb7 2024-05-25T00:44:03.316247869Z [2024-05-25T00:44:03.315+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf to 2024-05-25T00:44:00+00:00, run_after=2024-05-25T00:45:00+00:00 2024-05-25T00:44:03.323117404Z [2024-05-25T00:44:03.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:44:03.323545241Z [2024-05-25T00:44:03.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:42:00+00:00, run_id=scheduled__2024-05-25T00:42:00+00:00, run_start_date=2024-05-25 00:44:01.078101+00:00, run_end_date=2024-05-25 00:44:03.323015+00:00, run_duration=2.244914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:42:00+00:00, data_interval_end=2024-05-25 00:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:44:03.331834258Z [2024-05-25T00:44:03.331+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:44:00+00:00, run_after=2024-05-25T00:46:00+00:00 2024-05-25T00:44:03.340705664Z [2024-05-25T00:44:03.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:44:03.341217142Z [2024-05-25T00:44:03.340+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:43:00+00:00, run_id=scheduled__2024-05-25T00:43:00+00:00, run_start_date=2024-05-25 00:44:01.079453+00:00, run_end_date=2024-05-25 00:44:03.340609+00:00, run_duration=2.261156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:43:00+00:00, data_interval_end=2024-05-25 00:44:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:44:03.355028955Z [2024-05-25T00:44:03.354+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:44:00+00:00, run_after=2024-05-25T00:45:00+00:00 2024-05-25T00:44:03.409793804Z [2024-05-25T00:44:03.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:42:00+00:00 exited with status success for try_number 1 2024-05-25T00:44:03.409994570Z [2024-05-25T00:44:03.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:43:00+00:00 exited with status success for try_number 1 2024-05-25T00:44:03.410201915Z [2024-05-25T00:44:03.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:43:00+00:00 exited with status success for try_number 1 2024-05-25T00:44:03.419348600Z [2024-05-25T00:44:03.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:42:00+00:00, map_index=-1, run_start_date=2024-05-25 00:44:02.040601+00:00, run_end_date=2024-05-25 00:44:02.622270+00:00, run_duration=0.581669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:44:01.211171+00:00, queued_by_job_id=1, pid=6954 2024-05-25T00:44:03.419500285Z [2024-05-25T00:44:03.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:43:00+00:00, map_index=-1, run_start_date=2024-05-25 00:44:02.280662+00:00, run_end_date=2024-05-25 00:44:02.867164+00:00, run_duration=0.586502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:44:01.211171+00:00, queued_by_job_id=1, pid=6955 2024-05-25T00:44:03.419706189Z [2024-05-25T00:44:03.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:43:00+00:00, map_index=-1, run_start_date=2024-05-25 00:44:02.685862+00:00, run_end_date=2024-05-25 00:44:03.086061+00:00, run_duration=0.400199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:44:01.211171+00:00, queued_by_job_id=1, pid=6967 2024-05-25T00:44:06.109475674Z [2024-05-25T00:44:06.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:44:06.112328218Z [2024-05-25T00:44:06.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:43:00+00:00, run_id=scheduled__2024-05-25T00:43:00+00:00, run_start_date=2024-05-25 00:44:01.082899+00:00, run_end_date=2024-05-25 00:44:06.109435+00:00, run_duration=5.026536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:43:00+00:00, data_interval_end=2024-05-25 00:44:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:44:06.121444326Z [2024-05-25T00:44:06.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:44:00+00:00, run_after=2024-05-25T00:45:00+00:00 2024-05-25T00:44:06.128169739Z [2024-05-25T00:44:06.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:44:06.128431216Z [2024-05-25T00:44:06.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:43:00+00:00, run_id=scheduled__2024-05-25T00:43:00+00:00, run_start_date=2024-05-25 00:44:01.081719+00:00, run_end_date=2024-05-25 00:44:06.128119+00:00, run_duration=5.0464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:43:00+00:00, data_interval_end=2024-05-25 00:44:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:44:06.137118158Z [2024-05-25T00:44:06.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:44:00+00:00, run_after=2024-05-25T00:45:00+00:00 2024-05-25T00:44:06.166048791Z [2024-05-25T00:44:06.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:43:00+00:00 exited with status success for try_number 1 2024-05-25T00:44:06.166088405Z [2024-05-25T00:44:06.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:43:00+00:00 exited with status success for try_number 1 2024-05-25T00:44:06.171960816Z [2024-05-25T00:44:06.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:43:00+00:00, map_index=-1, run_start_date=2024-05-25 00:44:03.396337+00:00, run_end_date=2024-05-25 00:44:05.197676+00:00, run_duration=1.801339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:44:01.211171+00:00, queued_by_job_id=1, pid=6989 2024-05-25T00:44:06.172213208Z [2024-05-25T00:44:06.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:43:00+00:00, map_index=-1, run_start_date=2024-05-25 00:44:03.567648+00:00, run_end_date=2024-05-25 00:44:05.058865+00:00, run_duration=1.491217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:44:01.211171+00:00, queued_by_job_id=1, pid=6990 2024-05-25T00:45:00.224890484Z [2024-05-25T00:45:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:45:00+00:00, run_after=2024-05-25T00:46:00+00:00 2024-05-25T00:45:00.245259422Z [2024-05-25T00:45:00.244+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf to 2024-05-25T00:45:00+00:00, run_after=2024-05-25T00:46:00+00:00 2024-05-25T00:45:00.273634199Z [2024-05-25T00:45:00.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:45:00+00:00, run_after=2024-05-25T00:50:00+00:00 2024-05-25T00:45:00.284507195Z [2024-05-25T00:45:00.284+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:45:00.303224359Z [2024-05-25T00:45:00.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:45:00+00:00, run_after=2024-05-25T00:46:00+00:00 2024-05-25T00:45:00.432700448Z [2024-05-25T00:45:00.432+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T00:45:00.432829744Z 2024-05-25T00:45:00.432843752Z 2024-05-25T00:45:00.432848766Z 2024-05-25T00:45:00.432898492Z 2024-05-25T00:45:00.432904262Z 2024-05-25T00:45:00.432920401Z [2024-05-25T00:45:00.432+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:45:00.433090694Z [2024-05-25T00:45:00.432+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:45:00.433351187Z [2024-05-25T00:45:00.433+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:45:00.433715215Z [2024-05-25T00:45:00.433+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf has 0/16 running and queued tasks 2024-05-25T00:45:00.434032179Z [2024-05-25T00:45:00.433+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:45:00.436445862Z [2024-05-25T00:45:00.436+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:45:00.436460431Z 2024-05-25T00:45:00.436464766Z 2024-05-25T00:45:00.436468571Z 2024-05-25T00:45:00.436472588Z 2024-05-25T00:45:00.436476366Z 2024-05-25T00:45:00.445091878Z [2024-05-25T00:45:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T00:45:00.445285147Z [2024-05-25T00:45:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:45:00.446250462Z [2024-05-25T00:45:00.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:45:00.446525947Z [2024-05-25T00:45:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:45:00.446826965Z [2024-05-25T00:45:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:45:00.446950124Z [2024-05-25T00:45:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:45:00.447214138Z [2024-05-25T00:45:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:45:00.447340574Z [2024-05-25T00:45:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:45:00.447592580Z [2024-05-25T00:45:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:45:00.447721616Z [2024-05-25T00:45:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:45:01.007271312Z [2024-05-25T00:45:01.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status queued for try_number 1 2024-05-25T00:45:01.007622744Z [2024-05-25T00:45:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:44:00+00:00 exited with status queued for try_number 1 2024-05-25T00:45:01.007837337Z [2024-05-25T00:45:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:44:00+00:00 exited with status queued for try_number 1 2024-05-25T00:45:01.008056804Z [2024-05-25T00:45:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:44:00+00:00 exited with status queued for try_number 1 2024-05-25T00:45:01.008268285Z [2024-05-25T00:45:01.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:44:00+00:00 exited with status queued for try_number 1 2024-05-25T00:45:01.026485338Z [2024-05-25T00:45:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to deae3391-9664-4b5c-acc7-b4c1638b1e79 2024-05-25T00:45:01.026847220Z [2024-05-25T00:45:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 138e226e-227c-422a-a7ce-7d815c654dcb 2024-05-25T00:45:01.027014568Z [2024-05-25T00:45:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bfa65e3-f77b-48e6-afb3-89a5252ea2ff 2024-05-25T00:45:01.027194997Z [2024-05-25T00:45:01.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbf6b023-4a93-41ff-ae2f-069fd09f21b6 2024-05-25T00:45:01.027338467Z [2024-05-25T00:45:01.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7801d862-3c91-4616-81f5-89caf285f659 2024-05-25T00:45:02.447354019Z [2024-05-25T00:45:02.446+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:45:02.448683756Z [2024-05-25T00:45:02.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:44:00+00:00, run_id=scheduled__2024-05-25T00:44:00+00:00, run_start_date=2024-05-25 00:45:00.317980+00:00, run_end_date=2024-05-25 00:45:02.447461+00:00, run_duration=2.129481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:44:00+00:00, data_interval_end=2024-05-25 00:45:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:45:02.463786895Z [2024-05-25T00:45:02.463+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:45:00+00:00, run_after=2024-05-25T00:46:00+00:00 2024-05-25T00:45:02.525693129Z [2024-05-25T00:45:02.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:44:00+00:00 exited with status failed for try_number 1 2024-05-25T00:45:02.526004146Z [2024-05-25T00:45:02.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:44:00+00:00 exited with status success for try_number 1 2024-05-25T00:45:02.532457636Z [2024-05-25T00:45:02.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:44:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:45:00.439103+00:00, queued_by_job_id=1, pid=None 2024-05-25T00:45:02.533139386Z [2024-05-25T00:45:02.532+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T00:45:02.534566568Z [2024-05-25T00:45:02.534+0000] {dagbag.py:207} WARNING - Serialized DAG sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf no longer exists 2024-05-25T00:45:02.544156887Z [2024-05-25T00:45:02.538+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-05-25T00:45:02.544200336Z Traceback (most recent call last): 2024-05-25T00:45:02.544204830Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-05-25T00:45:02.544208000Z task = dag.get_task(ti.task_id) 2024-05-25T00:45:02.544211607Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-05-25T00:45:02.553578756Z [2024-05-25T00:45:02.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:44:00+00:00, map_index=-1, run_start_date=2024-05-25 00:45:01.697608+00:00, run_end_date=2024-05-25 00:45:02.164692+00:00, run_duration=0.467084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:45:00.439103+00:00, queued_by_job_id=1, pid=7035 2024-05-25T00:45:03.644822821Z [2024-05-25T00:45:03.644+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:45:03.644951229Z 2024-05-25T00:45:03.645921261Z [2024-05-25T00:45:03.645+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:45:03.647959830Z [2024-05-25T00:45:03.647+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:45:03.647988806Z 2024-05-25T00:45:03.654598039Z [2024-05-25T00:45:03.653+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T00:45:03.657617933Z [2024-05-25T00:45:03.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:45:03.706205215Z [2024-05-25T00:45:03.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status queued for try_number 1 2024-05-25T00:45:03.706576024Z [2024-05-25T00:45:03.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status success for try_number 1 2024-05-25T00:45:03.712178907Z [2024-05-25T00:45:03.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37ba4d96-ce96-41e2-bbd5-c1e2bcad4a52 2024-05-25T00:45:03.712485660Z [2024-05-25T00:45:03.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T00:40:00+00:00, map_index=-1, run_start_date=2024-05-25 00:45:03.090321+00:00, run_end_date=2024-05-25 00:45:03.477075+00:00, run_duration=0.386754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:45:00.439103+00:00, queued_by_job_id=1, pid=7070 2024-05-25T00:45:04.924476046Z [2024-05-25T00:45:04.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:45:04.924888634Z [2024-05-25T00:45:04.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:44:00+00:00, run_id=scheduled__2024-05-25T00:44:00+00:00, run_start_date=2024-05-25 00:45:00.320220+00:00, run_end_date=2024-05-25 00:45:04.924334+00:00, run_duration=4.604114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:44:00+00:00, data_interval_end=2024-05-25 00:45:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:45:04.936338919Z [2024-05-25T00:45:04.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:45:00+00:00, run_after=2024-05-25T00:46:00+00:00 2024-05-25T00:45:04.947112382Z [2024-05-25T00:45:04.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:45:04.947291724Z [2024-05-25T00:45:04.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:44:00+00:00, run_id=scheduled__2024-05-25T00:44:00+00:00, run_start_date=2024-05-25 00:45:00.321250+00:00, run_end_date=2024-05-25 00:45:04.946866+00:00, run_duration=4.625616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:44:00+00:00, data_interval_end=2024-05-25 00:45:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:45:04.958853276Z [2024-05-25T00:45:04.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:45:00+00:00, run_after=2024-05-25T00:46:00+00:00 2024-05-25T00:45:05.031006016Z [2024-05-25T00:45:05.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:44:00+00:00 exited with status success for try_number 1 2024-05-25T00:45:05.031357094Z [2024-05-25T00:45:05.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:44:00+00:00 exited with status success for try_number 1 2024-05-25T00:45:05.039160293Z [2024-05-25T00:45:05.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:44:00+00:00, map_index=-1, run_start_date=2024-05-25 00:45:02.668423+00:00, run_end_date=2024-05-25 00:45:04.124650+00:00, run_duration=1.456227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:45:00.439103+00:00, queued_by_job_id=1, pid=7054 2024-05-25T00:45:05.039482884Z [2024-05-25T00:45:05.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:44:00+00:00, map_index=-1, run_start_date=2024-05-25 00:45:02.396429+00:00, run_end_date=2024-05-25 00:45:04.025541+00:00, run_duration=1.629112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:45:00.439103+00:00, queued_by_job_id=1, pid=7048 2024-05-25T00:45:06.131497150Z [2024-05-25T00:45:06.131+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:45:06.131528316Z 2024-05-25T00:45:06.131678097Z [2024-05-25T00:45:06.131+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:45:06.132509981Z [2024-05-25T00:45:06.132+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:45:06.132519482Z 2024-05-25T00:45:06.135640764Z [2024-05-25T00:45:06.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T00:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T00:45:06.135826711Z [2024-05-25T00:45:06.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:45:06.189683464Z [2024-05-25T00:45:06.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status queued for try_number 1 2024-05-25T00:45:06.189719906Z [2024-05-25T00:45:06.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status success for try_number 1 2024-05-25T00:45:06.196890903Z [2024-05-25T00:45:06.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f383d42-837f-4775-84dd-6a774a787199 2024-05-25T00:45:06.197102673Z [2024-05-25T00:45:06.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T00:40:00+00:00, map_index=-1, run_start_date=2024-05-25 00:45:05.355490+00:00, run_end_date=2024-05-25 00:45:05.744875+00:00, run_duration=0.389385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:45:03.650070+00:00, queued_by_job_id=1, pid=7083 2024-05-25T00:45:08.438584626Z [2024-05-25T00:45:08.438+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:45:08.438617054Z 2024-05-25T00:45:08.438800534Z [2024-05-25T00:45:08.438+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:45:08.439411092Z [2024-05-25T00:45:08.439+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:45:08.439420127Z 2024-05-25T00:45:08.441688670Z [2024-05-25T00:45:08.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:45:08.441904392Z [2024-05-25T00:45:08.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:45:08.514117067Z [2024-05-25T00:45:08.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status queued for try_number 1 2024-05-25T00:45:08.514229503Z [2024-05-25T00:45:08.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status success for try_number 1 2024-05-25T00:45:08.522756554Z [2024-05-25T00:45:08.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6e6faa7-71af-4734-8d04-8852efdeea9e 2024-05-25T00:45:08.523001689Z [2024-05-25T00:45:08.522+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T00:40:00+00:00, map_index=0, run_start_date=2024-05-25 00:45:07.833010+00:00, run_end_date=2024-05-25 00:45:08.171502+00:00, run_duration=0.338492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:45:06.133021+00:00, queued_by_job_id=1, pid=7101 2024-05-25T00:45:10.792687146Z [2024-05-25T00:45:10.792+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:45:10.793294252Z [2024-05-25T00:45:10.792+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:40:00+00:00, run_id=scheduled__2024-05-25T00:40:00+00:00, run_start_date=2024-05-25 00:45:00.316266+00:00, run_end_date=2024-05-25 00:45:10.792543+00:00, run_duration=10.476277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:40:00+00:00, data_interval_end=2024-05-25 00:45:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T00:45:10.801634592Z [2024-05-25T00:45:10.801+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:45:00+00:00, run_after=2024-05-25T00:50:00+00:00 2024-05-25T00:45:10.831588643Z [2024-05-25T00:45:10.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:40:00+00:00 exited with status success for try_number 1 2024-05-25T00:45:10.837323241Z [2024-05-25T00:45:10.836+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T00:40:00+00:00, map_index=-1, run_start_date=2024-05-25 00:45:10.122871+00:00, run_end_date=2024-05-25 00:45:10.428316+00:00, run_duration=0.305445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:45:08.439826+00:00, queued_by_job_id=1, pid=7112 2024-05-25T00:45:28.598040341Z [2024-05-25T00:45:28.596+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T00:46:00.071284528Z [2024-05-25T00:46:00.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:46:00+00:00, run_after=2024-05-25T00:47:00+00:00 2024-05-25T00:46:00.094969638Z [2024-05-25T00:46:00.094+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:46:00+00:00, run_after=2024-05-25T00:47:00+00:00 2024-05-25T00:46:00.104972104Z [2024-05-25T00:46:00.104+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:46:00.110876579Z [2024-05-25T00:46:00.110+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:46:00.196523469Z [2024-05-25T00:46:00.196+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:46:00.196616477Z 2024-05-25T00:46:00.196665394Z 2024-05-25T00:46:00.196672535Z 2024-05-25T00:46:00.196678388Z 2024-05-25T00:46:00.196733447Z [2024-05-25T00:46:00.196+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:46:00.196859612Z [2024-05-25T00:46:00.196+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:46:00.197174996Z [2024-05-25T00:46:00.196+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:46:00.197406038Z [2024-05-25T00:46:00.197+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:46:00.198172690Z [2024-05-25T00:46:00.197+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:46:00.198185552Z 2024-05-25T00:46:00.198192115Z 2024-05-25T00:46:00.198198235Z 2024-05-25T00:46:00.198203970Z 2024-05-25T00:46:00.203353551Z [2024-05-25T00:46:00.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:46:00.203589669Z [2024-05-25T00:46:00.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:46:00.204004701Z [2024-05-25T00:46:00.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:46:00.204276376Z [2024-05-25T00:46:00.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:46:00.204708511Z [2024-05-25T00:46:00.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:46:00.205010626Z [2024-05-25T00:46:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:46:00.205462289Z [2024-05-25T00:46:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:46:00.205873647Z [2024-05-25T00:46:00.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:46:00.495176284Z [2024-05-25T00:46:00.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:44:00+00:00 exited with status queued for try_number 1 2024-05-25T00:46:00.495544837Z [2024-05-25T00:46:00.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status queued for try_number 1 2024-05-25T00:46:00.495785537Z [2024-05-25T00:46:00.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status queued for try_number 1 2024-05-25T00:46:00.496021549Z [2024-05-25T00:46:00.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status queued for try_number 1 2024-05-25T00:46:00.506546584Z [2024-05-25T00:46:00.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd04ec40-bf9d-4da4-8ce0-8d095d879bfb 2024-05-25T00:46:00.506820471Z [2024-05-25T00:46:00.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a5c8d40-4a49-4f7b-b903-238eea4edb04 2024-05-25T00:46:00.507085641Z [2024-05-25T00:46:00.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc3b4844-b36e-4d6e-b943-3e8728e6de90 2024-05-25T00:46:00.507349404Z [2024-05-25T00:46:00.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26d72a63-5bf7-4e84-8e2e-88fc7e6eeb0d 2024-05-25T00:46:01.939124731Z [2024-05-25T00:46:01.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:46:01.939634281Z [2024-05-25T00:46:01.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:44:00+00:00, run_id=scheduled__2024-05-25T00:44:00+00:00, run_start_date=2024-05-25 00:46:00.125794+00:00, run_end_date=2024-05-25 00:46:01.939270+00:00, run_duration=1.813476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:44:00+00:00, data_interval_end=2024-05-25 00:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:46:01.947569882Z [2024-05-25T00:46:01.947+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:46:00+00:00, run_after=2024-05-25T00:48:00+00:00 2024-05-25T00:46:01.954861779Z [2024-05-25T00:46:01.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:46:01.955357293Z [2024-05-25T00:46:01.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:45:00+00:00, run_id=scheduled__2024-05-25T00:45:00+00:00, run_start_date=2024-05-25 00:46:00.127222+00:00, run_end_date=2024-05-25 00:46:01.955000+00:00, run_duration=1.827778, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:45:00+00:00, data_interval_end=2024-05-25 00:46:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:46:01.967122248Z [2024-05-25T00:46:01.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:46:00+00:00, run_after=2024-05-25T00:47:00+00:00 2024-05-25T00:46:02.024478067Z [2024-05-25T00:46:02.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:44:00+00:00 exited with status success for try_number 1 2024-05-25T00:46:02.024710739Z [2024-05-25T00:46:02.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status success for try_number 1 2024-05-25T00:46:02.032825055Z [2024-05-25T00:46:02.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:45:00+00:00, map_index=-1, run_start_date=2024-05-25 00:46:01.124723+00:00, run_end_date=2024-05-25 00:46:01.571878+00:00, run_duration=0.447155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:46:00.199261+00:00, queued_by_job_id=1, pid=7122 2024-05-25T00:46:02.033132706Z [2024-05-25T00:46:02.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:44:00+00:00, map_index=-1, run_start_date=2024-05-25 00:46:01.160065+00:00, run_end_date=2024-05-25 00:46:01.580260+00:00, run_duration=0.420195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:46:00.199261+00:00, queued_by_job_id=1, pid=7123 2024-05-25T00:46:04.203717372Z [2024-05-25T00:46:04.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:46:04.204255701Z [2024-05-25T00:46:04.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:45:00+00:00, run_id=scheduled__2024-05-25T00:45:00+00:00, run_start_date=2024-05-25 00:46:00.129042+00:00, run_end_date=2024-05-25 00:46:04.203786+00:00, run_duration=4.074744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:45:00+00:00, data_interval_end=2024-05-25 00:46:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:46:04.216113401Z [2024-05-25T00:46:04.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:46:00+00:00, run_after=2024-05-25T00:47:00+00:00 2024-05-25T00:46:04.224885948Z [2024-05-25T00:46:04.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:46:04.225118634Z [2024-05-25T00:46:04.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:45:00+00:00, run_id=scheduled__2024-05-25T00:45:00+00:00, run_start_date=2024-05-25 00:46:00.130263+00:00, run_end_date=2024-05-25 00:46:04.224852+00:00, run_duration=4.094589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:45:00+00:00, data_interval_end=2024-05-25 00:46:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:46:04.234075483Z [2024-05-25T00:46:04.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:46:00+00:00, run_after=2024-05-25T00:47:00+00:00 2024-05-25T00:46:04.267183471Z [2024-05-25T00:46:04.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status success for try_number 1 2024-05-25T00:46:04.267313585Z [2024-05-25T00:46:04.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status success for try_number 1 2024-05-25T00:46:04.273162092Z [2024-05-25T00:46:04.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:45:00+00:00, map_index=-1, run_start_date=2024-05-25 00:46:02.198877+00:00, run_end_date=2024-05-25 00:46:03.592215+00:00, run_duration=1.393338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:46:00.199261+00:00, queued_by_job_id=1, pid=7147 2024-05-25T00:46:04.273415981Z [2024-05-25T00:46:04.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:45:00+00:00, map_index=-1, run_start_date=2024-05-25 00:46:02.167552+00:00, run_end_date=2024-05-25 00:46:03.861065+00:00, run_duration=1.693513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:46:00.199261+00:00, queued_by_job_id=1, pid=7146 2024-05-25T00:47:00.040156244Z [2024-05-25T00:47:00.039+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:47:00.056200721Z [2024-05-25T00:47:00.055+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:47:00+00:00, run_after=2024-05-25T00:48:00+00:00 2024-05-25T00:47:00.069320755Z [2024-05-25T00:47:00.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:47:00+00:00, run_after=2024-05-25T00:48:00+00:00 2024-05-25T00:47:00.146791816Z [2024-05-25T00:47:00.146+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:47:00.146835593Z 2024-05-25T00:47:00.146839299Z 2024-05-25T00:47:00.146842489Z 2024-05-25T00:47:00.147002041Z [2024-05-25T00:47:00.146+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:47:00.147461951Z [2024-05-25T00:47:00.147+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:47:00.147763719Z [2024-05-25T00:47:00.147+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:47:00.149966092Z [2024-05-25T00:47:00.148+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:47:00.149982770Z 2024-05-25T00:47:00.149987862Z 2024-05-25T00:47:00.149992127Z 2024-05-25T00:47:00.155449969Z [2024-05-25T00:47:00.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:47:00.155652962Z [2024-05-25T00:47:00.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:47:00.156073624Z [2024-05-25T00:47:00.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:47:00.156281373Z [2024-05-25T00:47:00.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:47:00.156632358Z [2024-05-25T00:47:00.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:47:00.156828117Z [2024-05-25T00:47:00.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:47:00.367634575Z [2024-05-25T00:47:00.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:46:00+00:00 exited with status queued for try_number 1 2024-05-25T00:47:00.368356970Z [2024-05-25T00:47:00.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:46:00+00:00 exited with status queued for try_number 1 2024-05-25T00:47:00.368552180Z [2024-05-25T00:47:00.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:46:00+00:00 exited with status queued for try_number 1 2024-05-25T00:47:00.376377765Z [2024-05-25T00:47:00.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to e024f5ab-9f7c-4fab-9a3e-5f1ce108c31c 2024-05-25T00:47:00.376656701Z [2024-05-25T00:47:00.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to af8b1d37-a03a-40c8-b1e2-88a10e2937c4 2024-05-25T00:47:00.376899003Z [2024-05-25T00:47:00.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93814e2e-04da-4cf7-bff2-a4670082326b 2024-05-25T00:47:01.555932689Z [2024-05-25T00:47:01.555+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:47:01.556735142Z [2024-05-25T00:47:01.556+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:46:00+00:00, run_id=scheduled__2024-05-25T00:46:00+00:00, run_start_date=2024-05-25 00:47:00.079670+00:00, run_end_date=2024-05-25 00:47:01.556341+00:00, run_duration=1.476671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:46:00+00:00, data_interval_end=2024-05-25 00:47:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:47:01.586571519Z [2024-05-25T00:47:01.586+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:47:00+00:00, run_after=2024-05-25T00:48:00+00:00 2024-05-25T00:47:01.922492218Z [2024-05-25T00:47:01.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:46:00+00:00 exited with status success for try_number 1 2024-05-25T00:47:01.928584492Z [2024-05-25T00:47:01.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:46:00+00:00, map_index=-1, run_start_date=2024-05-25 00:47:00.987455+00:00, run_end_date=2024-05-25 00:47:01.532524+00:00, run_duration=0.545069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:47:00.151983+00:00, queued_by_job_id=1, pid=7178 2024-05-25T00:47:04.103546127Z [2024-05-25T00:47:04.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:47:04.103876131Z [2024-05-25T00:47:04.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:46:00+00:00, run_id=scheduled__2024-05-25T00:46:00+00:00, run_start_date=2024-05-25 00:47:00.081069+00:00, run_end_date=2024-05-25 00:47:04.103527+00:00, run_duration=4.022458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:46:00+00:00, data_interval_end=2024-05-25 00:47:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:47:04.114127786Z [2024-05-25T00:47:04.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:47:00+00:00, run_after=2024-05-25T00:48:00+00:00 2024-05-25T00:47:04.129028243Z [2024-05-25T00:47:04.128+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:47:04.129819952Z [2024-05-25T00:47:04.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:46:00+00:00, run_id=scheduled__2024-05-25T00:46:00+00:00, run_start_date=2024-05-25 00:47:00.082283+00:00, run_end_date=2024-05-25 00:47:04.128904+00:00, run_duration=4.046621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:46:00+00:00, data_interval_end=2024-05-25 00:47:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:47:04.150250086Z [2024-05-25T00:47:04.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:47:00+00:00, run_after=2024-05-25T00:48:00+00:00 2024-05-25T00:47:04.204251283Z [2024-05-25T00:47:04.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:46:00+00:00 exited with status success for try_number 1 2024-05-25T00:47:04.205107385Z [2024-05-25T00:47:04.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:46:00+00:00 exited with status success for try_number 1 2024-05-25T00:47:04.217889032Z [2024-05-25T00:47:04.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:46:00+00:00, map_index=-1, run_start_date=2024-05-25 00:47:02.149697+00:00, run_end_date=2024-05-25 00:47:03.634051+00:00, run_duration=1.484354, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:47:00.151983+00:00, queued_by_job_id=1, pid=7197 2024-05-25T00:47:04.218487453Z [2024-05-25T00:47:04.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:46:00+00:00, map_index=-1, run_start_date=2024-05-25 00:47:02.118463+00:00, run_end_date=2024-05-25 00:47:03.960720+00:00, run_duration=1.842257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:47:00.151983+00:00, queued_by_job_id=1, pid=7196 2024-05-25T00:48:00.061559441Z [2024-05-25T00:48:00.060+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:48:00+00:00, run_after=2024-05-25T00:49:00+00:00 2024-05-25T00:48:00.069788848Z [2024-05-25T00:48:00.069+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:48:00.075127490Z [2024-05-25T00:48:00.074+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:48:00.085809253Z [2024-05-25T00:48:00.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:48:00+00:00, run_after=2024-05-25T00:49:00+00:00 2024-05-25T00:48:00.169691999Z [2024-05-25T00:48:00.168+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:48:00.169829863Z 2024-05-25T00:48:00.169844344Z 2024-05-25T00:48:00.169853250Z 2024-05-25T00:48:00.169861822Z 2024-05-25T00:48:00.169871136Z [2024-05-25T00:48:00.169+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:48:00.169930593Z [2024-05-25T00:48:00.169+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:48:00.170026257Z [2024-05-25T00:48:00.169+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:48:00.170330983Z [2024-05-25T00:48:00.170+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:48:00.171457687Z [2024-05-25T00:48:00.170+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:48:00.171488644Z 2024-05-25T00:48:00.171501506Z 2024-05-25T00:48:00.171513434Z 2024-05-25T00:48:00.171526041Z 2024-05-25T00:48:00.177525447Z [2024-05-25T00:48:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:48:00.177643146Z [2024-05-25T00:48:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:48:00.178310878Z [2024-05-25T00:48:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:48:00.178389363Z [2024-05-25T00:48:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:48:00.178909061Z [2024-05-25T00:48:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:48:00.179034654Z [2024-05-25T00:48:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:48:00.179524192Z [2024-05-25T00:48:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:48:00.179576540Z [2024-05-25T00:48:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:48:00.707892594Z [2024-05-25T00:48:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:46:00+00:00 exited with status queued for try_number 1 2024-05-25T00:48:00.707909022Z [2024-05-25T00:48:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:47:00+00:00 exited with status queued for try_number 1 2024-05-25T00:48:00.707928758Z [2024-05-25T00:48:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:47:00+00:00 exited with status queued for try_number 1 2024-05-25T00:48:00.709736197Z [2024-05-25T00:48:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:47:00+00:00 exited with status queued for try_number 1 2024-05-25T00:48:00.720163304Z [2024-05-25T00:48:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 410a8645-55ae-45d5-b17a-d62a757acb01 2024-05-25T00:48:00.720262958Z [2024-05-25T00:48:00.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac079619-7f78-4320-bb77-c65939ed79eb 2024-05-25T00:48:00.720353584Z [2024-05-25T00:48:00.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bbd7c87-b528-4784-b729-3d4ab47cd01d 2024-05-25T00:48:00.720449822Z [2024-05-25T00:48:00.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcad045b-52f4-44a0-8d5d-0700dc60e12a 2024-05-25T00:48:01.860665867Z [2024-05-25T00:48:01.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:48:01.861030331Z [2024-05-25T00:48:01.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:46:00+00:00, run_id=scheduled__2024-05-25T00:46:00+00:00, run_start_date=2024-05-25 00:48:00.094117+00:00, run_end_date=2024-05-25 00:48:01.860598+00:00, run_duration=1.766481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:46:00+00:00, data_interval_end=2024-05-25 00:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:48:01.870935810Z [2024-05-25T00:48:01.870+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:48:00+00:00, run_after=2024-05-25T00:50:00+00:00 2024-05-25T00:48:01.878129652Z [2024-05-25T00:48:01.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:48:01.878283728Z [2024-05-25T00:48:01.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:47:00+00:00, run_id=scheduled__2024-05-25T00:47:00+00:00, run_start_date=2024-05-25 00:48:00.095170+00:00, run_end_date=2024-05-25 00:48:01.878049+00:00, run_duration=1.782879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:47:00+00:00, data_interval_end=2024-05-25 00:48:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:48:01.888902258Z [2024-05-25T00:48:01.888+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:48:00+00:00, run_after=2024-05-25T00:49:00+00:00 2024-05-25T00:48:01.975429405Z [2024-05-25T00:48:01.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:46:00+00:00 exited with status success for try_number 1 2024-05-25T00:48:01.975508151Z [2024-05-25T00:48:01.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:47:00+00:00 exited with status success for try_number 1 2024-05-25T00:48:01.985026344Z [2024-05-25T00:48:01.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:47:00+00:00, map_index=-1, run_start_date=2024-05-25 00:48:00.906079+00:00, run_end_date=2024-05-25 00:48:01.291698+00:00, run_duration=0.385619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:48:00.172956+00:00, queued_by_job_id=1, pid=7230 2024-05-25T00:48:01.985563090Z [2024-05-25T00:48:01.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:46:00+00:00, map_index=-1, run_start_date=2024-05-25 00:48:00.896436+00:00, run_end_date=2024-05-25 00:48:01.200741+00:00, run_duration=0.304305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:48:00.172956+00:00, queued_by_job_id=1, pid=7231 2024-05-25T00:48:03.525734874Z [2024-05-25T00:48:03.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:48:03.526179873Z [2024-05-25T00:48:03.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:47:00+00:00, run_id=scheduled__2024-05-25T00:47:00+00:00, run_start_date=2024-05-25 00:48:00.096181+00:00, run_end_date=2024-05-25 00:48:03.525849+00:00, run_duration=3.429668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:47:00+00:00, data_interval_end=2024-05-25 00:48:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:48:03.535070256Z [2024-05-25T00:48:03.534+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:48:00+00:00, run_after=2024-05-25T00:49:00+00:00 2024-05-25T00:48:04.087761808Z [2024-05-25T00:48:04.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:48:04.087996425Z [2024-05-25T00:48:04.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:47:00+00:00, run_id=scheduled__2024-05-25T00:47:00+00:00, run_start_date=2024-05-25 00:48:00.097358+00:00, run_end_date=2024-05-25 00:48:04.087610+00:00, run_duration=3.990252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:47:00+00:00, data_interval_end=2024-05-25 00:48:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:48:04.097036206Z [2024-05-25T00:48:04.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:48:00+00:00, run_after=2024-05-25T00:49:00+00:00 2024-05-25T00:48:04.138861265Z [2024-05-25T00:48:04.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:47:00+00:00 exited with status success for try_number 1 2024-05-25T00:48:04.138911578Z [2024-05-25T00:48:04.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:47:00+00:00 exited with status success for try_number 1 2024-05-25T00:48:04.151228854Z [2024-05-25T00:48:04.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:47:00+00:00, map_index=-1, run_start_date=2024-05-25 00:48:02.140495+00:00, run_end_date=2024-05-25 00:48:03.462380+00:00, run_duration=1.321885, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:48:00.172956+00:00, queued_by_job_id=1, pid=7255 2024-05-25T00:48:04.151450200Z [2024-05-25T00:48:04.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:47:00+00:00, map_index=-1, run_start_date=2024-05-25 00:48:02.114526+00:00, run_end_date=2024-05-25 00:48:03.824175+00:00, run_duration=1.709649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:48:00.172956+00:00, queued_by_job_id=1, pid=7254 2024-05-25T00:49:01.080232414Z [2024-05-25T00:49:01.079+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:49:01.098036652Z [2024-05-25T00:49:01.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:49:00+00:00, run_after=2024-05-25T00:50:00+00:00 2024-05-25T00:49:01.112387835Z [2024-05-25T00:49:01.111+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:49:00+00:00, run_after=2024-05-25T00:50:00+00:00 2024-05-25T00:49:01.178742551Z [2024-05-25T00:49:01.178+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:49:01.178790299Z 2024-05-25T00:49:01.178801281Z 2024-05-25T00:49:01.178811000Z 2024-05-25T00:49:01.179232273Z [2024-05-25T00:49:01.178+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:49:01.179664227Z [2024-05-25T00:49:01.179+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:49:01.179872680Z [2024-05-25T00:49:01.179+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:49:01.181260219Z [2024-05-25T00:49:01.180+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:49:01.181286586Z 2024-05-25T00:49:01.181294228Z 2024-05-25T00:49:01.181300932Z 2024-05-25T00:49:01.187701767Z [2024-05-25T00:49:01.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:49:01.188099403Z [2024-05-25T00:49:01.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:49:01.188757257Z [2024-05-25T00:49:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:49:01.189110448Z [2024-05-25T00:49:01.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:49:01.189411335Z [2024-05-25T00:49:01.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:49:01.189554318Z [2024-05-25T00:49:01.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:49:01.476520269Z [2024-05-25T00:49:01.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:48:00+00:00 exited with status queued for try_number 1 2024-05-25T00:49:01.476601655Z [2024-05-25T00:49:01.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:48:00+00:00 exited with status queued for try_number 1 2024-05-25T00:49:01.476716997Z [2024-05-25T00:49:01.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:48:00+00:00 exited with status queued for try_number 1 2024-05-25T00:49:01.487950794Z [2024-05-25T00:49:01.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac18633d-39a6-4287-b244-57ae3fda6b6a 2024-05-25T00:49:01.488170314Z [2024-05-25T00:49:01.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10773648-1f00-4fd7-9a56-474c24b2cba9 2024-05-25T00:49:01.488448428Z [2024-05-25T00:49:01.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to a90476ea-6545-4224-8395-70fb9f093f9c 2024-05-25T00:49:02.861310305Z [2024-05-25T00:49:02.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:49:02.861860482Z [2024-05-25T00:49:02.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:48:00+00:00, run_id=scheduled__2024-05-25T00:48:00+00:00, run_start_date=2024-05-25 00:49:01.123743+00:00, run_end_date=2024-05-25 00:49:02.861445+00:00, run_duration=1.737702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:48:00+00:00, data_interval_end=2024-05-25 00:49:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:49:02.870528354Z [2024-05-25T00:49:02.870+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:49:00+00:00, run_after=2024-05-25T00:50:00+00:00 2024-05-25T00:49:02.915532965Z [2024-05-25T00:49:02.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:48:00+00:00 exited with status success for try_number 1 2024-05-25T00:49:02.920468901Z [2024-05-25T00:49:02.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:48:00+00:00, map_index=-1, run_start_date=2024-05-25 00:49:02.135042+00:00, run_end_date=2024-05-25 00:49:02.714113+00:00, run_duration=0.579071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:49:01.182936+00:00, queued_by_job_id=1, pid=7287 2024-05-25T00:49:06.244040183Z [2024-05-25T00:49:06.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:49:06.244414808Z [2024-05-25T00:49:06.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:48:00+00:00, run_id=scheduled__2024-05-25T00:48:00+00:00, run_start_date=2024-05-25 00:49:01.124901+00:00, run_end_date=2024-05-25 00:49:06.243948+00:00, run_duration=5.119047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:48:00+00:00, data_interval_end=2024-05-25 00:49:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:49:06.257703757Z [2024-05-25T00:49:06.257+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:49:00+00:00, run_after=2024-05-25T00:50:00+00:00 2024-05-25T00:49:06.264345160Z [2024-05-25T00:49:06.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:49:06.264495219Z [2024-05-25T00:49:06.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:48:00+00:00, run_id=scheduled__2024-05-25T00:48:00+00:00, run_start_date=2024-05-25 00:49:01.126087+00:00, run_end_date=2024-05-25 00:49:06.264246+00:00, run_duration=5.138159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:48:00+00:00, data_interval_end=2024-05-25 00:49:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:49:06.273759235Z [2024-05-25T00:49:06.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:49:00+00:00, run_after=2024-05-25T00:50:00+00:00 2024-05-25T00:49:06.310645333Z [2024-05-25T00:49:06.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:48:00+00:00 exited with status success for try_number 1 2024-05-25T00:49:06.310771610Z [2024-05-25T00:49:06.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:48:00+00:00 exited with status success for try_number 1 2024-05-25T00:49:06.319954354Z [2024-05-25T00:49:06.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:48:00+00:00, map_index=-1, run_start_date=2024-05-25 00:49:03.227196+00:00, run_end_date=2024-05-25 00:49:05.723599+00:00, run_duration=2.496403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:49:01.182936+00:00, queued_by_job_id=1, pid=7305 2024-05-25T00:49:06.320412361Z [2024-05-25T00:49:06.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:48:00+00:00, map_index=-1, run_start_date=2024-05-25 00:49:03.277432+00:00, run_end_date=2024-05-25 00:49:05.369112+00:00, run_duration=2.09168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:49:01.182936+00:00, queued_by_job_id=1, pid=7306 2024-05-25T00:50:00.195956872Z [2024-05-25T00:50:00.195+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:50:00+00:00, run_after=2024-05-25T00:51:00+00:00 2024-05-25T00:50:00.204281766Z [2024-05-25T00:50:00.203+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:50:00.217847994Z [2024-05-25T00:50:00.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:50:00+00:00, run_after=2024-05-25T00:51:00+00:00 2024-05-25T00:50:00.238678983Z [2024-05-25T00:50:00.238+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:50:00.251564323Z [2024-05-25T00:50:00.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:50:00+00:00, run_after=2024-05-25T00:55:00+00:00 2024-05-25T00:50:00.368166184Z [2024-05-25T00:50:00.367+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T00:50:00.368200909Z 2024-05-25T00:50:00.368208512Z 2024-05-25T00:50:00.368222279Z 2024-05-25T00:50:00.368228178Z 2024-05-25T00:50:00.368233875Z 2024-05-25T00:50:00.368462138Z [2024-05-25T00:50:00.368+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:50:00.368713227Z [2024-05-25T00:50:00.368+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:50:00.368948074Z [2024-05-25T00:50:00.368+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:50:00.369171199Z [2024-05-25T00:50:00.368+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:50:00.369458880Z [2024-05-25T00:50:00.369+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:50:00.370317338Z [2024-05-25T00:50:00.370+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:50:00.370332819Z 2024-05-25T00:50:00.370339220Z 2024-05-25T00:50:00.370345285Z 2024-05-25T00:50:00.370350820Z 2024-05-25T00:50:00.370356462Z 2024-05-25T00:50:00.375408015Z [2024-05-25T00:50:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T00:50:00.375779668Z [2024-05-25T00:50:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:50:00.376207465Z [2024-05-25T00:50:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:50:00.376463739Z [2024-05-25T00:50:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:50:00.376809650Z [2024-05-25T00:50:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:50:00.377034306Z [2024-05-25T00:50:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:50:00.377404690Z [2024-05-25T00:50:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:50:00.377689540Z [2024-05-25T00:50:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:50:00.378068730Z [2024-05-25T00:50:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:50:00.378325416Z [2024-05-25T00:50:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:50:00.969748926Z [2024-05-25T00:50:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status queued for try_number 1 2024-05-25T00:50:00.969805846Z [2024-05-25T00:50:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:48:00+00:00 exited with status queued for try_number 1 2024-05-25T00:50:00.969873233Z [2024-05-25T00:50:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:49:00+00:00 exited with status queued for try_number 1 2024-05-25T00:50:00.969950692Z [2024-05-25T00:50:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:49:00+00:00 exited with status queued for try_number 1 2024-05-25T00:50:00.969999976Z [2024-05-25T00:50:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:49:00+00:00 exited with status queued for try_number 1 2024-05-25T00:50:00.988115073Z [2024-05-25T00:50:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to 287b5577-df39-466b-bf08-7ac5acd1952d 2024-05-25T00:50:00.988150651Z [2024-05-25T00:50:00.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c5db3f0-ff79-472b-9c6b-c60656995fbe 2024-05-25T00:50:00.988436022Z [2024-05-25T00:50:00.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc6452ef-ff2c-4707-975a-b873cb378c97 2024-05-25T00:50:00.988549990Z [2024-05-25T00:50:00.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to 303591f9-2b86-4ad4-8161-d9a11d4c2071 2024-05-25T00:50:00.988670253Z [2024-05-25T00:50:00.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0efa30fc-c64b-489d-bd8d-0138650106a2 2024-05-25T00:50:02.404877073Z [2024-05-25T00:50:02.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:50:02.405421144Z [2024-05-25T00:50:02.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:48:00+00:00, run_id=scheduled__2024-05-25T00:48:00+00:00, run_start_date=2024-05-25 00:50:00.266865+00:00, run_end_date=2024-05-25 00:50:02.404944+00:00, run_duration=2.138079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:48:00+00:00, data_interval_end=2024-05-25 00:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:50:02.425868440Z [2024-05-25T00:50:02.425+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:50:00+00:00, run_after=2024-05-25T00:52:00+00:00 2024-05-25T00:50:02.446658480Z [2024-05-25T00:50:02.446+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:50:02.447066257Z [2024-05-25T00:50:02.446+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:49:00+00:00, run_id=scheduled__2024-05-25T00:49:00+00:00, run_start_date=2024-05-25 00:50:00.268153+00:00, run_end_date=2024-05-25 00:50:02.446708+00:00, run_duration=2.178555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:49:00+00:00, data_interval_end=2024-05-25 00:50:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:50:02.459410620Z [2024-05-25T00:50:02.459+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:50:00+00:00, run_after=2024-05-25T00:51:00+00:00 2024-05-25T00:50:02.507424769Z [2024-05-25T00:50:02.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:48:00+00:00 exited with status success for try_number 1 2024-05-25T00:50:02.514786247Z [2024-05-25T00:50:02.514+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:48:00+00:00, map_index=-1, run_start_date=2024-05-25 00:50:01.474200+00:00, run_end_date=2024-05-25 00:50:01.843918+00:00, run_duration=0.369718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:50:00.371665+00:00, queued_by_job_id=1, pid=7335 2024-05-25T00:50:02.826130984Z [2024-05-25T00:50:02.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:49:00+00:00 exited with status success for try_number 1 2024-05-25T00:50:02.830864078Z [2024-05-25T00:50:02.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:49:00+00:00, map_index=-1, run_start_date=2024-05-25 00:50:01.831429+00:00, run_end_date=2024-05-25 00:50:02.341117+00:00, run_duration=0.509688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:50:00.371665+00:00, queued_by_job_id=1, pid=7348 2024-05-25T00:50:03.410754171Z [2024-05-25T00:50:03.410+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:50:03.410794373Z 2024-05-25T00:50:03.410837046Z [2024-05-25T00:50:03.410+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:50:03.411495194Z [2024-05-25T00:50:03.411+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:50:03.411558016Z 2024-05-25T00:50:03.414092076Z [2024-05-25T00:50:03.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T00:50:03.414179009Z [2024-05-25T00:50:03.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:50:03.474098490Z [2024-05-25T00:50:03.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status queued for try_number 1 2024-05-25T00:50:03.474325694Z [2024-05-25T00:50:03.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status success for try_number 1 2024-05-25T00:50:03.480778572Z [2024-05-25T00:50:03.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70216b3f-440c-4814-b4eb-253f41fbafa1 2024-05-25T00:50:03.481128231Z [2024-05-25T00:50:03.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T00:45:00+00:00, map_index=-1, run_start_date=2024-05-25 00:50:02.750263+00:00, run_end_date=2024-05-25 00:50:03.161979+00:00, run_duration=0.411716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:50:00.371665+00:00, queued_by_job_id=1, pid=7365 2024-05-25T00:50:04.656411120Z [2024-05-25T00:50:04.655+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:50:04.656613227Z [2024-05-25T00:50:04.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:49:00+00:00, run_id=scheduled__2024-05-25T00:49:00+00:00, run_start_date=2024-05-25 00:50:00.269301+00:00, run_end_date=2024-05-25 00:50:04.656284+00:00, run_duration=4.386983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:49:00+00:00, data_interval_end=2024-05-25 00:50:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:50:04.668506577Z [2024-05-25T00:50:04.668+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:50:00+00:00, run_after=2024-05-25T00:51:00+00:00 2024-05-25T00:50:04.758871635Z [2024-05-25T00:50:04.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:49:00+00:00 exited with status success for try_number 1 2024-05-25T00:50:04.767577709Z [2024-05-25T00:50:04.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:49:00+00:00, map_index=-1, run_start_date=2024-05-25 00:50:02.790535+00:00, run_end_date=2024-05-25 00:50:04.109567+00:00, run_duration=1.319032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:50:00.371665+00:00, queued_by_job_id=1, pid=7366 2024-05-25T00:50:05.827339028Z [2024-05-25T00:50:05.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:50:05.827805166Z [2024-05-25T00:50:05.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:49:00+00:00, run_id=scheduled__2024-05-25T00:49:00+00:00, run_start_date=2024-05-25 00:50:00.270348+00:00, run_end_date=2024-05-25 00:50:05.827254+00:00, run_duration=5.556906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:49:00+00:00, data_interval_end=2024-05-25 00:50:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:50:05.844440202Z [2024-05-25T00:50:05.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:50:00+00:00, run_after=2024-05-25T00:51:00+00:00 2024-05-25T00:50:05.892498324Z [2024-05-25T00:50:05.891+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:50:05.892535088Z 2024-05-25T00:50:05.892542997Z [2024-05-25T00:50:05.892+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:50:05.893561360Z [2024-05-25T00:50:05.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:50:05.893585151Z 2024-05-25T00:50:05.896720812Z [2024-05-25T00:50:05.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T00:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T00:50:05.896907644Z [2024-05-25T00:50:05.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:50:05.953290332Z [2024-05-25T00:50:05.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status queued for try_number 1 2024-05-25T00:50:05.953535309Z [2024-05-25T00:50:05.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:49:00+00:00 exited with status success for try_number 1 2024-05-25T00:50:05.953726608Z [2024-05-25T00:50:05.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status success for try_number 1 2024-05-25T00:50:05.960213859Z [2024-05-25T00:50:05.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:49:00+00:00, map_index=-1, run_start_date=2024-05-25 00:50:03.264744+00:00, run_end_date=2024-05-25 00:50:05.057429+00:00, run_duration=1.792685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:50:00.371665+00:00, queued_by_job_id=1, pid=7382 2024-05-25T00:50:05.960422496Z [2024-05-25T00:50:05.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T00:45:00+00:00, map_index=-1, run_start_date=2024-05-25 00:50:05.111173+00:00, run_end_date=2024-05-25 00:50:05.520734+00:00, run_duration=0.409561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:50:03.411821+00:00, queued_by_job_id=1, pid=7395 2024-05-25T00:50:05.960617242Z [2024-05-25T00:50:05.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1344e3fe-3a00-47aa-af04-1f4a01a1bf82 2024-05-25T00:50:08.261614927Z [2024-05-25T00:50:08.261+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:50:08.261642483Z 2024-05-25T00:50:08.261654650Z [2024-05-25T00:50:08.261+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:50:08.262341313Z [2024-05-25T00:50:08.262+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:50:08.262361339Z 2024-05-25T00:50:08.264553284Z [2024-05-25T00:50:08.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:50:08.264610198Z [2024-05-25T00:50:08.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:50:08.317353958Z [2024-05-25T00:50:08.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status queued for try_number 1 2024-05-25T00:50:08.319344714Z [2024-05-25T00:50:08.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status success for try_number 1 2024-05-25T00:50:08.341940157Z [2024-05-25T00:50:08.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a59a9fa-2130-435a-a605-81ba7b92f8cb 2024-05-25T00:50:08.342150419Z [2024-05-25T00:50:08.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T00:45:00+00:00, map_index=0, run_start_date=2024-05-25 00:50:07.598636+00:00, run_end_date=2024-05-25 00:50:07.962253+00:00, run_duration=0.363617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:50:05.894138+00:00, queued_by_job_id=1, pid=7413 2024-05-25T00:50:10.563480487Z [2024-05-25T00:50:10.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:50:10.563922896Z [2024-05-25T00:50:10.563+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:45:00+00:00, run_id=scheduled__2024-05-25T00:45:00+00:00, run_start_date=2024-05-25 00:50:00.265453+00:00, run_end_date=2024-05-25 00:50:10.563377+00:00, run_duration=10.297924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:45:00+00:00, data_interval_end=2024-05-25 00:50:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T00:50:10.570509896Z [2024-05-25T00:50:10.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:50:00+00:00, run_after=2024-05-25T00:55:00+00:00 2024-05-25T00:50:10.607560082Z [2024-05-25T00:50:10.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:45:00+00:00 exited with status success for try_number 1 2024-05-25T00:50:10.612834003Z [2024-05-25T00:50:10.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T00:45:00+00:00, map_index=-1, run_start_date=2024-05-25 00:50:09.961037+00:00, run_end_date=2024-05-25 00:50:10.352731+00:00, run_duration=0.391694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:50:08.262694+00:00, queued_by_job_id=1, pid=7424 2024-05-25T00:50:28.658663791Z [2024-05-25T00:50:28.658+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T00:51:00.138786598Z [2024-05-25T00:51:00.138+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:51:00.161006522Z [2024-05-25T00:51:00.160+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:51:00+00:00, run_after=2024-05-25T00:52:00+00:00 2024-05-25T00:51:00.175678161Z [2024-05-25T00:51:00.175+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:51:00+00:00, run_after=2024-05-25T00:52:00+00:00 2024-05-25T00:51:00.245962883Z [2024-05-25T00:51:00.245+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:51:00.245992985Z 2024-05-25T00:51:00.245999878Z 2024-05-25T00:51:00.246034396Z 2024-05-25T00:51:00.246150152Z [2024-05-25T00:51:00.245+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:51:00.246189724Z [2024-05-25T00:51:00.245+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:51:00.246260726Z [2024-05-25T00:51:00.246+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:51:00.246997426Z [2024-05-25T00:51:00.246+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:51:00.247017838Z 2024-05-25T00:51:00.247021951Z 2024-05-25T00:51:00.247025301Z 2024-05-25T00:51:00.251469375Z [2024-05-25T00:51:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:51:00.251728751Z [2024-05-25T00:51:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:51:00.252165352Z [2024-05-25T00:51:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:51:00.252309720Z [2024-05-25T00:51:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:51:00.252595626Z [2024-05-25T00:51:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:51:00.252725172Z [2024-05-25T00:51:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:51:00.595496368Z [2024-05-25T00:51:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status queued for try_number 1 2024-05-25T00:51:00.595657220Z [2024-05-25T00:51:00.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status queued for try_number 1 2024-05-25T00:51:00.595806154Z [2024-05-25T00:51:00.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status queued for try_number 1 2024-05-25T00:51:00.606549524Z [2024-05-25T00:51:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddb5cd15-63fc-4c4e-8c75-858752e18a6b 2024-05-25T00:51:00.606762168Z [2024-05-25T00:51:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69434984-24fb-4522-9280-059e3fc3d0b4 2024-05-25T00:51:00.606973372Z [2024-05-25T00:51:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7d82d5b-ebd1-41c5-b696-fb5cf974dce7 2024-05-25T00:51:01.803276568Z [2024-05-25T00:51:01.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:51:01.803819219Z [2024-05-25T00:51:01.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:50:00+00:00, run_id=scheduled__2024-05-25T00:50:00+00:00, run_start_date=2024-05-25 00:51:00.186399+00:00, run_end_date=2024-05-25 00:51:01.803139+00:00, run_duration=1.61674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:50:00+00:00, data_interval_end=2024-05-25 00:51:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:51:01.814364724Z [2024-05-25T00:51:01.814+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:51:00+00:00, run_after=2024-05-25T00:52:00+00:00 2024-05-25T00:51:01.862150363Z [2024-05-25T00:51:01.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status success for try_number 1 2024-05-25T00:51:01.875216208Z [2024-05-25T00:51:01.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:50:00+00:00, map_index=-1, run_start_date=2024-05-25 00:51:01.216919+00:00, run_end_date=2024-05-25 00:51:01.653567+00:00, run_duration=0.436648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:51:00.247856+00:00, queued_by_job_id=1, pid=7433 2024-05-25T00:51:03.921627627Z [2024-05-25T00:51:03.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:51:03.925053530Z [2024-05-25T00:51:03.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:50:00+00:00, run_id=scheduled__2024-05-25T00:50:00+00:00, run_start_date=2024-05-25 00:51:00.187519+00:00, run_end_date=2024-05-25 00:51:03.921500+00:00, run_duration=3.733981, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:50:00+00:00, data_interval_end=2024-05-25 00:51:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:51:03.935480612Z [2024-05-25T00:51:03.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:51:00+00:00, run_after=2024-05-25T00:52:00+00:00 2024-05-25T00:51:03.980990774Z [2024-05-25T00:51:03.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status success for try_number 1 2024-05-25T00:51:03.987329796Z [2024-05-25T00:51:03.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:50:00+00:00, map_index=-1, run_start_date=2024-05-25 00:51:02.032799+00:00, run_end_date=2024-05-25 00:51:03.386943+00:00, run_duration=1.354144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:51:00.247856+00:00, queued_by_job_id=1, pid=7446 2024-05-25T00:51:05.061736374Z [2024-05-25T00:51:05.061+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:51:05.062340748Z [2024-05-25T00:51:05.062+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:50:00+00:00, run_id=scheduled__2024-05-25T00:50:00+00:00, run_start_date=2024-05-25 00:51:00.188540+00:00, run_end_date=2024-05-25 00:51:05.061923+00:00, run_duration=4.873383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:50:00+00:00, data_interval_end=2024-05-25 00:51:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:51:05.072825839Z [2024-05-25T00:51:05.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:51:00+00:00, run_after=2024-05-25T00:52:00+00:00 2024-05-25T00:51:05.126420393Z [2024-05-25T00:51:05.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status success for try_number 1 2024-05-25T00:51:05.137584099Z [2024-05-25T00:51:05.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:50:00+00:00, map_index=-1, run_start_date=2024-05-25 00:51:02.335785+00:00, run_end_date=2024-05-25 00:51:04.767784+00:00, run_duration=2.431999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:51:00.247856+00:00, queued_by_job_id=1, pid=7454 2024-05-25T00:52:00.073488746Z [2024-05-25T00:52:00.072+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:52:00.089311842Z [2024-05-25T00:52:00.085+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:52:00.103175452Z [2024-05-25T00:52:00.102+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:52:00+00:00, run_after=2024-05-25T00:53:00+00:00 2024-05-25T00:52:00.114905372Z [2024-05-25T00:52:00.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:52:00+00:00, run_after=2024-05-25T00:53:00+00:00 2024-05-25T00:52:00.223823699Z [2024-05-25T00:52:00.223+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:52:00.223863288Z 2024-05-25T00:52:00.223935127Z 2024-05-25T00:52:00.223943270Z 2024-05-25T00:52:00.223950439Z 2024-05-25T00:52:00.224088433Z [2024-05-25T00:52:00.223+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:52:00.224305300Z [2024-05-25T00:52:00.224+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:52:00.224539716Z [2024-05-25T00:52:00.224+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:52:00.224737076Z [2024-05-25T00:52:00.224+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:52:00.225667663Z [2024-05-25T00:52:00.225+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:52:00.225685124Z 2024-05-25T00:52:00.225689261Z 2024-05-25T00:52:00.225704540Z 2024-05-25T00:52:00.225707818Z 2024-05-25T00:52:00.231171406Z [2024-05-25T00:52:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:52:00.231506882Z [2024-05-25T00:52:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:52:00.231762737Z [2024-05-25T00:52:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:52:00.231970275Z [2024-05-25T00:52:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:52:00.232258357Z [2024-05-25T00:52:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:52:00.232399523Z [2024-05-25T00:52:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:52:00.232652081Z [2024-05-25T00:52:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:52:00.232768477Z [2024-05-25T00:52:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:52:00.470264072Z [2024-05-25T00:52:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status queued for try_number 1 2024-05-25T00:52:00.473563343Z [2024-05-25T00:52:00.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:51:00+00:00 exited with status queued for try_number 1 2024-05-25T00:52:00.473661393Z [2024-05-25T00:52:00.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:51:00+00:00 exited with status queued for try_number 1 2024-05-25T00:52:00.473764693Z [2024-05-25T00:52:00.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:51:00+00:00 exited with status queued for try_number 1 2024-05-25T00:52:00.498530522Z [2024-05-25T00:52:00.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1f29d53-382b-4052-8668-0b2ddb29fe62 2024-05-25T00:52:00.499320505Z [2024-05-25T00:52:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4b022f3-20f5-40c0-b031-bdd050bf9a30 2024-05-25T00:52:00.499595298Z [2024-05-25T00:52:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6b3eb1a-5439-4788-aa8c-6675763332c0 2024-05-25T00:52:00.499810963Z [2024-05-25T00:52:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 775f759a-8c90-416f-8dc0-d6848b763cc6 2024-05-25T00:52:01.656337009Z [2024-05-25T00:52:01.655+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:52:01.656756382Z [2024-05-25T00:52:01.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:51:00+00:00, run_id=scheduled__2024-05-25T00:51:00+00:00, run_start_date=2024-05-25 00:52:00.125552+00:00, run_end_date=2024-05-25 00:52:01.656249+00:00, run_duration=1.530697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:51:00+00:00, data_interval_end=2024-05-25 00:52:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:52:01.667568029Z [2024-05-25T00:52:01.667+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:52:00+00:00, run_after=2024-05-25T00:53:00+00:00 2024-05-25T00:52:01.716630819Z [2024-05-25T00:52:01.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status success for try_number 1 2024-05-25T00:52:01.716751789Z [2024-05-25T00:52:01.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:51:00+00:00 exited with status success for try_number 1 2024-05-25T00:52:01.724832531Z [2024-05-25T00:52:01.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:51:00+00:00, map_index=-1, run_start_date=2024-05-25 00:52:01.119102+00:00, run_end_date=2024-05-25 00:52:01.498520+00:00, run_duration=0.379418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:52:00.227245+00:00, queued_by_job_id=1, pid=7485 2024-05-25T00:52:01.725328032Z [2024-05-25T00:52:01.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:50:00+00:00, map_index=-1, run_start_date=2024-05-25 00:52:01.168801+00:00, run_end_date=2024-05-25 00:52:01.554118+00:00, run_duration=0.385317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:52:00.227245+00:00, queued_by_job_id=1, pid=7486 2024-05-25T00:52:02.768018800Z [2024-05-25T00:52:02.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:52:02.768557834Z [2024-05-25T00:52:02.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:50:00+00:00, run_id=scheduled__2024-05-25T00:50:00+00:00, run_start_date=2024-05-25 00:52:00.124433+00:00, run_end_date=2024-05-25 00:52:02.767834+00:00, run_duration=2.643401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:50:00+00:00, data_interval_end=2024-05-25 00:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:52:02.775763919Z [2024-05-25T00:52:02.775+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:52:00+00:00, run_after=2024-05-25T00:54:00+00:00 2024-05-25T00:52:04.458122629Z [2024-05-25T00:52:04.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:52:04.458359571Z [2024-05-25T00:52:04.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:51:00+00:00, run_id=scheduled__2024-05-25T00:51:00+00:00, run_start_date=2024-05-25 00:52:00.126483+00:00, run_end_date=2024-05-25 00:52:04.457774+00:00, run_duration=4.331291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:51:00+00:00, data_interval_end=2024-05-25 00:52:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:52:04.467645933Z [2024-05-25T00:52:04.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:52:00+00:00, run_after=2024-05-25T00:53:00+00:00 2024-05-25T00:52:04.474727203Z [2024-05-25T00:52:04.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:52:04.475192568Z [2024-05-25T00:52:04.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:51:00+00:00, run_id=scheduled__2024-05-25T00:51:00+00:00, run_start_date=2024-05-25 00:52:00.127369+00:00, run_end_date=2024-05-25 00:52:04.474667+00:00, run_duration=4.347298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:51:00+00:00, data_interval_end=2024-05-25 00:52:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:52:04.486759253Z [2024-05-25T00:52:04.486+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:52:00+00:00, run_after=2024-05-25T00:53:00+00:00 2024-05-25T00:52:04.518244364Z [2024-05-25T00:52:04.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:51:00+00:00 exited with status success for try_number 1 2024-05-25T00:52:04.518645960Z [2024-05-25T00:52:04.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:51:00+00:00 exited with status success for try_number 1 2024-05-25T00:52:04.528483708Z [2024-05-25T00:52:04.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:51:00+00:00, map_index=-1, run_start_date=2024-05-25 00:52:02.340653+00:00, run_end_date=2024-05-25 00:52:03.650911+00:00, run_duration=1.310258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:52:00.227245+00:00, queued_by_job_id=1, pid=7510 2024-05-25T00:52:04.528988887Z [2024-05-25T00:52:04.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:51:00+00:00, map_index=-1, run_start_date=2024-05-25 00:52:02.176898+00:00, run_end_date=2024-05-25 00:52:03.848440+00:00, run_duration=1.671542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:52:00.227245+00:00, queued_by_job_id=1, pid=7509 2024-05-25T00:53:00.072232612Z [2024-05-25T00:53:00.071+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:53:00.090193295Z [2024-05-25T00:53:00.089+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:53:00+00:00, run_after=2024-05-25T00:54:00+00:00 2024-05-25T00:53:00.121102310Z [2024-05-25T00:53:00.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:53:00+00:00, run_after=2024-05-25T00:54:00+00:00 2024-05-25T00:53:00.208462642Z [2024-05-25T00:53:00.207+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:53:00.208544208Z 2024-05-25T00:53:00.208613478Z 2024-05-25T00:53:00.208625560Z 2024-05-25T00:53:00.208652874Z [2024-05-25T00:53:00.208+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:53:00.208662093Z [2024-05-25T00:53:00.208+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:53:00.208802662Z [2024-05-25T00:53:00.208+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:53:00.210060369Z [2024-05-25T00:53:00.209+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:53:00.210084555Z 2024-05-25T00:53:00.210093470Z 2024-05-25T00:53:00.210102702Z 2024-05-25T00:53:00.214972626Z [2024-05-25T00:53:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:53:00.215064980Z [2024-05-25T00:53:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:53:00.215255118Z [2024-05-25T00:53:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:53:00.215315116Z [2024-05-25T00:53:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:53:00.215628437Z [2024-05-25T00:53:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:53:00.215693450Z [2024-05-25T00:53:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:53:00.472844770Z [2024-05-25T00:53:00.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:52:00+00:00 exited with status queued for try_number 1 2024-05-25T00:53:00.472905924Z [2024-05-25T00:53:00.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:52:00+00:00 exited with status queued for try_number 1 2024-05-25T00:53:00.473035250Z [2024-05-25T00:53:00.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:52:00+00:00 exited with status queued for try_number 1 2024-05-25T00:53:00.480396688Z [2024-05-25T00:53:00.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to 400d0fe5-ee58-4f9b-af9b-fc6a12f3778b 2024-05-25T00:53:00.480436891Z [2024-05-25T00:53:00.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to 254768c5-0759-4d35-b606-4a418d0aa8bd 2024-05-25T00:53:00.480541191Z [2024-05-25T00:53:00.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to d48c64a9-0729-4c88-8ffd-1747a11e727d 2024-05-25T00:53:01.631985355Z [2024-05-25T00:53:01.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:53:01.632260900Z [2024-05-25T00:53:01.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:52:00+00:00, run_id=scheduled__2024-05-25T00:52:00+00:00, run_start_date=2024-05-25 00:53:00.136425+00:00, run_end_date=2024-05-25 00:53:01.631744+00:00, run_duration=1.495319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:52:00+00:00, data_interval_end=2024-05-25 00:53:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:53:01.644888056Z [2024-05-25T00:53:01.644+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:53:00+00:00, run_after=2024-05-25T00:54:00+00:00 2024-05-25T00:53:01.725941211Z [2024-05-25T00:53:01.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:52:00+00:00 exited with status success for try_number 1 2024-05-25T00:53:01.737881828Z [2024-05-25T00:53:01.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:52:00+00:00, map_index=-1, run_start_date=2024-05-25 00:53:00.989015+00:00, run_end_date=2024-05-25 00:53:01.321328+00:00, run_duration=0.332313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:53:00.211041+00:00, queued_by_job_id=1, pid=7542 2024-05-25T00:53:03.728303890Z [2024-05-25T00:53:03.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:53:03.728699676Z [2024-05-25T00:53:03.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:52:00+00:00, run_id=scheduled__2024-05-25T00:52:00+00:00, run_start_date=2024-05-25 00:53:00.138346+00:00, run_end_date=2024-05-25 00:53:03.728284+00:00, run_duration=3.589938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:52:00+00:00, data_interval_end=2024-05-25 00:53:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:53:03.738534016Z [2024-05-25T00:53:03.738+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:53:00+00:00, run_after=2024-05-25T00:54:00+00:00 2024-05-25T00:53:03.800957839Z [2024-05-25T00:53:03.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:52:00+00:00 exited with status success for try_number 1 2024-05-25T00:53:03.807941230Z [2024-05-25T00:53:03.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:52:00+00:00, map_index=-1, run_start_date=2024-05-25 00:53:02.072853+00:00, run_end_date=2024-05-25 00:53:03.363861+00:00, run_duration=1.291008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:53:00.211041+00:00, queued_by_job_id=1, pid=7561 2024-05-25T00:53:04.087364226Z [2024-05-25T00:53:04.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:53:04.087880828Z [2024-05-25T00:53:04.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:52:00+00:00, run_id=scheduled__2024-05-25T00:52:00+00:00, run_start_date=2024-05-25 00:53:00.139555+00:00, run_end_date=2024-05-25 00:53:04.087410+00:00, run_duration=3.947855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:52:00+00:00, data_interval_end=2024-05-25 00:53:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:53:04.102097592Z [2024-05-25T00:53:04.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:53:00+00:00, run_after=2024-05-25T00:54:00+00:00 2024-05-25T00:53:04.162253361Z [2024-05-25T00:53:04.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:52:00+00:00 exited with status success for try_number 1 2024-05-25T00:53:04.167679496Z [2024-05-25T00:53:04.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:52:00+00:00, map_index=-1, run_start_date=2024-05-25 00:53:02.039082+00:00, run_end_date=2024-05-25 00:53:03.725110+00:00, run_duration=1.686028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:53:00.211041+00:00, queued_by_job_id=1, pid=7560 2024-05-25T00:54:00.093537460Z [2024-05-25T00:54:00.093+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:54:00.112118062Z [2024-05-25T00:54:00.111+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:54:00+00:00, run_after=2024-05-25T00:55:00+00:00 2024-05-25T00:54:00.120869366Z [2024-05-25T00:54:00.120+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:54:00.135223151Z [2024-05-25T00:54:00.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:54:00+00:00, run_after=2024-05-25T00:55:00+00:00 2024-05-25T00:54:00.248108178Z [2024-05-25T00:54:00.247+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:54:00.248163077Z 2024-05-25T00:54:00.248169005Z 2024-05-25T00:54:00.248173067Z 2024-05-25T00:54:00.248177239Z 2024-05-25T00:54:00.248190542Z [2024-05-25T00:54:00.247+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:54:00.248241521Z [2024-05-25T00:54:00.248+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:54:00.248251494Z [2024-05-25T00:54:00.248+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:54:00.248341588Z [2024-05-25T00:54:00.248+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:54:00.249071891Z [2024-05-25T00:54:00.248+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:54:00.249083420Z 2024-05-25T00:54:00.249087921Z 2024-05-25T00:54:00.249092110Z 2024-05-25T00:54:00.249096388Z 2024-05-25T00:54:00.253475921Z [2024-05-25T00:54:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:54:00.253573223Z [2024-05-25T00:54:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:54:00.253885537Z [2024-05-25T00:54:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:54:00.253958325Z [2024-05-25T00:54:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:54:00.254228921Z [2024-05-25T00:54:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:54:00.254243303Z [2024-05-25T00:54:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:54:00.254494651Z [2024-05-25T00:54:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:54:00.254506553Z [2024-05-25T00:54:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:54:00.657090076Z [2024-05-25T00:54:00.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:52:00+00:00 exited with status queued for try_number 1 2024-05-25T00:54:00.657510475Z [2024-05-25T00:54:00.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:53:00+00:00 exited with status queued for try_number 1 2024-05-25T00:54:00.657742754Z [2024-05-25T00:54:00.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:53:00+00:00 exited with status queued for try_number 1 2024-05-25T00:54:00.657996519Z [2024-05-25T00:54:00.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:53:00+00:00 exited with status queued for try_number 1 2024-05-25T00:54:00.680173639Z [2024-05-25T00:54:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a27169f-8055-4be8-b5d2-1954fac0e5cb 2024-05-25T00:54:00.680205985Z [2024-05-25T00:54:00.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d8598c8-680b-49e3-882c-708cf1fb7164 2024-05-25T00:54:00.680266544Z [2024-05-25T00:54:00.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1a596b2-5d3c-460e-8215-16892ca90d10 2024-05-25T00:54:00.680408099Z [2024-05-25T00:54:00.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a5cd13f-3845-4f8e-a8da-13ceab216523 2024-05-25T00:54:01.866384300Z [2024-05-25T00:54:01.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:54:01.866704738Z [2024-05-25T00:54:01.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:52:00+00:00, run_id=scheduled__2024-05-25T00:52:00+00:00, run_start_date=2024-05-25 00:54:00.148254+00:00, run_end_date=2024-05-25 00:54:01.866086+00:00, run_duration=1.717832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:52:00+00:00, data_interval_end=2024-05-25 00:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:54:01.875004479Z [2024-05-25T00:54:01.874+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:54:00+00:00, run_after=2024-05-25T00:56:00+00:00 2024-05-25T00:54:01.882697559Z [2024-05-25T00:54:01.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:54:01.882914819Z [2024-05-25T00:54:01.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:53:00+00:00, run_id=scheduled__2024-05-25T00:53:00+00:00, run_start_date=2024-05-25 00:54:00.149756+00:00, run_end_date=2024-05-25 00:54:01.882453+00:00, run_duration=1.732697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:53:00+00:00, data_interval_end=2024-05-25 00:54:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:54:01.892757692Z [2024-05-25T00:54:01.892+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:54:00+00:00, run_after=2024-05-25T00:55:00+00:00 2024-05-25T00:54:01.955011096Z [2024-05-25T00:54:01.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:52:00+00:00 exited with status success for try_number 1 2024-05-25T00:54:01.955742896Z [2024-05-25T00:54:01.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:53:00+00:00 exited with status success for try_number 1 2024-05-25T00:54:01.968484571Z [2024-05-25T00:54:01.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:52:00+00:00, map_index=-1, run_start_date=2024-05-25 00:54:01.187454+00:00, run_end_date=2024-05-25 00:54:01.607669+00:00, run_duration=0.420215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:54:00.249987+00:00, queued_by_job_id=1, pid=7594 2024-05-25T00:54:01.969048144Z [2024-05-25T00:54:01.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:53:00+00:00, map_index=-1, run_start_date=2024-05-25 00:54:01.133601+00:00, run_end_date=2024-05-25 00:54:01.626810+00:00, run_duration=0.493209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:54:00.249987+00:00, queued_by_job_id=1, pid=7593 2024-05-25T00:54:04.075279727Z [2024-05-25T00:54:04.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:54:04.075774626Z [2024-05-25T00:54:04.075+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:53:00+00:00, run_id=scheduled__2024-05-25T00:53:00+00:00, run_start_date=2024-05-25 00:54:00.150904+00:00, run_end_date=2024-05-25 00:54:04.075245+00:00, run_duration=3.924341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:53:00+00:00, data_interval_end=2024-05-25 00:54:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:54:04.085703889Z [2024-05-25T00:54:04.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:54:00+00:00, run_after=2024-05-25T00:55:00+00:00 2024-05-25T00:54:04.092138409Z [2024-05-25T00:54:04.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:54:04.092369548Z [2024-05-25T00:54:04.092+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:53:00+00:00, run_id=scheduled__2024-05-25T00:53:00+00:00, run_start_date=2024-05-25 00:54:00.152090+00:00, run_end_date=2024-05-25 00:54:04.092048+00:00, run_duration=3.939958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:53:00+00:00, data_interval_end=2024-05-25 00:54:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:54:04.101374546Z [2024-05-25T00:54:04.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:54:00+00:00, run_after=2024-05-25T00:55:00+00:00 2024-05-25T00:54:04.141099952Z [2024-05-25T00:54:04.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:53:00+00:00 exited with status success for try_number 1 2024-05-25T00:54:04.150971352Z [2024-05-25T00:54:04.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:53:00+00:00, map_index=-1, run_start_date=2024-05-25 00:54:02.171958+00:00, run_end_date=2024-05-25 00:54:03.506717+00:00, run_duration=1.334759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:54:00.249987+00:00, queued_by_job_id=1, pid=7617 2024-05-25T00:54:05.236914201Z [2024-05-25T00:54:05.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:53:00+00:00 exited with status success for try_number 1 2024-05-25T00:54:05.244070485Z [2024-05-25T00:54:05.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:53:00+00:00, map_index=-1, run_start_date=2024-05-25 00:54:02.359893+00:00, run_end_date=2024-05-25 00:54:04.034573+00:00, run_duration=1.67468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:54:00.249987+00:00, queued_by_job_id=1, pid=7618 2024-05-25T00:55:00.830880966Z [2024-05-25T00:55:00.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:55:00+00:00, run_after=2024-05-25T00:56:00+00:00 2024-05-25T00:55:00.847795072Z [2024-05-25T00:55:00.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:55:00+00:00, run_after=2024-05-25T01:00:00+00:00 2024-05-25T00:55:00.856892808Z [2024-05-25T00:55:00.856+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:55:00.872750225Z [2024-05-25T00:55:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:55:00+00:00, run_after=2024-05-25T00:56:00+00:00 2024-05-25T00:55:00.991972945Z [2024-05-25T00:55:00.991+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:55:00.992009327Z 2024-05-25T00:55:00.992022877Z 2024-05-25T00:55:00.992029317Z 2024-05-25T00:55:00.992035461Z 2024-05-25T00:55:00.992721931Z [2024-05-25T00:55:00.992+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:55:00.992992675Z [2024-05-25T00:55:00.992+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:55:00.993407829Z [2024-05-25T00:55:00.993+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:55:00.993953696Z [2024-05-25T00:55:00.993+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:55:00.996556036Z [2024-05-25T00:55:00.996+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:55:00.996580751Z 2024-05-25T00:55:00.996589913Z 2024-05-25T00:55:00.996598279Z 2024-05-25T00:55:00.996606643Z 2024-05-25T00:55:01.003717270Z [2024-05-25T00:55:01.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T00:55:01.004950835Z [2024-05-25T00:55:01.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:55:01.005939301Z [2024-05-25T00:55:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:55:01.006593109Z [2024-05-25T00:55:01.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:55:01.007437928Z [2024-05-25T00:55:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:55:01.008074550Z [2024-05-25T00:55:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:55:01.009097942Z [2024-05-25T00:55:01.008+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:55:01.009719309Z [2024-05-25T00:55:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:55:01.465382934Z [2024-05-25T00:55:01.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status queued for try_number 1 2024-05-25T00:55:01.465530858Z [2024-05-25T00:55:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:54:00+00:00 exited with status queued for try_number 1 2024-05-25T00:55:01.465597003Z [2024-05-25T00:55:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:54:00+00:00 exited with status queued for try_number 1 2024-05-25T00:55:01.465661358Z [2024-05-25T00:55:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:54:00+00:00 exited with status queued for try_number 1 2024-05-25T00:55:01.486749727Z [2024-05-25T00:55:01.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b456487-0800-4c3d-a365-632feb8ddb63 2024-05-25T00:55:01.487101821Z [2024-05-25T00:55:01.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4336638-db47-45fd-bca7-3465380252c9 2024-05-25T00:55:01.487317068Z [2024-05-25T00:55:01.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7986ebf-629c-4492-909d-034ea0eee7c1 2024-05-25T00:55:01.487523291Z [2024-05-25T00:55:01.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf87f638-51b2-4fa2-8867-6d1eff2bca9c 2024-05-25T00:55:02.779574485Z [2024-05-25T00:55:02.778+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:55:02.779989225Z [2024-05-25T00:55:02.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:54:00+00:00, run_id=scheduled__2024-05-25T00:54:00+00:00, run_start_date=2024-05-25 00:55:00.890158+00:00, run_end_date=2024-05-25 00:55:02.779598+00:00, run_duration=1.88944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:54:00+00:00, data_interval_end=2024-05-25 00:55:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:55:02.790244360Z [2024-05-25T00:55:02.789+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:55:00+00:00, run_after=2024-05-25T00:56:00+00:00 2024-05-25T00:55:02.850737524Z [2024-05-25T00:55:02.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:54:00+00:00 exited with status success for try_number 1 2024-05-25T00:55:02.857433383Z [2024-05-25T00:55:02.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:54:00+00:00, map_index=-1, run_start_date=2024-05-25 00:55:01.924111+00:00, run_end_date=2024-05-25 00:55:02.385658+00:00, run_duration=0.461547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:55:00.997817+00:00, queued_by_job_id=1, pid=7650 2024-05-25T00:55:03.977726766Z [2024-05-25T00:55:03.977+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:55:03.977769993Z 2024-05-25T00:55:03.977956768Z [2024-05-25T00:55:03.977+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:55:03.979517507Z [2024-05-25T00:55:03.979+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:55:03.979538636Z 2024-05-25T00:55:03.984966554Z [2024-05-25T00:55:03.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T00:55:03.985398542Z [2024-05-25T00:55:03.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:55:04.075905413Z [2024-05-25T00:55:04.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status queued for try_number 1 2024-05-25T00:55:04.075937036Z [2024-05-25T00:55:04.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status success for try_number 1 2024-05-25T00:55:04.088989301Z [2024-05-25T00:55:04.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85d9b7cf-f128-466c-b9f7-2cd02731c8d1 2024-05-25T00:55:04.089033295Z [2024-05-25T00:55:04.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T00:50:00+00:00, map_index=-1, run_start_date=2024-05-25 00:55:03.067587+00:00, run_end_date=2024-05-25 00:55:03.490575+00:00, run_duration=0.422988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:55:00.997817+00:00, queued_by_job_id=1, pid=7675 2024-05-25T00:55:05.515676920Z [2024-05-25T00:55:05.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:55:05.516001091Z [2024-05-25T00:55:05.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:54:00+00:00, run_id=scheduled__2024-05-25T00:54:00+00:00, run_start_date=2024-05-25 00:55:00.891192+00:00, run_end_date=2024-05-25 00:55:05.515522+00:00, run_duration=4.62433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:54:00+00:00, data_interval_end=2024-05-25 00:55:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:55:05.527684765Z [2024-05-25T00:55:05.527+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:55:00+00:00, run_after=2024-05-25T00:56:00+00:00 2024-05-25T00:55:05.535614107Z [2024-05-25T00:55:05.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:55:05.535897658Z [2024-05-25T00:55:05.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:54:00+00:00, run_id=scheduled__2024-05-25T00:54:00+00:00, run_start_date=2024-05-25 00:55:00.892213+00:00, run_end_date=2024-05-25 00:55:05.535509+00:00, run_duration=4.643296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:54:00+00:00, data_interval_end=2024-05-25 00:55:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:55:05.546451614Z [2024-05-25T00:55:05.546+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:55:00+00:00, run_after=2024-05-25T00:56:00+00:00 2024-05-25T00:55:05.589363213Z [2024-05-25T00:55:05.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:54:00+00:00 exited with status success for try_number 1 2024-05-25T00:55:05.589387566Z [2024-05-25T00:55:05.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:54:00+00:00 exited with status success for try_number 1 2024-05-25T00:55:05.595516626Z [2024-05-25T00:55:05.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:54:00+00:00, map_index=-1, run_start_date=2024-05-25 00:55:03.049092+00:00, run_end_date=2024-05-25 00:55:04.473829+00:00, run_duration=1.424737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:55:00.997817+00:00, queued_by_job_id=1, pid=7674 2024-05-25T00:55:05.595608027Z [2024-05-25T00:55:05.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:54:00+00:00, map_index=-1, run_start_date=2024-05-25 00:55:03.105060+00:00, run_end_date=2024-05-25 00:55:04.866812+00:00, run_duration=1.761752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:55:00.997817+00:00, queued_by_job_id=1, pid=7676 2024-05-25T00:55:06.794438466Z [2024-05-25T00:55:06.794+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:55:06.794470957Z 2024-05-25T00:55:06.794731759Z [2024-05-25T00:55:06.794+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:55:06.795328998Z [2024-05-25T00:55:06.795+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:55:06.795354984Z 2024-05-25T00:55:06.797852788Z [2024-05-25T00:55:06.797+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T00:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T00:55:06.797970501Z [2024-05-25T00:55:06.797+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:55:06.864617974Z [2024-05-25T00:55:06.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status queued for try_number 1 2024-05-25T00:55:06.864704080Z [2024-05-25T00:55:06.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status success for try_number 1 2024-05-25T00:55:06.873303185Z [2024-05-25T00:55:06.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74ea95dd-9199-4a0b-9ec2-8fd6442727e7 2024-05-25T00:55:06.873592587Z [2024-05-25T00:55:06.873+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T00:50:00+00:00, map_index=-1, run_start_date=2024-05-25 00:55:05.704904+00:00, run_end_date=2024-05-25 00:55:06.108884+00:00, run_duration=0.40398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:55:03.980461+00:00, queued_by_job_id=1, pid=7699 2024-05-25T00:55:09.155589778Z [2024-05-25T00:55:09.155+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T00:55:09.155631999Z 2024-05-25T00:55:09.155665635Z [2024-05-25T00:55:09.155+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:55:09.156115595Z [2024-05-25T00:55:09.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:55:09.156166245Z 2024-05-25T00:55:09.158746158Z [2024-05-25T00:55:09.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:55:09.158808459Z [2024-05-25T00:55:09.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:55:09.221305306Z [2024-05-25T00:55:09.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status queued for try_number 1 2024-05-25T00:55:09.221687367Z [2024-05-25T00:55:09.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status success for try_number 1 2024-05-25T00:55:09.229895702Z [2024-05-25T00:55:09.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d79db44-113a-41df-ae77-6d2d75198747 2024-05-25T00:55:09.230357259Z [2024-05-25T00:55:09.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T00:50:00+00:00, map_index=0, run_start_date=2024-05-25 00:55:08.617363+00:00, run_end_date=2024-05-25 00:55:08.975700+00:00, run_duration=0.358337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:55:06.795725+00:00, queued_by_job_id=1, pid=7719 2024-05-25T00:55:11.503219448Z [2024-05-25T00:55:11.502+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:55:11.503279859Z [2024-05-25T00:55:11.503+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:50:00+00:00, run_id=scheduled__2024-05-25T00:50:00+00:00, run_start_date=2024-05-25 00:55:00.888597+00:00, run_end_date=2024-05-25 00:55:11.503015+00:00, run_duration=10.614418, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:50:00+00:00, data_interval_end=2024-05-25 00:55:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T00:55:11.509393973Z [2024-05-25T00:55:11.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:55:00+00:00, run_after=2024-05-25T01:00:00+00:00 2024-05-25T00:55:11.569515346Z [2024-05-25T00:55:11.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:50:00+00:00 exited with status success for try_number 1 2024-05-25T00:55:11.573898692Z [2024-05-25T00:55:11.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T00:50:00+00:00, map_index=-1, run_start_date=2024-05-25 00:55:10.723549+00:00, run_end_date=2024-05-25 00:55:11.084208+00:00, run_duration=0.360659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:55:09.156355+00:00, queued_by_job_id=1, pid=7727 2024-05-25T00:55:28.722854864Z [2024-05-25T00:55:28.722+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T00:56:00.806936239Z [2024-05-25T00:56:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:56:00+00:00, run_after=2024-05-25T00:57:00+00:00 2024-05-25T00:56:00.818042274Z [2024-05-25T00:56:00.817+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:56:00.832982521Z [2024-05-25T00:56:00.832+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:56:00+00:00, run_after=2024-05-25T00:57:00+00:00 2024-05-25T00:56:00.841895639Z [2024-05-25T00:56:00.841+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:56:00.985001131Z [2024-05-25T00:56:00.984+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:56:00.985043286Z 2024-05-25T00:56:00.985050842Z 2024-05-25T00:56:00.985056542Z 2024-05-25T00:56:00.985061639Z 2024-05-25T00:56:00.985508053Z [2024-05-25T00:56:00.985+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:56:00.985997812Z [2024-05-25T00:56:00.985+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:56:00.986311276Z [2024-05-25T00:56:00.986+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:56:00.986746725Z [2024-05-25T00:56:00.986+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:56:00.988183627Z [2024-05-25T00:56:00.987+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:56:00.988224055Z 2024-05-25T00:56:00.988237990Z 2024-05-25T00:56:00.988277988Z 2024-05-25T00:56:00.988289203Z 2024-05-25T00:56:00.999990751Z [2024-05-25T00:56:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:56:01.000190566Z [2024-05-25T00:56:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:56:01.000689985Z [2024-05-25T00:56:01.000+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:56:01.000931201Z [2024-05-25T00:56:01.000+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:56:01.001578162Z [2024-05-25T00:56:01.001+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:56:01.001777884Z [2024-05-25T00:56:01.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:56:01.002266719Z [2024-05-25T00:56:01.001+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:56:01.002496544Z [2024-05-25T00:56:01.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:56:01.522611191Z [2024-05-25T00:56:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:54:00+00:00 exited with status queued for try_number 1 2024-05-25T00:56:01.522715431Z [2024-05-25T00:56:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status queued for try_number 1 2024-05-25T00:56:01.522721176Z [2024-05-25T00:56:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status queued for try_number 1 2024-05-25T00:56:01.522781723Z [2024-05-25T00:56:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status queued for try_number 1 2024-05-25T00:56:01.541041567Z [2024-05-25T00:56:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3287270b-0119-4abc-b5b2-22f22b9ddd05 2024-05-25T00:56:01.541143195Z [2024-05-25T00:56:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to c90618d0-5644-490e-a173-19306d6c200f 2024-05-25T00:56:01.541283191Z [2024-05-25T00:56:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19b9dd1e-78aa-4d30-9e38-af2c4ee459c6 2024-05-25T00:56:01.541410685Z [2024-05-25T00:56:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e19c07e-0551-4ae0-aac6-1827760a6664 2024-05-25T00:56:02.688001658Z [2024-05-25T00:56:02.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:56:02.688224319Z [2024-05-25T00:56:02.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:55:00+00:00, run_id=scheduled__2024-05-25T00:55:00+00:00, run_start_date=2024-05-25 00:56:00.864220+00:00, run_end_date=2024-05-25 00:56:02.687873+00:00, run_duration=1.823653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:55:00+00:00, data_interval_end=2024-05-25 00:56:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:56:02.712677592Z [2024-05-25T00:56:02.712+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:56:00+00:00, run_after=2024-05-25T00:57:00+00:00 2024-05-25T00:56:03.874548974Z [2024-05-25T00:56:03.870+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:56:03.874603911Z [2024-05-25T00:56:03.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:54:00+00:00, run_id=scheduled__2024-05-25T00:54:00+00:00, run_start_date=2024-05-25 00:56:00.861280+00:00, run_end_date=2024-05-25 00:56:03.871098+00:00, run_duration=3.009818, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:54:00+00:00, data_interval_end=2024-05-25 00:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:56:03.885353861Z [2024-05-25T00:56:03.882+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:56:00+00:00, run_after=2024-05-25T00:58:00+00:00 2024-05-25T00:56:03.942855329Z [2024-05-25T00:56:03.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:54:00+00:00 exited with status success for try_number 1 2024-05-25T00:56:03.942936868Z [2024-05-25T00:56:03.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status success for try_number 1 2024-05-25T00:56:03.951463770Z [2024-05-25T00:56:03.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:55:00+00:00, map_index=-1, run_start_date=2024-05-25 00:56:01.916082+00:00, run_end_date=2024-05-25 00:56:02.594285+00:00, run_duration=0.678203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:56:00.991972+00:00, queued_by_job_id=1, pid=7737 2024-05-25T00:56:03.951667698Z [2024-05-25T00:56:03.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:54:00+00:00, map_index=-1, run_start_date=2024-05-25 00:56:02.021766+00:00, run_end_date=2024-05-25 00:56:02.811361+00:00, run_duration=0.789595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:56:00.991972+00:00, queued_by_job_id=1, pid=7738 2024-05-25T00:56:05.813969363Z [2024-05-25T00:56:05.813+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:56:05.814069232Z [2024-05-25T00:56:05.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:55:00+00:00, run_id=scheduled__2024-05-25T00:55:00+00:00, run_start_date=2024-05-25 00:56:00.866893+00:00, run_end_date=2024-05-25 00:56:05.813705+00:00, run_duration=4.946812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:55:00+00:00, data_interval_end=2024-05-25 00:56:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:56:05.822865401Z [2024-05-25T00:56:05.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:56:00+00:00, run_after=2024-05-25T00:57:00+00:00 2024-05-25T00:56:05.829554929Z [2024-05-25T00:56:05.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:56:05.829603184Z [2024-05-25T00:56:05.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:55:00+00:00, run_id=scheduled__2024-05-25T00:55:00+00:00, run_start_date=2024-05-25 00:56:00.869356+00:00, run_end_date=2024-05-25 00:56:05.828805+00:00, run_duration=4.959449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:55:00+00:00, data_interval_end=2024-05-25 00:56:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:56:05.837914304Z [2024-05-25T00:56:05.837+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:56:00+00:00, run_after=2024-05-25T00:57:00+00:00 2024-05-25T00:56:05.884173795Z [2024-05-25T00:56:05.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status success for try_number 1 2024-05-25T00:56:05.884234185Z [2024-05-25T00:56:05.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status success for try_number 1 2024-05-25T00:56:05.897963289Z [2024-05-25T00:56:05.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:55:00+00:00, map_index=-1, run_start_date=2024-05-25 00:56:03.438585+00:00, run_end_date=2024-05-25 00:56:04.729135+00:00, run_duration=1.29055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:56:00.991972+00:00, queued_by_job_id=1, pid=7762 2024-05-25T00:56:05.898590014Z [2024-05-25T00:56:05.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:55:00+00:00, map_index=-1, run_start_date=2024-05-25 00:56:03.279338+00:00, run_end_date=2024-05-25 00:56:05.344321+00:00, run_duration=2.064983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:56:00.991972+00:00, queued_by_job_id=1, pid=7761 2024-05-25T00:57:00.818558917Z [2024-05-25T00:57:00.817+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:57:00.851731415Z [2024-05-25T00:57:00.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:57:00+00:00, run_after=2024-05-25T00:58:00+00:00 2024-05-25T00:57:00.866527635Z [2024-05-25T00:57:00.866+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:57:00+00:00, run_after=2024-05-25T00:58:00+00:00 2024-05-25T00:57:00.950936421Z [2024-05-25T00:57:00.950+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:57:00.950973412Z 2024-05-25T00:57:00.950979455Z 2024-05-25T00:57:00.950984917Z 2024-05-25T00:57:00.951069465Z [2024-05-25T00:57:00.950+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:57:00.951389186Z [2024-05-25T00:57:00.951+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:57:00.951604793Z [2024-05-25T00:57:00.951+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:57:00.952412557Z [2024-05-25T00:57:00.952+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:57:00.952428930Z 2024-05-25T00:57:00.952436458Z 2024-05-25T00:57:00.952443636Z 2024-05-25T00:57:00.958130368Z [2024-05-25T00:57:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:57:00.958278065Z [2024-05-25T00:57:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:57:00.958615364Z [2024-05-25T00:57:00.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:57:00.958779392Z [2024-05-25T00:57:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:57:00.959088023Z [2024-05-25T00:57:00.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:57:00.959297691Z [2024-05-25T00:57:00.959+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:57:01.246312644Z [2024-05-25T00:57:01.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:56:00+00:00 exited with status queued for try_number 1 2024-05-25T00:57:01.251950055Z [2024-05-25T00:57:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:56:00+00:00 exited with status queued for try_number 1 2024-05-25T00:57:01.252207587Z [2024-05-25T00:57:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:56:00+00:00 exited with status queued for try_number 1 2024-05-25T00:57:01.260449610Z [2024-05-25T00:57:01.260+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a56b820-c220-468a-aef4-bf3e7e543aea 2024-05-25T00:57:01.260624486Z [2024-05-25T00:57:01.260+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2455e521-53fa-4104-9c1d-268169be5f1b 2024-05-25T00:57:01.260795319Z [2024-05-25T00:57:01.260+0000] {scheduler_job.py:635} INFO - Setting external_id for to 390eac32-ff91-4aab-8581-66ee2c52b886 2024-05-25T00:57:02.419283869Z [2024-05-25T00:57:02.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:57:02.419585543Z [2024-05-25T00:57:02.419+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:56:00+00:00, run_id=scheduled__2024-05-25T00:56:00+00:00, run_start_date=2024-05-25 00:57:00.877365+00:00, run_end_date=2024-05-25 00:57:02.419190+00:00, run_duration=1.541825, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:56:00+00:00, data_interval_end=2024-05-25 00:57:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:57:02.429552478Z [2024-05-25T00:57:02.429+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:57:00+00:00, run_after=2024-05-25T00:58:00+00:00 2024-05-25T00:57:02.479298914Z [2024-05-25T00:57:02.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:56:00+00:00 exited with status success for try_number 1 2024-05-25T00:57:02.485293373Z [2024-05-25T00:57:02.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:56:00+00:00, map_index=-1, run_start_date=2024-05-25 00:57:01.720958+00:00, run_end_date=2024-05-25 00:57:02.117047+00:00, run_duration=0.396089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:57:00.953378+00:00, queued_by_job_id=1, pid=7794 2024-05-25T00:57:04.922673724Z [2024-05-25T00:57:04.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:57:04.923295821Z [2024-05-25T00:57:04.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:56:00+00:00, run_id=scheduled__2024-05-25T00:56:00+00:00, run_start_date=2024-05-25 00:57:00.879380+00:00, run_end_date=2024-05-25 00:57:04.922764+00:00, run_duration=4.043384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:56:00+00:00, data_interval_end=2024-05-25 00:57:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:57:04.934598712Z [2024-05-25T00:57:04.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:57:00+00:00, run_after=2024-05-25T00:58:00+00:00 2024-05-25T00:57:04.940772017Z [2024-05-25T00:57:04.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:57:04.941325828Z [2024-05-25T00:57:04.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:56:00+00:00, run_id=scheduled__2024-05-25T00:56:00+00:00, run_start_date=2024-05-25 00:57:00.880716+00:00, run_end_date=2024-05-25 00:57:04.940660+00:00, run_duration=4.059944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:56:00+00:00, data_interval_end=2024-05-25 00:57:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:57:04.950483623Z [2024-05-25T00:57:04.950+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:57:00+00:00, run_after=2024-05-25T00:58:00+00:00 2024-05-25T00:57:05.002375614Z [2024-05-25T00:57:05.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:56:00+00:00 exited with status success for try_number 1 2024-05-25T00:57:05.008927117Z [2024-05-25T00:57:05.008+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:56:00+00:00, map_index=-1, run_start_date=2024-05-25 00:57:02.834222+00:00, run_end_date=2024-05-25 00:57:04.499227+00:00, run_duration=1.665005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:57:00.953378+00:00, queued_by_job_id=1, pid=7813 2024-05-25T00:57:06.097332222Z [2024-05-25T00:57:06.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:56:00+00:00 exited with status success for try_number 1 2024-05-25T00:57:06.105072356Z [2024-05-25T00:57:06.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:56:00+00:00, map_index=-1, run_start_date=2024-05-25 00:57:02.792587+00:00, run_end_date=2024-05-25 00:57:04.881328+00:00, run_duration=2.088741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:57:00.953378+00:00, queued_by_job_id=1, pid=7812 2024-05-25T00:58:00.867401495Z [2024-05-25T00:58:00.866+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:58:00+00:00, run_after=2024-05-25T00:59:00+00:00 2024-05-25T00:58:00.876782699Z [2024-05-25T00:58:00.876+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:58:00.889248137Z [2024-05-25T00:58:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:58:00+00:00, run_after=2024-05-25T00:59:00+00:00 2024-05-25T00:58:00.896131926Z [2024-05-25T00:58:00.895+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:58:00.977513690Z [2024-05-25T00:58:00.977+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T00:58:00.977540206Z 2024-05-25T00:58:00.977552286Z 2024-05-25T00:58:00.977555766Z 2024-05-25T00:58:00.977558876Z 2024-05-25T00:58:00.977730733Z [2024-05-25T00:58:00.977+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T00:58:00.977979785Z [2024-05-25T00:58:00.977+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:58:00.978339173Z [2024-05-25T00:58:00.978+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:58:00.978691758Z [2024-05-25T00:58:00.978+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:58:00.980017838Z [2024-05-25T00:58:00.979+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:58:00.980035039Z 2024-05-25T00:58:00.980041578Z 2024-05-25T00:58:00.980046752Z 2024-05-25T00:58:00.980052619Z 2024-05-25T00:58:00.986218162Z [2024-05-25T00:58:00.985+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:58:00.986417518Z [2024-05-25T00:58:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:58:00.986743921Z [2024-05-25T00:58:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:58:00.986832807Z [2024-05-25T00:58:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:58:00.986987570Z [2024-05-25T00:58:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:58:00.987040670Z [2024-05-25T00:58:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:58:00.987207851Z [2024-05-25T00:58:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:58:00.987272486Z [2024-05-25T00:58:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:58:01.438437705Z [2024-05-25T00:58:01.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:56:00+00:00 exited with status queued for try_number 1 2024-05-25T00:58:01.438664647Z [2024-05-25T00:58:01.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:57:00+00:00 exited with status queued for try_number 1 2024-05-25T00:58:01.438732796Z [2024-05-25T00:58:01.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:57:00+00:00 exited with status queued for try_number 1 2024-05-25T00:58:01.438813972Z [2024-05-25T00:58:01.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:57:00+00:00 exited with status queued for try_number 1 2024-05-25T00:58:01.458570767Z [2024-05-25T00:58:01.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f35b42c-9b1d-442d-b27b-b8328624b3fd 2024-05-25T00:58:01.458617248Z [2024-05-25T00:58:01.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2297d5de-d539-4e95-a7ea-0ad37f27e450 2024-05-25T00:58:01.458752767Z [2024-05-25T00:58:01.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 154470c0-8323-4577-85da-37f95039c197 2024-05-25T00:58:01.458841523Z [2024-05-25T00:58:01.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25ece9df-df9a-4f22-a2cc-2e4d3a883dd9 2024-05-25T00:58:02.759568514Z [2024-05-25T00:58:02.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:58:02.759744450Z [2024-05-25T00:58:02.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:56:00+00:00, run_id=scheduled__2024-05-25T00:56:00+00:00, run_start_date=2024-05-25 00:58:00.909550+00:00, run_end_date=2024-05-25 00:58:02.759436+00:00, run_duration=1.849886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:56:00+00:00, data_interval_end=2024-05-25 00:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T00:58:02.771344537Z [2024-05-25T00:58:02.770+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T00:58:00+00:00, run_after=2024-05-25T01:00:00+00:00 2024-05-25T00:58:02.783097662Z [2024-05-25T00:58:02.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:58:02.783568797Z [2024-05-25T00:58:02.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:57:00+00:00, run_id=scheduled__2024-05-25T00:57:00+00:00, run_start_date=2024-05-25 00:58:00.911295+00:00, run_end_date=2024-05-25 00:58:02.782950+00:00, run_duration=1.871655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:57:00+00:00, data_interval_end=2024-05-25 00:58:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:58:02.803619730Z [2024-05-25T00:58:02.803+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:58:00+00:00, run_after=2024-05-25T00:59:00+00:00 2024-05-25T00:58:02.880164171Z [2024-05-25T00:58:02.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:56:00+00:00 exited with status success for try_number 1 2024-05-25T00:58:02.889252442Z [2024-05-25T00:58:02.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:56:00+00:00, map_index=-1, run_start_date=2024-05-25 00:58:02.306882+00:00, run_end_date=2024-05-25 00:58:02.673886+00:00, run_duration=0.367004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:58:00.982818+00:00, queued_by_job_id=1, pid=7847 2024-05-25T00:58:04.003751790Z [2024-05-25T00:58:03.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:57:00+00:00 exited with status success for try_number 1 2024-05-25T00:58:04.008103329Z [2024-05-25T00:58:04.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:57:00+00:00, map_index=-1, run_start_date=2024-05-25 00:58:02.134948+00:00, run_end_date=2024-05-25 00:58:02.712842+00:00, run_duration=0.577894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:58:00.982818+00:00, queued_by_job_id=1, pid=7846 2024-05-25T00:58:04.872568976Z [2024-05-25T00:58:04.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:58:04.873320795Z [2024-05-25T00:58:04.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:57:00+00:00, run_id=scheduled__2024-05-25T00:57:00+00:00, run_start_date=2024-05-25 00:58:00.912811+00:00, run_end_date=2024-05-25 00:58:04.872748+00:00, run_duration=3.959937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:57:00+00:00, data_interval_end=2024-05-25 00:58:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:58:04.886525967Z [2024-05-25T00:58:04.886+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:58:00+00:00, run_after=2024-05-25T00:59:00+00:00 2024-05-25T00:58:04.951910920Z [2024-05-25T00:58:04.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:57:00+00:00 exited with status success for try_number 1 2024-05-25T00:58:04.960867701Z [2024-05-25T00:58:04.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:57:00+00:00, map_index=-1, run_start_date=2024-05-25 00:58:03.337994+00:00, run_end_date=2024-05-25 00:58:04.558943+00:00, run_duration=1.220949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:58:00.982818+00:00, queued_by_job_id=1, pid=7870 2024-05-25T00:58:05.284797317Z [2024-05-25T00:58:05.284+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:58:05.285183892Z [2024-05-25T00:58:05.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:57:00+00:00, run_id=scheduled__2024-05-25T00:57:00+00:00, run_start_date=2024-05-25 00:58:00.914324+00:00, run_end_date=2024-05-25 00:58:05.284731+00:00, run_duration=4.370407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:57:00+00:00, data_interval_end=2024-05-25 00:58:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:58:05.294910105Z [2024-05-25T00:58:05.294+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:58:00+00:00, run_after=2024-05-25T00:59:00+00:00 2024-05-25T00:58:05.335244358Z [2024-05-25T00:58:05.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:57:00+00:00 exited with status success for try_number 1 2024-05-25T00:58:05.341402705Z [2024-05-25T00:58:05.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:57:00+00:00, map_index=-1, run_start_date=2024-05-25 00:58:03.469718+00:00, run_end_date=2024-05-25 00:58:05.076452+00:00, run_duration=1.606734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:58:00.982818+00:00, queued_by_job_id=1, pid=7871 2024-05-25T00:59:00.777589851Z [2024-05-25T00:59:00.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:59:00+00:00, run_after=2024-05-25T01:00:00+00:00 2024-05-25T00:59:00.792043643Z [2024-05-25T00:59:00.791+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:59:00+00:00, run_after=2024-05-25T01:00:00+00:00 2024-05-25T00:59:00.799844076Z [2024-05-25T00:59:00.799+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T00:59:00.872311299Z [2024-05-25T00:59:00.871+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T00:59:00.872353997Z 2024-05-25T00:59:00.872363462Z 2024-05-25T00:59:00.872372925Z 2024-05-25T00:59:00.872425675Z [2024-05-25T00:59:00.872+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:59:00.872610331Z [2024-05-25T00:59:00.872+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T00:59:00.872901551Z [2024-05-25T00:59:00.872+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T00:59:00.873609517Z [2024-05-25T00:59:00.873+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T00:59:00.873633900Z 2024-05-25T00:59:00.873669424Z 2024-05-25T00:59:00.873678306Z 2024-05-25T00:59:00.878191116Z [2024-05-25T00:59:00.877+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:59:00.878733098Z [2024-05-25T00:59:00.878+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:59:00.881757093Z [2024-05-25T00:59:00.881+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:59:00.881928647Z [2024-05-25T00:59:00.881+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:59:00.882237857Z [2024-05-25T00:59:00.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T00:59:00.882404661Z [2024-05-25T00:59:00.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:59:01.142367754Z [2024-05-25T00:59:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:58:00+00:00 exited with status queued for try_number 1 2024-05-25T00:59:01.142545079Z [2024-05-25T00:59:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:58:00+00:00 exited with status queued for try_number 1 2024-05-25T00:59:01.142715192Z [2024-05-25T00:59:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:58:00+00:00 exited with status queued for try_number 1 2024-05-25T00:59:01.155360707Z [2024-05-25T00:59:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff631735-321e-41f5-acd1-1d63f95f505e 2024-05-25T00:59:01.155605974Z [2024-05-25T00:59:01.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53ee711a-18d5-4ed2-babf-cb92bdee9c36 2024-05-25T00:59:01.155924977Z [2024-05-25T00:59:01.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9968e0e5-108a-431e-a7c1-ef14a9a761ea 2024-05-25T00:59:02.343207246Z [2024-05-25T00:59:02.342+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:59:02.344080852Z [2024-05-25T00:59:02.343+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:58:00+00:00, run_id=scheduled__2024-05-25T00:58:00+00:00, run_start_date=2024-05-25 00:59:00.811631+00:00, run_end_date=2024-05-25 00:59:02.343538+00:00, run_duration=1.531907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:58:00+00:00, data_interval_end=2024-05-25 00:59:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T00:59:02.357015233Z [2024-05-25T00:59:02.356+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T00:59:00+00:00, run_after=2024-05-25T01:00:00+00:00 2024-05-25T00:59:02.419656691Z [2024-05-25T00:59:02.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:58:00+00:00 exited with status success for try_number 1 2024-05-25T00:59:02.426686377Z [2024-05-25T00:59:02.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:58:00+00:00, map_index=-1, run_start_date=2024-05-25 00:59:01.723443+00:00, run_end_date=2024-05-25 00:59:02.130459+00:00, run_duration=0.407016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:59:00.874370+00:00, queued_by_job_id=1, pid=7904 2024-05-25T00:59:04.606031281Z [2024-05-25T00:59:04.605+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:59:04.606725451Z [2024-05-25T00:59:04.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:58:00+00:00, run_id=scheduled__2024-05-25T00:58:00+00:00, run_start_date=2024-05-25 00:59:00.812938+00:00, run_end_date=2024-05-25 00:59:04.605964+00:00, run_duration=3.793026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:58:00+00:00, data_interval_end=2024-05-25 00:59:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T00:59:04.644527148Z [2024-05-25T00:59:04.642+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:59:00+00:00, run_after=2024-05-25T01:00:00+00:00 2024-05-25T00:59:04.652123762Z [2024-05-25T00:59:04.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T00:59:04.657734996Z [2024-05-25T00:59:04.657+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:58:00+00:00, run_id=scheduled__2024-05-25T00:58:00+00:00, run_start_date=2024-05-25 00:59:00.814176+00:00, run_end_date=2024-05-25 00:59:04.652026+00:00, run_duration=3.83785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:58:00+00:00, data_interval_end=2024-05-25 00:59:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T00:59:04.679852856Z [2024-05-25T00:59:04.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T00:59:00+00:00, run_after=2024-05-25T01:00:00+00:00 2024-05-25T00:59:04.716793544Z [2024-05-25T00:59:04.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:58:00+00:00 exited with status success for try_number 1 2024-05-25T00:59:04.716959703Z [2024-05-25T00:59:04.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:58:00+00:00 exited with status success for try_number 1 2024-05-25T00:59:04.726971562Z [2024-05-25T00:59:04.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:58:00+00:00, map_index=-1, run_start_date=2024-05-25 00:59:02.684708+00:00, run_end_date=2024-05-25 00:59:04.373627+00:00, run_duration=1.688919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:59:00.874370+00:00, queued_by_job_id=1, pid=7923 2024-05-25T00:59:04.727526400Z [2024-05-25T00:59:04.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:58:00+00:00, map_index=-1, run_start_date=2024-05-25 00:59:02.674047+00:00, run_end_date=2024-05-25 00:59:03.912586+00:00, run_duration=1.238539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 00:59:00.874370+00:00, queued_by_job_id=1, pid=7922 2024-05-25T01:00:00.155177205Z [2024-05-25T01:00:00.154+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:00:00.169840031Z [2024-05-25T01:00:00.169+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:00:00.196108348Z [2024-05-25T01:00:00.195+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:00:00+00:00, run_after=2024-05-25T01:01:00+00:00 2024-05-25T01:00:00.222319718Z [2024-05-25T01:00:00.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:00:00+00:00, run_after=2024-05-25T01:05:00+00:00 2024-05-25T01:00:00.241061296Z [2024-05-25T01:00:00.240+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:00:00+00:00, run_after=2024-05-25T01:01:00+00:00 2024-05-25T01:00:00.356590842Z [2024-05-25T01:00:00.355+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T01:00:00.356647548Z 2024-05-25T01:00:00.356661579Z 2024-05-25T01:00:00.356712824Z 2024-05-25T01:00:00.356725890Z 2024-05-25T01:00:00.356738363Z 2024-05-25T01:00:00.357582202Z [2024-05-25T01:00:00.356+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:00:00.357976578Z [2024-05-25T01:00:00.357+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:00:00.358414120Z [2024-05-25T01:00:00.358+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:00:00.358868967Z [2024-05-25T01:00:00.358+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:00:00.359287962Z [2024-05-25T01:00:00.359+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:00:00.360644479Z [2024-05-25T01:00:00.360+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:00:00.360665661Z 2024-05-25T01:00:00.360673397Z 2024-05-25T01:00:00.360681219Z 2024-05-25T01:00:00.360688023Z 2024-05-25T01:00:00.360694509Z 2024-05-25T01:00:00.368055316Z [2024-05-25T01:00:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:00:00.368439907Z [2024-05-25T01:00:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:00:00.368963300Z [2024-05-25T01:00:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:00:00.369488585Z [2024-05-25T01:00:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:00:00.369936362Z [2024-05-25T01:00:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:00:00.370235155Z [2024-05-25T01:00:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:00:00.371622818Z [2024-05-25T01:00:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:00:00.372806948Z [2024-05-25T01:00:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:00:00.373517871Z [2024-05-25T01:00:00.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:00:00.373635988Z [2024-05-25T01:00:00.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:00:00.922557499Z [2024-05-25T01:00:00.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status queued for try_number 1 2024-05-25T01:00:00.924716568Z [2024-05-25T01:00:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:58:00+00:00 exited with status queued for try_number 1 2024-05-25T01:00:00.924969833Z [2024-05-25T01:00:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:59:00+00:00 exited with status queued for try_number 1 2024-05-25T01:00:00.925182177Z [2024-05-25T01:00:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:59:00+00:00 exited with status queued for try_number 1 2024-05-25T01:00:00.925408232Z [2024-05-25T01:00:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:59:00+00:00 exited with status queued for try_number 1 2024-05-25T01:00:00.938830691Z [2024-05-25T01:00:00.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to 359132c3-b3fe-4419-ab1b-5efb6cc30d06 2024-05-25T01:00:00.939173474Z [2024-05-25T01:00:00.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1830fd1d-3eb2-4049-92ca-1c2ef7a35ddb 2024-05-25T01:00:00.939435028Z [2024-05-25T01:00:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93ffc538-757f-4484-a94f-166a51388402 2024-05-25T01:00:00.939703194Z [2024-05-25T01:00:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1da219de-2128-4855-91dd-61c7cd2e2599 2024-05-25T01:00:00.939980227Z [2024-05-25T01:00:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to a804d232-81f4-4cff-995e-f0499cada1ae 2024-05-25T01:00:02.091220660Z [2024-05-25T01:00:02.090+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:00:02.091459466Z [2024-05-25T01:00:02.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 00:58:00+00:00, run_id=scheduled__2024-05-25T00:58:00+00:00, run_start_date=2024-05-25 01:00:00.256295+00:00, run_end_date=2024-05-25 01:00:02.091106+00:00, run_duration=1.834811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:58:00+00:00, data_interval_end=2024-05-25 01:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:00:02.100140295Z [2024-05-25T01:00:02.099+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:00:00+00:00, run_after=2024-05-25T01:02:00+00:00 2024-05-25T01:00:02.120388502Z [2024-05-25T01:00:02.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:00:02.120604335Z [2024-05-25T01:00:02.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 00:59:00+00:00, run_id=scheduled__2024-05-25T00:59:00+00:00, run_start_date=2024-05-25 01:00:00.257380+00:00, run_end_date=2024-05-25 01:00:02.120297+00:00, run_duration=1.862917, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:59:00+00:00, data_interval_end=2024-05-25 01:00:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:00:02.131933015Z [2024-05-25T01:00:02.131+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:00:00+00:00, run_after=2024-05-25T01:01:00+00:00 2024-05-25T01:00:02.193123505Z [2024-05-25T01:00:02.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T00:58:00+00:00 exited with status success for try_number 1 2024-05-25T01:00:02.193576846Z [2024-05-25T01:00:02.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:59:00+00:00 exited with status success for try_number 1 2024-05-25T01:00:02.201446144Z [2024-05-25T01:00:02.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T00:58:00+00:00, map_index=-1, run_start_date=2024-05-25 01:00:01.303745+00:00, run_end_date=2024-05-25 01:00:01.762006+00:00, run_duration=0.458261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:00:00.363124+00:00, queued_by_job_id=1, pid=7957 2024-05-25T01:00:02.201468840Z [2024-05-25T01:00:02.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:59:00+00:00, map_index=-1, run_start_date=2024-05-25 01:00:01.443787+00:00, run_end_date=2024-05-25 01:00:01.934511+00:00, run_duration=0.490724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:00:00.363124+00:00, queued_by_job_id=1, pid=7958 2024-05-25T01:00:04.437857078Z [2024-05-25T01:00:04.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:00:04.438259036Z [2024-05-25T01:00:04.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:59:00+00:00, run_id=scheduled__2024-05-25T00:59:00+00:00, run_start_date=2024-05-25 01:00:00.258357+00:00, run_end_date=2024-05-25 01:00:04.437770+00:00, run_duration=4.179413, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:59:00+00:00, data_interval_end=2024-05-25 01:00:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:00:04.452579393Z [2024-05-25T01:00:04.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:00:00+00:00, run_after=2024-05-25T01:01:00+00:00 2024-05-25T01:00:04.494802430Z [2024-05-25T01:00:04.494+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:00:04.494826620Z 2024-05-25T01:00:04.494942382Z [2024-05-25T01:00:04.494+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:00:04.495541855Z [2024-05-25T01:00:04.495+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:00:04.495551814Z 2024-05-25T01:00:04.498312089Z [2024-05-25T01:00:04.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:00:04.498447098Z [2024-05-25T01:00:04.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:00:04.556876477Z [2024-05-25T01:00:04.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status queued for try_number 1 2024-05-25T01:00:04.557029892Z [2024-05-25T01:00:04.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status success for try_number 1 2024-05-25T01:00:04.557150579Z [2024-05-25T01:00:04.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:59:00+00:00 exited with status success for try_number 1 2024-05-25T01:00:04.564084137Z [2024-05-25T01:00:04.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7b13c43-04b5-4f48-83c1-b5329d38220b 2024-05-25T01:00:04.564380271Z [2024-05-25T01:00:04.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T00:55:00+00:00, map_index=-1, run_start_date=2024-05-25 01:00:02.829562+00:00, run_end_date=2024-05-25 01:00:03.304031+00:00, run_duration=0.474469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:00:00.363124+00:00, queued_by_job_id=1, pid=7985 2024-05-25T01:00:04.564688800Z [2024-05-25T01:00:04.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:59:00+00:00, map_index=-1, run_start_date=2024-05-25 01:00:03.095665+00:00, run_end_date=2024-05-25 01:00:04.398159+00:00, run_duration=1.302494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:00:00.363124+00:00, queued_by_job_id=1, pid=7989 2024-05-25T01:00:05.732478132Z [2024-05-25T01:00:05.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:00:05.732990833Z [2024-05-25T01:00:05.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:59:00+00:00, run_id=scheduled__2024-05-25T00:59:00+00:00, run_start_date=2024-05-25 01:00:00.259287+00:00, run_end_date=2024-05-25 01:00:05.732333+00:00, run_duration=5.473046, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:59:00+00:00, data_interval_end=2024-05-25 01:00:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:00:05.743464954Z [2024-05-25T01:00:05.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:00:00+00:00, run_after=2024-05-25T01:01:00+00:00 2024-05-25T01:00:05.801801166Z [2024-05-25T01:00:05.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T00:59:00+00:00 exited with status success for try_number 1 2024-05-25T01:00:05.812978028Z [2024-05-25T01:00:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T00:59:00+00:00, map_index=-1, run_start_date=2024-05-25 01:00:02.985475+00:00, run_end_date=2024-05-25 01:00:04.614527+00:00, run_duration=1.629052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:00:00.363124+00:00, queued_by_job_id=1, pid=7988 2024-05-25T01:00:06.988609353Z [2024-05-25T01:00:06.988+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:00:06.988636950Z 2024-05-25T01:00:06.988878346Z [2024-05-25T01:00:06.988+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:00:06.989852593Z [2024-05-25T01:00:06.989+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:00:06.989879426Z 2024-05-25T01:00:06.992960144Z [2024-05-25T01:00:06.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T00:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:00:06.993305679Z [2024-05-25T01:00:06.993+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:00:07.045874665Z [2024-05-25T01:00:07.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status queued for try_number 1 2024-05-25T01:00:07.045962609Z [2024-05-25T01:00:07.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status success for try_number 1 2024-05-25T01:00:07.052782156Z [2024-05-25T01:00:07.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d356133-7d56-4698-a387-a551bfab7ebc 2024-05-25T01:00:07.052943359Z [2024-05-25T01:00:07.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T00:55:00+00:00, map_index=-1, run_start_date=2024-05-25 01:00:06.263969+00:00, run_end_date=2024-05-25 01:00:06.685828+00:00, run_duration=0.421859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:00:04.495970+00:00, queued_by_job_id=1, pid=8022 2024-05-25T01:00:10.374842616Z [2024-05-25T01:00:10.373+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:00:10.374893712Z 2024-05-25T01:00:10.374904543Z [2024-05-25T01:00:10.374+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:00:10.376280044Z [2024-05-25T01:00:10.375+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:00:10.376302158Z 2024-05-25T01:00:10.380288341Z [2024-05-25T01:00:10.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:00:10.380478915Z [2024-05-25T01:00:10.380+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:00:10.463779465Z [2024-05-25T01:00:10.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status queued for try_number 1 2024-05-25T01:00:10.464036487Z [2024-05-25T01:00:10.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status success for try_number 1 2024-05-25T01:00:10.474518232Z [2024-05-25T01:00:10.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33041e7d-727e-42a2-9453-36a637d881f2 2024-05-25T01:00:10.475247868Z [2024-05-25T01:00:10.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T00:55:00+00:00, map_index=0, run_start_date=2024-05-25 01:00:08.827503+00:00, run_end_date=2024-05-25 01:00:09.236133+00:00, run_duration=0.40863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:00:06.990325+00:00, queued_by_job_id=1, pid=8033 2024-05-25T01:00:13.569294325Z [2024-05-25T01:00:13.568+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:00:13.569536363Z [2024-05-25T01:00:13.569+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 00:55:00+00:00, run_id=scheduled__2024-05-25T00:55:00+00:00, run_start_date=2024-05-25 01:00:00.254837+00:00, run_end_date=2024-05-25 01:00:13.569141+00:00, run_duration=13.314304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 00:55:00+00:00, data_interval_end=2024-05-25 01:00:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T01:00:13.575370352Z [2024-05-25T01:00:13.575+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:00:00+00:00, run_after=2024-05-25T01:05:00+00:00 2024-05-25T01:00:13.614690518Z [2024-05-25T01:00:13.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T00:55:00+00:00 exited with status success for try_number 1 2024-05-25T01:00:13.620772608Z [2024-05-25T01:00:13.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T00:55:00+00:00, map_index=-1, run_start_date=2024-05-25 01:00:12.074353+00:00, run_end_date=2024-05-25 01:00:12.470562+00:00, run_duration=0.396209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:00:10.376913+00:00, queued_by_job_id=1, pid=8041 2024-05-25T01:00:28.780528273Z [2024-05-25T01:00:28.779+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T01:01:00.712771950Z [2024-05-25T01:01:00.711+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:01:00+00:00, run_after=2024-05-25T01:02:00+00:00 2024-05-25T01:01:00.743171924Z [2024-05-25T01:01:00.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:01:00+00:00, run_after=2024-05-25T01:02:00+00:00 2024-05-25T01:01:00.753526611Z [2024-05-25T01:01:00.753+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:01:00.840696963Z [2024-05-25T01:01:00.840+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:01:00.840741818Z 2024-05-25T01:01:00.840745848Z 2024-05-25T01:01:00.840749765Z 2024-05-25T01:01:00.841124342Z [2024-05-25T01:01:00.840+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:01:00.841394563Z [2024-05-25T01:01:00.841+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:01:00.841697274Z [2024-05-25T01:01:00.841+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:01:00.842465443Z [2024-05-25T01:01:00.842+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:01:00.842480805Z 2024-05-25T01:01:00.842486279Z 2024-05-25T01:01:00.842491338Z 2024-05-25T01:01:00.846545177Z [2024-05-25T01:01:00.846+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:01:00.846845258Z [2024-05-25T01:01:00.846+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:01:00.847236310Z [2024-05-25T01:01:00.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:01:00.847521675Z [2024-05-25T01:01:00.847+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:01:00.847972674Z [2024-05-25T01:01:00.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:01:00.848250230Z [2024-05-25T01:01:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:01:01.107107521Z [2024-05-25T01:01:01.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status queued for try_number 1 2024-05-25T01:01:01.107146607Z [2024-05-25T01:01:01.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status queued for try_number 1 2024-05-25T01:01:01.107271097Z [2024-05-25T01:01:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status queued for try_number 1 2024-05-25T01:01:01.123646420Z [2024-05-25T01:01:01.123+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13be9e58-8088-40d4-840c-3f0ae5472146 2024-05-25T01:01:01.123790522Z [2024-05-25T01:01:01.123+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb7777b3-6307-4215-854b-7f4288588865 2024-05-25T01:01:01.123915227Z [2024-05-25T01:01:01.123+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91ff0b85-ad06-4952-afea-9a8898632021 2024-05-25T01:01:02.402345799Z [2024-05-25T01:01:02.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:01:02.402586111Z [2024-05-25T01:01:02.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:00:00+00:00, run_id=scheduled__2024-05-25T01:00:00+00:00, run_start_date=2024-05-25 01:01:00.765881+00:00, run_end_date=2024-05-25 01:01:02.402265+00:00, run_duration=1.636384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:00:00+00:00, data_interval_end=2024-05-25 01:01:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:01:02.413361949Z [2024-05-25T01:01:02.413+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:01:00+00:00, run_after=2024-05-25T01:02:00+00:00 2024-05-25T01:01:02.467576554Z [2024-05-25T01:01:02.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status success for try_number 1 2024-05-25T01:01:02.474620961Z [2024-05-25T01:01:02.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:00:00+00:00, map_index=-1, run_start_date=2024-05-25 01:01:01.694906+00:00, run_end_date=2024-05-25 01:01:02.139889+00:00, run_duration=0.444983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:01:00.843641+00:00, queued_by_job_id=1, pid=8050 2024-05-25T01:01:05.546669181Z [2024-05-25T01:01:05.546+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:01:05.547132950Z [2024-05-25T01:01:05.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:00:00+00:00, run_id=scheduled__2024-05-25T01:00:00+00:00, run_start_date=2024-05-25 01:01:00.769342+00:00, run_end_date=2024-05-25 01:01:05.546794+00:00, run_duration=4.777452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:00:00+00:00, data_interval_end=2024-05-25 01:01:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:01:05.558370181Z [2024-05-25T01:01:05.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:01:00+00:00, run_after=2024-05-25T01:02:00+00:00 2024-05-25T01:01:05.565704749Z [2024-05-25T01:01:05.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:01:05.566135760Z [2024-05-25T01:01:05.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:00:00+00:00, run_id=scheduled__2024-05-25T01:00:00+00:00, run_start_date=2024-05-25 01:01:00.772454+00:00, run_end_date=2024-05-25 01:01:05.565810+00:00, run_duration=4.793356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:00:00+00:00, data_interval_end=2024-05-25 01:01:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:01:05.575936396Z [2024-05-25T01:01:05.575+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:01:00+00:00, run_after=2024-05-25T01:02:00+00:00 2024-05-25T01:01:05.628355826Z [2024-05-25T01:01:05.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status success for try_number 1 2024-05-25T01:01:05.628825116Z [2024-05-25T01:01:05.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status success for try_number 1 2024-05-25T01:01:05.639052849Z [2024-05-25T01:01:05.638+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:00:00+00:00, map_index=-1, run_start_date=2024-05-25 01:01:02.968560+00:00, run_end_date=2024-05-25 01:01:04.845810+00:00, run_duration=1.87725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:01:00.843641+00:00, queued_by_job_id=1, pid=8068 2024-05-25T01:01:05.639523631Z [2024-05-25T01:01:05.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:00:00+00:00, map_index=-1, run_start_date=2024-05-25 01:01:02.977321+00:00, run_end_date=2024-05-25 01:01:05.347183+00:00, run_duration=2.369862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:01:00.843641+00:00, queued_by_job_id=1, pid=8069 2024-05-25T01:02:00.343561141Z [2024-05-25T01:02:00.342+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:02:00.351192487Z [2024-05-25T01:02:00.350+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:02:00.366039388Z [2024-05-25T01:02:00.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:02:00+00:00, run_after=2024-05-25T01:03:00+00:00 2024-05-25T01:02:00.379045916Z [2024-05-25T01:02:00.378+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:02:00+00:00, run_after=2024-05-25T01:03:00+00:00 2024-05-25T01:02:00.473124205Z [2024-05-25T01:02:00.472+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:02:00.473204356Z 2024-05-25T01:02:00.473243833Z 2024-05-25T01:02:00.473249985Z 2024-05-25T01:02:00.473255843Z 2024-05-25T01:02:00.473337483Z [2024-05-25T01:02:00.473+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:02:00.473522096Z [2024-05-25T01:02:00.473+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:02:00.473710159Z [2024-05-25T01:02:00.473+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:02:00.473938523Z [2024-05-25T01:02:00.473+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:02:00.474627043Z [2024-05-25T01:02:00.474+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:02:00.474658393Z 2024-05-25T01:02:00.474666347Z 2024-05-25T01:02:00.474673131Z 2024-05-25T01:02:00.474679266Z 2024-05-25T01:02:00.481163735Z [2024-05-25T01:02:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:02:00.481692502Z [2024-05-25T01:02:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:02:00.482445743Z [2024-05-25T01:02:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:02:00.482949812Z [2024-05-25T01:02:00.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:02:00.483954411Z [2024-05-25T01:02:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:02:00.484348393Z [2024-05-25T01:02:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:02:00.485139413Z [2024-05-25T01:02:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:02:00.485492636Z [2024-05-25T01:02:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:02:00.882450935Z [2024-05-25T01:02:00.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status queued for try_number 1 2024-05-25T01:02:00.882500413Z [2024-05-25T01:02:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:01:00+00:00 exited with status queued for try_number 1 2024-05-25T01:02:00.882521265Z [2024-05-25T01:02:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:01:00+00:00 exited with status queued for try_number 1 2024-05-25T01:02:00.882603505Z [2024-05-25T01:02:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:01:00+00:00 exited with status queued for try_number 1 2024-05-25T01:02:00.898670073Z [2024-05-25T01:02:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c575c81-b2ca-4e40-ad68-e91e06a4240e 2024-05-25T01:02:00.898716769Z [2024-05-25T01:02:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26ac7dd4-7ced-4597-ad72-107869ad9bee 2024-05-25T01:02:00.898848115Z [2024-05-25T01:02:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a05a88f-f71c-4412-9b8e-5e502eedcdb0 2024-05-25T01:02:00.898952285Z [2024-05-25T01:02:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 947c03a8-c417-4986-bdd3-b83119b0d0a0 2024-05-25T01:02:02.111612192Z [2024-05-25T01:02:02.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:02:02.112161739Z [2024-05-25T01:02:02.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:00:00+00:00, run_id=scheduled__2024-05-25T01:00:00+00:00, run_start_date=2024-05-25 01:02:00.387959+00:00, run_end_date=2024-05-25 01:02:02.111437+00:00, run_duration=1.723478, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:00:00+00:00, data_interval_end=2024-05-25 01:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:02:02.120865247Z [2024-05-25T01:02:02.120+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:02:00+00:00, run_after=2024-05-25T01:04:00+00:00 2024-05-25T01:02:02.127938766Z [2024-05-25T01:02:02.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:02:02.128571810Z [2024-05-25T01:02:02.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:01:00+00:00, run_id=scheduled__2024-05-25T01:01:00+00:00, run_start_date=2024-05-25 01:02:00.389069+00:00, run_end_date=2024-05-25 01:02:02.127833+00:00, run_duration=1.738764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:01:00+00:00, data_interval_end=2024-05-25 01:02:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:02:02.140689954Z [2024-05-25T01:02:02.140+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:02:00+00:00, run_after=2024-05-25T01:03:00+00:00 2024-05-25T01:02:02.200642616Z [2024-05-25T01:02:02.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status success for try_number 1 2024-05-25T01:02:02.200666733Z [2024-05-25T01:02:02.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:01:00+00:00 exited with status success for try_number 1 2024-05-25T01:02:02.208733189Z [2024-05-25T01:02:02.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:00:00+00:00, map_index=-1, run_start_date=2024-05-25 01:02:01.521934+00:00, run_end_date=2024-05-25 01:02:01.886812+00:00, run_duration=0.364878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:02:00.476179+00:00, queued_by_job_id=1, pid=8102 2024-05-25T01:02:02.208758311Z [2024-05-25T01:02:02.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:01:00+00:00, map_index=-1, run_start_date=2024-05-25 01:02:01.208119+00:00, run_end_date=2024-05-25 01:02:01.669951+00:00, run_duration=0.461832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:02:00.476179+00:00, queued_by_job_id=1, pid=8101 2024-05-25T01:02:05.483840023Z [2024-05-25T01:02:05.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:02:05.484292988Z [2024-05-25T01:02:05.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:01:00+00:00, run_id=scheduled__2024-05-25T01:01:00+00:00, run_start_date=2024-05-25 01:02:00.390109+00:00, run_end_date=2024-05-25 01:02:05.483626+00:00, run_duration=5.093517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:01:00+00:00, data_interval_end=2024-05-25 01:02:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:02:05.514239988Z [2024-05-25T01:02:05.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:02:00+00:00, run_after=2024-05-25T01:03:00+00:00 2024-05-25T01:02:05.524438932Z [2024-05-25T01:02:05.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:02:05.524825177Z [2024-05-25T01:02:05.524+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:01:00+00:00, run_id=scheduled__2024-05-25T01:01:00+00:00, run_start_date=2024-05-25 01:02:00.390995+00:00, run_end_date=2024-05-25 01:02:05.524284+00:00, run_duration=5.133289, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:01:00+00:00, data_interval_end=2024-05-25 01:02:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:02:05.537101399Z [2024-05-25T01:02:05.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:02:00+00:00, run_after=2024-05-25T01:03:00+00:00 2024-05-25T01:02:05.593977375Z [2024-05-25T01:02:05.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:01:00+00:00 exited with status success for try_number 1 2024-05-25T01:02:05.594226878Z [2024-05-25T01:02:05.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:01:00+00:00 exited with status success for try_number 1 2024-05-25T01:02:05.613729754Z [2024-05-25T01:02:05.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:01:00+00:00, map_index=-1, run_start_date=2024-05-25 01:02:02.531771+00:00, run_end_date=2024-05-25 01:02:04.283003+00:00, run_duration=1.751232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:02:00.476179+00:00, queued_by_job_id=1, pid=8125 2024-05-25T01:02:05.614471915Z [2024-05-25T01:02:05.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:01:00+00:00, map_index=-1, run_start_date=2024-05-25 01:02:02.582039+00:00, run_end_date=2024-05-25 01:02:04.840598+00:00, run_duration=2.258559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:02:00.476179+00:00, queued_by_job_id=1, pid=8126 2024-05-25T01:03:00.270033656Z [2024-05-25T01:03:00.269+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:03:00.293419491Z [2024-05-25T01:03:00.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:03:00+00:00, run_after=2024-05-25T01:04:00+00:00 2024-05-25T01:03:00.310373170Z [2024-05-25T01:03:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:03:00+00:00, run_after=2024-05-25T01:04:00+00:00 2024-05-25T01:03:00.374899486Z [2024-05-25T01:03:00.374+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:03:00.374928040Z 2024-05-25T01:03:00.374931989Z 2024-05-25T01:03:00.374935088Z 2024-05-25T01:03:00.375057014Z [2024-05-25T01:03:00.374+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:03:00.375384496Z [2024-05-25T01:03:00.375+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:03:00.375605171Z [2024-05-25T01:03:00.375+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:03:00.376899437Z [2024-05-25T01:03:00.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:03:00.376911907Z 2024-05-25T01:03:00.376915361Z 2024-05-25T01:03:00.376918369Z 2024-05-25T01:03:00.384376304Z [2024-05-25T01:03:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:03:00.384564053Z [2024-05-25T01:03:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:03:00.384921461Z [2024-05-25T01:03:00.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:03:00.385246552Z [2024-05-25T01:03:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:03:00.385631924Z [2024-05-25T01:03:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:03:00.385782784Z [2024-05-25T01:03:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:03:00.618361463Z [2024-05-25T01:03:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:02:00+00:00 exited with status queued for try_number 1 2024-05-25T01:03:00.618400892Z [2024-05-25T01:03:00.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:02:00+00:00 exited with status queued for try_number 1 2024-05-25T01:03:00.618422994Z [2024-05-25T01:03:00.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:02:00+00:00 exited with status queued for try_number 1 2024-05-25T01:03:00.627892516Z [2024-05-25T01:03:00.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4363e459-f742-44b9-86c7-c4aaccfacea0 2024-05-25T01:03:00.628579924Z [2024-05-25T01:03:00.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41d9ae71-fc88-4242-8dd6-270cecf20f5d 2024-05-25T01:03:00.628821373Z [2024-05-25T01:03:00.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bd438ac-74a9-4bf9-9d3a-bf63dc5eee47 2024-05-25T01:03:01.790139044Z [2024-05-25T01:03:01.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:03:01.790848543Z [2024-05-25T01:03:01.790+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:02:00+00:00, run_id=scheduled__2024-05-25T01:02:00+00:00, run_start_date=2024-05-25 01:03:00.323148+00:00, run_end_date=2024-05-25 01:03:01.789964+00:00, run_duration=1.466816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:02:00+00:00, data_interval_end=2024-05-25 01:03:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:03:01.800729591Z [2024-05-25T01:03:01.800+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:03:00+00:00, run_after=2024-05-25T01:04:00+00:00 2024-05-25T01:03:01.858581245Z [2024-05-25T01:03:01.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:02:00+00:00 exited with status success for try_number 1 2024-05-25T01:03:01.869945484Z [2024-05-25T01:03:01.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:02:00+00:00, map_index=-1, run_start_date=2024-05-25 01:03:01.195139+00:00, run_end_date=2024-05-25 01:03:01.586249+00:00, run_duration=0.39111, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:03:00.378487+00:00, queued_by_job_id=1, pid=8158 2024-05-25T01:03:04.035137644Z [2024-05-25T01:03:04.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:03:04.035343150Z [2024-05-25T01:03:04.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:02:00+00:00, run_id=scheduled__2024-05-25T01:02:00+00:00, run_start_date=2024-05-25 01:03:00.324368+00:00, run_end_date=2024-05-25 01:03:04.034968+00:00, run_duration=3.7106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:02:00+00:00, data_interval_end=2024-05-25 01:03:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:03:04.043561569Z [2024-05-25T01:03:04.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:03:00+00:00, run_after=2024-05-25T01:04:00+00:00 2024-05-25T01:03:04.050197100Z [2024-05-25T01:03:04.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:03:04.050228209Z [2024-05-25T01:03:04.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:02:00+00:00, run_id=scheduled__2024-05-25T01:02:00+00:00, run_start_date=2024-05-25 01:03:00.325636+00:00, run_end_date=2024-05-25 01:03:04.048993+00:00, run_duration=3.723357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:02:00+00:00, data_interval_end=2024-05-25 01:03:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:03:04.058053489Z [2024-05-25T01:03:04.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:03:00+00:00, run_after=2024-05-25T01:04:00+00:00 2024-05-25T01:03:04.093950015Z [2024-05-25T01:03:04.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:02:00+00:00 exited with status success for try_number 1 2024-05-25T01:03:04.094052761Z [2024-05-25T01:03:04.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:02:00+00:00 exited with status success for try_number 1 2024-05-25T01:03:04.103951998Z [2024-05-25T01:03:04.103+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:02:00+00:00, map_index=-1, run_start_date=2024-05-25 01:03:02.158469+00:00, run_end_date=2024-05-25 01:03:03.571427+00:00, run_duration=1.412958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:03:00.378487+00:00, queued_by_job_id=1, pid=8176 2024-05-25T01:03:04.104801257Z [2024-05-25T01:03:04.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:02:00+00:00, map_index=-1, run_start_date=2024-05-25 01:03:02.343937+00:00, run_end_date=2024-05-25 01:03:03.914140+00:00, run_duration=1.570203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:03:00.378487+00:00, queued_by_job_id=1, pid=8177 2024-05-25T01:04:00.905570027Z [2024-05-25T01:04:00.904+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:04:00.914658676Z [2024-05-25T01:04:00.914+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:04:00.929424271Z [2024-05-25T01:04:00.928+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:04:00+00:00, run_after=2024-05-25T01:05:00+00:00 2024-05-25T01:04:00.943971399Z [2024-05-25T01:04:00.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:04:00+00:00, run_after=2024-05-25T01:05:00+00:00 2024-05-25T01:04:01.040030135Z [2024-05-25T01:04:01.039+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:04:01.040066906Z 2024-05-25T01:04:01.040079920Z 2024-05-25T01:04:01.040086296Z 2024-05-25T01:04:01.040091592Z 2024-05-25T01:04:01.040375174Z [2024-05-25T01:04:01.039+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:04:01.041091036Z [2024-05-25T01:04:01.040+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:04:01.042052609Z [2024-05-25T01:04:01.041+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:04:01.042071134Z [2024-05-25T01:04:01.041+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:04:01.042926614Z [2024-05-25T01:04:01.042+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:04:01.042946116Z 2024-05-25T01:04:01.042953007Z 2024-05-25T01:04:01.042958955Z 2024-05-25T01:04:01.042964741Z 2024-05-25T01:04:01.047505208Z [2024-05-25T01:04:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:04:01.047570290Z [2024-05-25T01:04:01.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:04:01.047798227Z [2024-05-25T01:04:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:04:01.047900511Z [2024-05-25T01:04:01.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:04:01.048069341Z [2024-05-25T01:04:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:04:01.048141455Z [2024-05-25T01:04:01.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:04:01.048334542Z [2024-05-25T01:04:01.048+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:04:01.048389216Z [2024-05-25T01:04:01.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:04:01.311414909Z [2024-05-25T01:04:01.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:02:00+00:00 exited with status queued for try_number 1 2024-05-25T01:04:01.313609861Z [2024-05-25T01:04:01.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:03:00+00:00 exited with status queued for try_number 1 2024-05-25T01:04:01.313828587Z [2024-05-25T01:04:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:03:00+00:00 exited with status queued for try_number 1 2024-05-25T01:04:01.314010744Z [2024-05-25T01:04:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:03:00+00:00 exited with status queued for try_number 1 2024-05-25T01:04:01.322764311Z [2024-05-25T01:04:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed5f9d80-bd3a-4fc2-8cd7-4d8302a220af 2024-05-25T01:04:01.323009710Z [2024-05-25T01:04:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcbeb40e-c0ca-4542-9b27-efaa7bbae9cf 2024-05-25T01:04:01.323218186Z [2024-05-25T01:04:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9491b5da-08fd-48f7-a398-f5458ec2404d 2024-05-25T01:04:01.323415285Z [2024-05-25T01:04:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 242d5717-94e6-47f0-a69f-ba33e5df1a85 2024-05-25T01:04:02.727159337Z [2024-05-25T01:04:02.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:04:02.727494318Z [2024-05-25T01:04:02.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:02:00+00:00, run_id=scheduled__2024-05-25T01:02:00+00:00, run_start_date=2024-05-25 01:04:00.953852+00:00, run_end_date=2024-05-25 01:04:02.727164+00:00, run_duration=1.773312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:02:00+00:00, data_interval_end=2024-05-25 01:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:04:02.735650912Z [2024-05-25T01:04:02.735+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:04:00+00:00, run_after=2024-05-25T01:06:00+00:00 2024-05-25T01:04:02.742813869Z [2024-05-25T01:04:02.742+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:04:02.743100389Z [2024-05-25T01:04:02.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:03:00+00:00, run_id=scheduled__2024-05-25T01:03:00+00:00, run_start_date=2024-05-25 01:04:00.955026+00:00, run_end_date=2024-05-25 01:04:02.742791+00:00, run_duration=1.787765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:03:00+00:00, data_interval_end=2024-05-25 01:04:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:04:02.754712763Z [2024-05-25T01:04:02.754+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:04:00+00:00, run_after=2024-05-25T01:05:00+00:00 2024-05-25T01:04:02.808923567Z [2024-05-25T01:04:02.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:02:00+00:00 exited with status success for try_number 1 2024-05-25T01:04:02.809103772Z [2024-05-25T01:04:02.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:03:00+00:00 exited with status success for try_number 1 2024-05-25T01:04:02.820418538Z [2024-05-25T01:04:02.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:02:00+00:00, map_index=-1, run_start_date=2024-05-25 01:04:01.910628+00:00, run_end_date=2024-05-25 01:04:02.395720+00:00, run_duration=0.485092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:04:01.044356+00:00, queued_by_job_id=1, pid=8210 2024-05-25T01:04:02.820626468Z [2024-05-25T01:04:02.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:03:00+00:00, map_index=-1, run_start_date=2024-05-25 01:04:01.928247+00:00, run_end_date=2024-05-25 01:04:02.441856+00:00, run_duration=0.513609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:04:01.044356+00:00, queued_by_job_id=1, pid=8211 2024-05-25T01:04:06.096577098Z [2024-05-25T01:04:06.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:04:06.096877962Z [2024-05-25T01:04:06.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:03:00+00:00, run_id=scheduled__2024-05-25T01:03:00+00:00, run_start_date=2024-05-25 01:04:00.956050+00:00, run_end_date=2024-05-25 01:04:06.096413+00:00, run_duration=5.140363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:03:00+00:00, data_interval_end=2024-05-25 01:04:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:04:06.105339193Z [2024-05-25T01:04:06.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:04:00+00:00, run_after=2024-05-25T01:05:00+00:00 2024-05-25T01:04:06.112345199Z [2024-05-25T01:04:06.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:04:06.112585127Z [2024-05-25T01:04:06.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:03:00+00:00, run_id=scheduled__2024-05-25T01:03:00+00:00, run_start_date=2024-05-25 01:04:00.957037+00:00, run_end_date=2024-05-25 01:04:06.112206+00:00, run_duration=5.155169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:03:00+00:00, data_interval_end=2024-05-25 01:04:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:04:06.123281008Z [2024-05-25T01:04:06.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:04:00+00:00, run_after=2024-05-25T01:05:00+00:00 2024-05-25T01:04:06.169867197Z [2024-05-25T01:04:06.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:03:00+00:00 exited with status success for try_number 1 2024-05-25T01:04:06.170179904Z [2024-05-25T01:04:06.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:03:00+00:00 exited with status success for try_number 1 2024-05-25T01:04:06.177085956Z [2024-05-25T01:04:06.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:03:00+00:00, map_index=-1, run_start_date=2024-05-25 01:04:03.393556+00:00, run_end_date=2024-05-25 01:04:05.113717+00:00, run_duration=1.720161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:04:01.044356+00:00, queued_by_job_id=1, pid=8240 2024-05-25T01:04:06.177453968Z [2024-05-25T01:04:06.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:03:00+00:00, map_index=-1, run_start_date=2024-05-25 01:04:03.066260+00:00, run_end_date=2024-05-25 01:04:05.214274+00:00, run_duration=2.148014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:04:01.044356+00:00, queued_by_job_id=1, pid=8229 2024-05-25T01:05:00.308712822Z [2024-05-25T01:05:00.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:05:00+00:00, run_after=2024-05-25T01:10:00+00:00 2024-05-25T01:05:00.335343528Z [2024-05-25T01:05:00.334+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:05:00+00:00, run_after=2024-05-25T01:06:00+00:00 2024-05-25T01:05:00.347322909Z [2024-05-25T01:05:00.346+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:05:00.360527128Z [2024-05-25T01:05:00.360+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:05:00+00:00, run_after=2024-05-25T01:06:00+00:00 2024-05-25T01:05:00.476888037Z [2024-05-25T01:05:00.476+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:05:00.476942235Z 2024-05-25T01:05:00.477005881Z 2024-05-25T01:05:00.477015549Z 2024-05-25T01:05:00.477024467Z 2024-05-25T01:05:00.477522060Z [2024-05-25T01:05:00.476+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:05:00.477941100Z [2024-05-25T01:05:00.477+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:05:00.478177697Z [2024-05-25T01:05:00.477+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:05:00.478670579Z [2024-05-25T01:05:00.478+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:05:00.479511626Z [2024-05-25T01:05:00.479+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:05:00.479535848Z 2024-05-25T01:05:00.479545363Z 2024-05-25T01:05:00.479554191Z 2024-05-25T01:05:00.479596839Z 2024-05-25T01:05:00.484630947Z [2024-05-25T01:05:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:05:00.484728253Z [2024-05-25T01:05:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:05:00.485062001Z [2024-05-25T01:05:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:05:00.485244703Z [2024-05-25T01:05:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:05:00.485568962Z [2024-05-25T01:05:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:05:00.485734019Z [2024-05-25T01:05:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:05:00.486008444Z [2024-05-25T01:05:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:05:00.486130357Z [2024-05-25T01:05:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:05:00.831205627Z [2024-05-25T01:05:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status queued for try_number 1 2024-05-25T01:05:00.831402460Z [2024-05-25T01:05:00.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:04:00+00:00 exited with status queued for try_number 1 2024-05-25T01:05:00.831571427Z [2024-05-25T01:05:00.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:04:00+00:00 exited with status queued for try_number 1 2024-05-25T01:05:00.831704443Z [2024-05-25T01:05:00.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:04:00+00:00 exited with status queued for try_number 1 2024-05-25T01:05:00.852733534Z [2024-05-25T01:05:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37ac9ad2-483e-4aae-b769-4db7bb0d2cb7 2024-05-25T01:05:00.853054500Z [2024-05-25T01:05:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa5bc155-3544-40a5-9c63-8c378f6f74d3 2024-05-25T01:05:00.853353292Z [2024-05-25T01:05:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a5cccff-3533-454e-97b8-2b7a322c2c1a 2024-05-25T01:05:00.853560168Z [2024-05-25T01:05:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b20e00d-d346-4244-ae23-b983a375cdc2 2024-05-25T01:05:02.209869937Z [2024-05-25T01:05:02.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:05:02.209902407Z [2024-05-25T01:05:02.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:04:00+00:00, run_id=scheduled__2024-05-25T01:04:00+00:00, run_start_date=2024-05-25 01:05:00.381548+00:00, run_end_date=2024-05-25 01:05:02.202990+00:00, run_duration=1.821442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:04:00+00:00, data_interval_end=2024-05-25 01:05:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:05:02.240176874Z [2024-05-25T01:05:02.235+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:05:00+00:00, run_after=2024-05-25T01:06:00+00:00 2024-05-25T01:05:02.767503949Z [2024-05-25T01:05:02.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:04:00+00:00 exited with status success for try_number 1 2024-05-25T01:05:02.788712652Z [2024-05-25T01:05:02.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:04:00+00:00, map_index=-1, run_start_date=2024-05-25 01:05:01.647415+00:00, run_end_date=2024-05-25 01:05:02.131597+00:00, run_duration=0.484182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:05:00.480720+00:00, queued_by_job_id=1, pid=8268 2024-05-25T01:05:05.099851698Z [2024-05-25T01:05:05.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:05:05.100350316Z [2024-05-25T01:05:05.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:04:00+00:00, run_id=scheduled__2024-05-25T01:04:00+00:00, run_start_date=2024-05-25 01:05:00.383112+00:00, run_end_date=2024-05-25 01:05:05.099674+00:00, run_duration=4.716562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:04:00+00:00, data_interval_end=2024-05-25 01:05:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:05:05.110676620Z [2024-05-25T01:05:05.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:05:00+00:00, run_after=2024-05-25T01:06:00+00:00 2024-05-25T01:05:05.164840659Z [2024-05-25T01:05:05.164+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:05:05.164892800Z 2024-05-25T01:05:05.165092063Z [2024-05-25T01:05:05.164+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:05:05.165857457Z [2024-05-25T01:05:05.165+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:05:05.165868823Z 2024-05-25T01:05:05.169421827Z [2024-05-25T01:05:05.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:05:05.169689661Z [2024-05-25T01:05:05.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:05:05.247314511Z [2024-05-25T01:05:05.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status queued for try_number 1 2024-05-25T01:05:05.247993479Z [2024-05-25T01:05:05.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status success for try_number 1 2024-05-25T01:05:05.248043279Z [2024-05-25T01:05:05.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:04:00+00:00 exited with status success for try_number 1 2024-05-25T01:05:05.258482055Z [2024-05-25T01:05:05.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:00:00+00:00, map_index=-1, run_start_date=2024-05-25 01:05:03.561175+00:00, run_end_date=2024-05-25 01:05:04.036927+00:00, run_duration=0.475752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:05:00.480720+00:00, queued_by_job_id=1, pid=8297 2024-05-25T01:05:05.258859485Z [2024-05-25T01:05:05.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c78a41d-0fe4-453e-a088-1fe5da0b1cf3 2024-05-25T01:05:05.259079813Z [2024-05-25T01:05:05.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:04:00+00:00, map_index=-1, run_start_date=2024-05-25 01:05:02.836482+00:00, run_end_date=2024-05-25 01:05:04.180391+00:00, run_duration=1.343909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:05:00.480720+00:00, queued_by_job_id=1, pid=8281 2024-05-25T01:05:06.412531814Z [2024-05-25T01:05:06.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:05:06.412742929Z [2024-05-25T01:05:06.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:04:00+00:00, run_id=scheduled__2024-05-25T01:04:00+00:00, run_start_date=2024-05-25 01:05:00.384610+00:00, run_end_date=2024-05-25 01:05:06.412219+00:00, run_duration=6.027609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:04:00+00:00, data_interval_end=2024-05-25 01:05:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:05:06.423101892Z [2024-05-25T01:05:06.422+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:05:00+00:00, run_after=2024-05-25T01:06:00+00:00 2024-05-25T01:05:06.487544875Z [2024-05-25T01:05:06.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:04:00+00:00 exited with status success for try_number 1 2024-05-25T01:05:06.499163066Z [2024-05-25T01:05:06.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:04:00+00:00, map_index=-1, run_start_date=2024-05-25 01:05:03.710025+00:00, run_end_date=2024-05-25 01:05:05.397418+00:00, run_duration=1.687393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:05:00.480720+00:00, queued_by_job_id=1, pid=8298 2024-05-25T01:05:07.925380861Z [2024-05-25T01:05:07.922+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:05:07.925418203Z 2024-05-25T01:05:07.925425066Z [2024-05-25T01:05:07.923+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:05:07.925431712Z [2024-05-25T01:05:07.923+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:05:07.925437364Z 2024-05-25T01:05:07.929365817Z [2024-05-25T01:05:07.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:05:07.929398309Z [2024-05-25T01:05:07.927+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:05:07.997948869Z [2024-05-25T01:05:07.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status queued for try_number 1 2024-05-25T01:05:07.998043096Z [2024-05-25T01:05:07.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status success for try_number 1 2024-05-25T01:05:08.008808518Z [2024-05-25T01:05:08.008+0000] {scheduler_job.py:635} INFO - Setting external_id for to d31a02b9-4636-4e7b-a98e-7f5ad59d22c1 2024-05-25T01:05:08.011176598Z [2024-05-25T01:05:08.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T01:00:00+00:00, map_index=-1, run_start_date=2024-05-25 01:05:06.757674+00:00, run_end_date=2024-05-25 01:05:07.192434+00:00, run_duration=0.43476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:05:05.166663+00:00, queued_by_job_id=1, pid=8327 2024-05-25T01:05:10.282167466Z [2024-05-25T01:05:10.281+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:05:10.282213802Z 2024-05-25T01:05:10.282407183Z [2024-05-25T01:05:10.282+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:05:10.283398706Z [2024-05-25T01:05:10.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:05:10.283412437Z 2024-05-25T01:05:10.285393167Z [2024-05-25T01:05:10.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:05:10.285590687Z [2024-05-25T01:05:10.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:05:10.362908906Z [2024-05-25T01:05:10.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status queued for try_number 1 2024-05-25T01:05:10.362951856Z [2024-05-25T01:05:10.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status success for try_number 1 2024-05-25T01:05:10.368896216Z [2024-05-25T01:05:10.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to a680433d-94e4-4fe6-a6db-2db8dbbcb24a 2024-05-25T01:05:10.369123115Z [2024-05-25T01:05:10.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:00:00+00:00, map_index=0, run_start_date=2024-05-25 01:05:09.724191+00:00, run_end_date=2024-05-25 01:05:10.142575+00:00, run_duration=0.418384, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:05:07.924032+00:00, queued_by_job_id=1, pid=8338 2024-05-25T01:05:13.095021228Z [2024-05-25T01:05:13.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:05:13.095549320Z [2024-05-25T01:05:13.095+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:00:00+00:00, run_id=scheduled__2024-05-25T01:00:00+00:00, run_start_date=2024-05-25 01:05:00.379267+00:00, run_end_date=2024-05-25 01:05:13.094867+00:00, run_duration=12.7156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:00:00+00:00, data_interval_end=2024-05-25 01:05:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T01:05:13.103446225Z [2024-05-25T01:05:13.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:05:00+00:00, run_after=2024-05-25T01:10:00+00:00 2024-05-25T01:05:13.152411362Z [2024-05-25T01:05:13.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:00:00+00:00 exited with status success for try_number 1 2024-05-25T01:05:13.163984657Z [2024-05-25T01:05:13.163+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:00:00+00:00, map_index=-1, run_start_date=2024-05-25 01:05:11.892544+00:00, run_end_date=2024-05-25 01:05:12.250315+00:00, run_duration=0.357771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:05:10.283296+00:00, queued_by_job_id=1, pid=8346 2024-05-25T01:05:28.876638063Z [2024-05-25T01:05:28.875+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T01:06:00.054839093Z [2024-05-25T01:06:00.054+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:06:00+00:00, run_after=2024-05-25T01:07:00+00:00 2024-05-25T01:06:00.077591083Z [2024-05-25T01:06:00.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:06:00+00:00, run_after=2024-05-25T01:07:00+00:00 2024-05-25T01:06:00.089668885Z [2024-05-25T01:06:00.089+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:06:00.100086174Z [2024-05-25T01:06:00.099+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:06:00.243049310Z [2024-05-25T01:06:00.242+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:06:00.243108424Z 2024-05-25T01:06:00.243119992Z 2024-05-25T01:06:00.243129938Z 2024-05-25T01:06:00.243138818Z 2024-05-25T01:06:00.243479877Z [2024-05-25T01:06:00.243+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:06:00.243950325Z [2024-05-25T01:06:00.243+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:06:00.244382895Z [2024-05-25T01:06:00.244+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:06:00.244732476Z [2024-05-25T01:06:00.244+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:06:00.246209158Z [2024-05-25T01:06:00.245+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:06:00.246254316Z 2024-05-25T01:06:00.246263361Z 2024-05-25T01:06:00.246270645Z 2024-05-25T01:06:00.246277675Z 2024-05-25T01:06:00.253011361Z [2024-05-25T01:06:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:06:00.253392746Z [2024-05-25T01:06:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:06:00.253876957Z [2024-05-25T01:06:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:06:00.254266944Z [2024-05-25T01:06:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:06:00.254818547Z [2024-05-25T01:06:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:06:00.255105917Z [2024-05-25T01:06:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:06:00.255572281Z [2024-05-25T01:06:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:06:00.255998214Z [2024-05-25T01:06:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:06:00.552193456Z [2024-05-25T01:06:00.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:04:00+00:00 exited with status queued for try_number 1 2024-05-25T01:06:00.552418737Z [2024-05-25T01:06:00.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status queued for try_number 1 2024-05-25T01:06:00.552649675Z [2024-05-25T01:06:00.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status queued for try_number 1 2024-05-25T01:06:00.552843415Z [2024-05-25T01:06:00.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status queued for try_number 1 2024-05-25T01:06:00.571112960Z [2024-05-25T01:06:00.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ecd0620-c661-4c17-b4e6-8ceed4943aa6 2024-05-25T01:06:00.571638755Z [2024-05-25T01:06:00.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55cbc802-7d25-46e8-a7f6-71102be656a5 2024-05-25T01:06:00.572101297Z [2024-05-25T01:06:00.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10079a9e-b3ae-43d8-a74b-129a49272552 2024-05-25T01:06:00.572334090Z [2024-05-25T01:06:00.572+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89e61f8f-ddf1-452c-83b2-71cd932f0734 2024-05-25T01:06:02.550870323Z [2024-05-25T01:06:02.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:06:02.551234858Z [2024-05-25T01:06:02.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:04:00+00:00, run_id=scheduled__2024-05-25T01:04:00+00:00, run_start_date=2024-05-25 01:06:00.116987+00:00, run_end_date=2024-05-25 01:06:02.550873+00:00, run_duration=2.433886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:04:00+00:00, data_interval_end=2024-05-25 01:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:06:02.558900705Z [2024-05-25T01:06:02.558+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:06:00+00:00, run_after=2024-05-25T01:08:00+00:00 2024-05-25T01:06:02.579809300Z [2024-05-25T01:06:02.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:06:02.580110690Z [2024-05-25T01:06:02.579+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:05:00+00:00, run_id=scheduled__2024-05-25T01:05:00+00:00, run_start_date=2024-05-25 01:06:00.119111+00:00, run_end_date=2024-05-25 01:06:02.579804+00:00, run_duration=2.460693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:05:00+00:00, data_interval_end=2024-05-25 01:06:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:06:02.589615569Z [2024-05-25T01:06:02.589+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:06:00+00:00, run_after=2024-05-25T01:07:00+00:00 2024-05-25T01:06:02.643241232Z [2024-05-25T01:06:02.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:04:00+00:00 exited with status success for try_number 1 2024-05-25T01:06:02.643448959Z [2024-05-25T01:06:02.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status success for try_number 1 2024-05-25T01:06:02.650154518Z [2024-05-25T01:06:02.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:05:00+00:00, map_index=-1, run_start_date=2024-05-25 01:06:01.103998+00:00, run_end_date=2024-05-25 01:06:01.581811+00:00, run_duration=0.477813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:06:00.248521+00:00, queued_by_job_id=1, pid=8356 2024-05-25T01:06:02.650437465Z [2024-05-25T01:06:02.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:04:00+00:00, map_index=-1, run_start_date=2024-05-25 01:06:01.222626+00:00, run_end_date=2024-05-25 01:06:01.672260+00:00, run_duration=0.449634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:06:00.248521+00:00, queued_by_job_id=1, pid=8357 2024-05-25T01:06:03.699531509Z [2024-05-25T01:06:03.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:06:03.700293601Z [2024-05-25T01:06:03.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:05:00+00:00, run_id=scheduled__2024-05-25T01:05:00+00:00, run_start_date=2024-05-25 01:06:00.120969+00:00, run_end_date=2024-05-25 01:06:03.699457+00:00, run_duration=3.578488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:05:00+00:00, data_interval_end=2024-05-25 01:06:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:06:03.715318720Z [2024-05-25T01:06:03.714+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:06:00+00:00, run_after=2024-05-25T01:07:00+00:00 2024-05-25T01:06:04.090539775Z [2024-05-25T01:06:04.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status success for try_number 1 2024-05-25T01:06:04.095880924Z [2024-05-25T01:06:04.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:05:00+00:00, map_index=-1, run_start_date=2024-05-25 01:06:02.422796+00:00, run_end_date=2024-05-25 01:06:03.637331+00:00, run_duration=1.214535, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:06:00.248521+00:00, queued_by_job_id=1, pid=8380 2024-05-25T01:06:05.157951415Z [2024-05-25T01:06:05.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:06:05.158234398Z [2024-05-25T01:06:05.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:05:00+00:00, run_id=scheduled__2024-05-25T01:05:00+00:00, run_start_date=2024-05-25 01:06:00.122443+00:00, run_end_date=2024-05-25 01:06:05.157828+00:00, run_duration=5.035385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:05:00+00:00, data_interval_end=2024-05-25 01:06:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:06:05.166339630Z [2024-05-25T01:06:05.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:06:00+00:00, run_after=2024-05-25T01:07:00+00:00 2024-05-25T01:06:05.202094795Z [2024-05-25T01:06:05.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status success for try_number 1 2024-05-25T01:06:05.206897749Z [2024-05-25T01:06:05.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:05:00+00:00, map_index=-1, run_start_date=2024-05-25 01:06:02.490420+00:00, run_end_date=2024-05-25 01:06:04.110272+00:00, run_duration=1.619852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:06:00.248521+00:00, queued_by_job_id=1, pid=8381 2024-05-25T01:07:01.065346833Z [2024-05-25T01:07:01.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:07:00+00:00, run_after=2024-05-25T01:08:00+00:00 2024-05-25T01:07:01.096525317Z [2024-05-25T01:07:01.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:07:00+00:00, run_after=2024-05-25T01:08:00+00:00 2024-05-25T01:07:01.105115888Z [2024-05-25T01:07:01.104+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:07:01.196734433Z [2024-05-25T01:07:01.196+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:07:01.196790286Z 2024-05-25T01:07:01.196797761Z 2024-05-25T01:07:01.196803536Z 2024-05-25T01:07:01.197531299Z [2024-05-25T01:07:01.196+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:07:01.198254715Z [2024-05-25T01:07:01.197+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:07:01.198890173Z [2024-05-25T01:07:01.198+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:07:01.201370361Z [2024-05-25T01:07:01.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:07:01.201381839Z 2024-05-25T01:07:01.201385418Z 2024-05-25T01:07:01.201388608Z 2024-05-25T01:07:01.205608840Z [2024-05-25T01:07:01.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:07:01.205884707Z [2024-05-25T01:07:01.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:07:01.206210706Z [2024-05-25T01:07:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:07:01.206391011Z [2024-05-25T01:07:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:07:01.206719671Z [2024-05-25T01:07:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:07:01.206866153Z [2024-05-25T01:07:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:07:01.508290690Z [2024-05-25T01:07:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:06:00+00:00 exited with status queued for try_number 1 2024-05-25T01:07:01.508357726Z [2024-05-25T01:07:01.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:06:00+00:00 exited with status queued for try_number 1 2024-05-25T01:07:01.508519553Z [2024-05-25T01:07:01.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:06:00+00:00 exited with status queued for try_number 1 2024-05-25T01:07:01.523022896Z [2024-05-25T01:07:01.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to 310d8247-42aa-49a7-a9e1-95d0731380e2 2024-05-25T01:07:01.523163133Z [2024-05-25T01:07:01.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 647e3684-40f4-4f47-929c-58ba262263a4 2024-05-25T01:07:01.523303106Z [2024-05-25T01:07:01.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to e11688c2-3f26-46b6-bc97-4d82ba28f9c5 2024-05-25T01:07:03.057002216Z [2024-05-25T01:07:03.056+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:07:03.057717987Z [2024-05-25T01:07:03.057+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:06:00+00:00, run_id=scheduled__2024-05-25T01:06:00+00:00, run_start_date=2024-05-25 01:07:01.116404+00:00, run_end_date=2024-05-25 01:07:03.057029+00:00, run_duration=1.940625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:06:00+00:00, data_interval_end=2024-05-25 01:07:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:07:03.070610483Z [2024-05-25T01:07:03.070+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:07:00+00:00, run_after=2024-05-25T01:08:00+00:00 2024-05-25T01:07:03.151347225Z [2024-05-25T01:07:03.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:06:00+00:00 exited with status success for try_number 1 2024-05-25T01:07:03.159033113Z [2024-05-25T01:07:03.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:06:00+00:00, map_index=-1, run_start_date=2024-05-25 01:07:02.175803+00:00, run_end_date=2024-05-25 01:07:02.732096+00:00, run_duration=0.556293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:07:01.202232+00:00, queued_by_job_id=1, pid=8413 2024-05-25T01:07:05.069435484Z [2024-05-25T01:07:05.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:07:05.069810718Z [2024-05-25T01:07:05.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:06:00+00:00, run_id=scheduled__2024-05-25T01:06:00+00:00, run_start_date=2024-05-25 01:07:01.118087+00:00, run_end_date=2024-05-25 01:07:05.069114+00:00, run_duration=3.951027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:06:00+00:00, data_interval_end=2024-05-25 01:07:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:07:05.081447305Z [2024-05-25T01:07:05.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:07:00+00:00, run_after=2024-05-25T01:08:00+00:00 2024-05-25T01:07:05.158711924Z [2024-05-25T01:07:05.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:06:00+00:00 exited with status success for try_number 1 2024-05-25T01:07:05.175495073Z [2024-05-25T01:07:05.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:06:00+00:00, map_index=-1, run_start_date=2024-05-25 01:07:03.334924+00:00, run_end_date=2024-05-25 01:07:04.892259+00:00, run_duration=1.557335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:07:01.202232+00:00, queued_by_job_id=1, pid=8431 2024-05-25T01:07:06.261635445Z [2024-05-25T01:07:06.261+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:07:06.262002759Z [2024-05-25T01:07:06.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:06:00+00:00, run_id=scheduled__2024-05-25T01:06:00+00:00, run_start_date=2024-05-25 01:07:01.119205+00:00, run_end_date=2024-05-25 01:07:06.261617+00:00, run_duration=5.142412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:06:00+00:00, data_interval_end=2024-05-25 01:07:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:07:06.272406435Z [2024-05-25T01:07:06.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:07:00+00:00, run_after=2024-05-25T01:08:00+00:00 2024-05-25T01:07:06.326472410Z [2024-05-25T01:07:06.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:06:00+00:00 exited with status success for try_number 1 2024-05-25T01:07:06.333939976Z [2024-05-25T01:07:06.333+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:06:00+00:00, map_index=-1, run_start_date=2024-05-25 01:07:03.349463+00:00, run_end_date=2024-05-25 01:07:05.226145+00:00, run_duration=1.876682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:07:01.202232+00:00, queued_by_job_id=1, pid=8432 2024-05-25T01:08:00.356988510Z [2024-05-25T01:08:00.356+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:08:00.376387619Z [2024-05-25T01:08:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:08:00+00:00, run_after=2024-05-25T01:09:00+00:00 2024-05-25T01:08:00.405161025Z [2024-05-25T01:08:00.404+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:08:00+00:00, run_after=2024-05-25T01:09:00+00:00 2024-05-25T01:08:00.414940769Z [2024-05-25T01:08:00.414+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:08:00.544485192Z [2024-05-25T01:08:00.543+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:08:00.544511441Z 2024-05-25T01:08:00.544530577Z 2024-05-25T01:08:00.544534772Z 2024-05-25T01:08:00.544554571Z 2024-05-25T01:08:00.544798500Z [2024-05-25T01:08:00.544+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:08:00.545019604Z [2024-05-25T01:08:00.544+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:08:00.545198905Z [2024-05-25T01:08:00.544+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:08:00.545333708Z [2024-05-25T01:08:00.545+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:08:00.545984914Z [2024-05-25T01:08:00.545+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:08:00.545989948Z 2024-05-25T01:08:00.545993152Z 2024-05-25T01:08:00.545996071Z 2024-05-25T01:08:00.546007433Z 2024-05-25T01:08:00.549910116Z [2024-05-25T01:08:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:08:00.550173709Z [2024-05-25T01:08:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:08:00.550596896Z [2024-05-25T01:08:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:08:00.550821230Z [2024-05-25T01:08:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:08:00.551120993Z [2024-05-25T01:08:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:08:00.551270343Z [2024-05-25T01:08:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:08:00.551505297Z [2024-05-25T01:08:00.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:08:00.551713108Z [2024-05-25T01:08:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:08:00.971706686Z [2024-05-25T01:08:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:06:00+00:00 exited with status queued for try_number 1 2024-05-25T01:08:00.972120066Z [2024-05-25T01:08:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:07:00+00:00 exited with status queued for try_number 1 2024-05-25T01:08:00.972305294Z [2024-05-25T01:08:00.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:07:00+00:00 exited with status queued for try_number 1 2024-05-25T01:08:00.972474500Z [2024-05-25T01:08:00.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:07:00+00:00 exited with status queued for try_number 1 2024-05-25T01:08:00.990345417Z [2024-05-25T01:08:00.989+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b8a85c4-c0d6-4a21-8622-d0b5c0076c5d 2024-05-25T01:08:00.991013132Z [2024-05-25T01:08:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1746c05-a21e-497d-b6f7-707cb9d61267 2024-05-25T01:08:00.991241707Z [2024-05-25T01:08:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81f73574-dd4f-4802-b8f6-14f56598b7b6 2024-05-25T01:08:00.991682286Z [2024-05-25T01:08:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4533cba-0ce7-4612-a5c6-edff8792708e 2024-05-25T01:08:02.302004609Z [2024-05-25T01:08:02.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:08:02.302401855Z [2024-05-25T01:08:02.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:06:00+00:00, run_id=scheduled__2024-05-25T01:06:00+00:00, run_start_date=2024-05-25 01:08:00.429339+00:00, run_end_date=2024-05-25 01:08:02.301883+00:00, run_duration=1.872544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:06:00+00:00, data_interval_end=2024-05-25 01:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:08:02.310294899Z [2024-05-25T01:08:02.309+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:08:00+00:00, run_after=2024-05-25T01:10:00+00:00 2024-05-25T01:08:02.317324698Z [2024-05-25T01:08:02.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:08:02.317667505Z [2024-05-25T01:08:02.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:07:00+00:00, run_id=scheduled__2024-05-25T01:07:00+00:00, run_start_date=2024-05-25 01:08:00.430892+00:00, run_end_date=2024-05-25 01:08:02.317243+00:00, run_duration=1.886351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:07:00+00:00, data_interval_end=2024-05-25 01:08:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:08:02.328288856Z [2024-05-25T01:08:02.327+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:08:00+00:00, run_after=2024-05-25T01:09:00+00:00 2024-05-25T01:08:02.401662368Z [2024-05-25T01:08:02.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:06:00+00:00 exited with status success for try_number 1 2024-05-25T01:08:02.401725556Z [2024-05-25T01:08:02.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:07:00+00:00 exited with status success for try_number 1 2024-05-25T01:08:02.408080985Z [2024-05-25T01:08:02.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:06:00+00:00, map_index=-1, run_start_date=2024-05-25 01:08:01.457582+00:00, run_end_date=2024-05-25 01:08:01.883766+00:00, run_duration=0.426184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:08:00.546939+00:00, queued_by_job_id=1, pid=8466 2024-05-25T01:08:02.408192507Z [2024-05-25T01:08:02.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:07:00+00:00, map_index=-1, run_start_date=2024-05-25 01:08:01.474362+00:00, run_end_date=2024-05-25 01:08:01.941045+00:00, run_duration=0.466683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:08:00.546939+00:00, queued_by_job_id=1, pid=8467 2024-05-25T01:08:04.591420980Z [2024-05-25T01:08:04.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:08:04.591926249Z [2024-05-25T01:08:04.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:07:00+00:00, run_id=scheduled__2024-05-25T01:07:00+00:00, run_start_date=2024-05-25 01:08:00.432322+00:00, run_end_date=2024-05-25 01:08:04.591315+00:00, run_duration=4.158993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:07:00+00:00, data_interval_end=2024-05-25 01:08:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:08:04.608971096Z [2024-05-25T01:08:04.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:08:00+00:00, run_after=2024-05-25T01:09:00+00:00 2024-05-25T01:08:04.621628283Z [2024-05-25T01:08:04.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:08:04.622210281Z [2024-05-25T01:08:04.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:07:00+00:00, run_id=scheduled__2024-05-25T01:07:00+00:00, run_start_date=2024-05-25 01:08:00.433748+00:00, run_end_date=2024-05-25 01:08:04.621517+00:00, run_duration=4.187769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:07:00+00:00, data_interval_end=2024-05-25 01:08:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:08:04.643837841Z [2024-05-25T01:08:04.643+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:08:00+00:00, run_after=2024-05-25T01:09:00+00:00 2024-05-25T01:08:04.693177322Z [2024-05-25T01:08:04.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:07:00+00:00 exited with status success for try_number 1 2024-05-25T01:08:04.701202119Z [2024-05-25T01:08:04.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:07:00+00:00, map_index=-1, run_start_date=2024-05-25 01:08:02.557910+00:00, run_end_date=2024-05-25 01:08:03.805029+00:00, run_duration=1.247119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:08:00.546939+00:00, queued_by_job_id=1, pid=8489 2024-05-25T01:08:05.759376968Z [2024-05-25T01:08:05.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:07:00+00:00 exited with status success for try_number 1 2024-05-25T01:08:05.765501796Z [2024-05-25T01:08:05.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:07:00+00:00, map_index=-1, run_start_date=2024-05-25 01:08:02.809825+00:00, run_end_date=2024-05-25 01:08:04.501611+00:00, run_duration=1.691786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:08:00.546939+00:00, queued_by_job_id=1, pid=8491 2024-05-25T01:09:00.330603267Z [2024-05-25T01:09:00.330+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:09:00+00:00, run_after=2024-05-25T01:10:00+00:00 2024-05-25T01:09:00.340000869Z [2024-05-25T01:09:00.339+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:09:00.353596463Z [2024-05-25T01:09:00.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:09:00+00:00, run_after=2024-05-25T01:10:00+00:00 2024-05-25T01:09:00.427552444Z [2024-05-25T01:09:00.426+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:09:00.427578349Z 2024-05-25T01:09:00.427596276Z 2024-05-25T01:09:00.427599374Z 2024-05-25T01:09:00.427978462Z [2024-05-25T01:09:00.427+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:09:00.428454280Z [2024-05-25T01:09:00.428+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:09:00.428751984Z [2024-05-25T01:09:00.428+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:09:00.431099915Z [2024-05-25T01:09:00.430+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:09:00.431115755Z 2024-05-25T01:09:00.431119478Z 2024-05-25T01:09:00.431122606Z 2024-05-25T01:09:00.437371230Z [2024-05-25T01:09:00.436+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:09:00.437516528Z [2024-05-25T01:09:00.437+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:09:00.438072912Z [2024-05-25T01:09:00.437+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:09:00.438368006Z [2024-05-25T01:09:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:09:00.438723028Z [2024-05-25T01:09:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:09:00.438878385Z [2024-05-25T01:09:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:09:00.659270735Z [2024-05-25T01:09:00.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:08:00+00:00 exited with status queued for try_number 1 2024-05-25T01:09:00.659455987Z [2024-05-25T01:09:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:08:00+00:00 exited with status queued for try_number 1 2024-05-25T01:09:00.659609410Z [2024-05-25T01:09:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:08:00+00:00 exited with status queued for try_number 1 2024-05-25T01:09:00.666811466Z [2024-05-25T01:09:00.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0187c1d3-24e7-4f3f-b285-a76ebe479d19 2024-05-25T01:09:00.667011933Z [2024-05-25T01:09:00.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3387e00c-66e1-4eb5-b73f-50415e6d2af5 2024-05-25T01:09:00.667198026Z [2024-05-25T01:09:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a54c807-4f3c-475f-9e9c-d6127a6b5ded 2024-05-25T01:09:01.790217852Z [2024-05-25T01:09:01.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:09:01.790776617Z [2024-05-25T01:09:01.790+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:08:00+00:00, run_id=scheduled__2024-05-25T01:08:00+00:00, run_start_date=2024-05-25 01:09:00.365600+00:00, run_end_date=2024-05-25 01:09:01.790067+00:00, run_duration=1.424467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:08:00+00:00, data_interval_end=2024-05-25 01:09:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:09:01.800320714Z [2024-05-25T01:09:01.799+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:09:00+00:00, run_after=2024-05-25T01:10:00+00:00 2024-05-25T01:09:01.844312236Z [2024-05-25T01:09:01.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:08:00+00:00 exited with status success for try_number 1 2024-05-25T01:09:01.850258696Z [2024-05-25T01:09:01.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:08:00+00:00, map_index=-1, run_start_date=2024-05-25 01:09:01.247185+00:00, run_end_date=2024-05-25 01:09:01.599398+00:00, run_duration=0.352213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:09:00.432969+00:00, queued_by_job_id=1, pid=8523 2024-05-25T01:09:03.949881523Z [2024-05-25T01:09:03.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:09:03.950299731Z [2024-05-25T01:09:03.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:08:00+00:00, run_id=scheduled__2024-05-25T01:08:00+00:00, run_start_date=2024-05-25 01:09:00.367094+00:00, run_end_date=2024-05-25 01:09:03.949791+00:00, run_duration=3.582697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:08:00+00:00, data_interval_end=2024-05-25 01:09:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:09:03.960911670Z [2024-05-25T01:09:03.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:09:00+00:00, run_after=2024-05-25T01:10:00+00:00 2024-05-25T01:09:04.020154772Z [2024-05-25T01:09:04.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:08:00+00:00 exited with status success for try_number 1 2024-05-25T01:09:04.026388605Z [2024-05-25T01:09:04.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:08:00+00:00, map_index=-1, run_start_date=2024-05-25 01:09:02.280761+00:00, run_end_date=2024-05-25 01:09:03.690634+00:00, run_duration=1.409873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:09:00.432969+00:00, queued_by_job_id=1, pid=8542 2024-05-25T01:09:05.084024606Z [2024-05-25T01:09:05.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:09:05.084338913Z [2024-05-25T01:09:05.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:08:00+00:00, run_id=scheduled__2024-05-25T01:08:00+00:00, run_start_date=2024-05-25 01:09:00.368283+00:00, run_end_date=2024-05-25 01:09:05.083791+00:00, run_duration=4.715508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:08:00+00:00, data_interval_end=2024-05-25 01:09:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:09:05.097040736Z [2024-05-25T01:09:05.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:09:00+00:00, run_after=2024-05-25T01:10:00+00:00 2024-05-25T01:09:05.137130299Z [2024-05-25T01:09:05.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:08:00+00:00 exited with status success for try_number 1 2024-05-25T01:09:05.145108240Z [2024-05-25T01:09:05.144+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:08:00+00:00, map_index=-1, run_start_date=2024-05-25 01:09:02.215055+00:00, run_end_date=2024-05-25 01:09:04.132962+00:00, run_duration=1.917907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:09:00.432969+00:00, queued_by_job_id=1, pid=8541 2024-05-25T01:10:00.327649547Z [2024-05-25T01:10:00.326+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:10:00.338127897Z [2024-05-25T01:10:00.337+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:10:00.374935353Z [2024-05-25T01:10:00.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:10:00+00:00, run_after=2024-05-25T01:11:00+00:00 2024-05-25T01:10:00.395863978Z [2024-05-25T01:10:00.395+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:10:00+00:00, run_after=2024-05-25T01:15:00+00:00 2024-05-25T01:10:00.415489712Z [2024-05-25T01:10:00.414+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:10:00+00:00, run_after=2024-05-25T01:11:00+00:00 2024-05-25T01:10:00.561927782Z [2024-05-25T01:10:00.561+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T01:10:00.561958910Z 2024-05-25T01:10:00.561965644Z 2024-05-25T01:10:00.561972135Z 2024-05-25T01:10:00.561977532Z 2024-05-25T01:10:00.561982823Z 2024-05-25T01:10:00.562144377Z [2024-05-25T01:10:00.561+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:10:00.562439188Z [2024-05-25T01:10:00.562+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:10:00.562657064Z [2024-05-25T01:10:00.562+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:10:00.562933495Z [2024-05-25T01:10:00.562+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:10:00.563130433Z [2024-05-25T01:10:00.562+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:10:00.564161617Z [2024-05-25T01:10:00.563+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:10:00.564171913Z 2024-05-25T01:10:00.564178470Z 2024-05-25T01:10:00.564184568Z 2024-05-25T01:10:00.564190158Z 2024-05-25T01:10:00.564195627Z 2024-05-25T01:10:00.570503054Z [2024-05-25T01:10:00.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:10:00.570842269Z [2024-05-25T01:10:00.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:10:00.571360615Z [2024-05-25T01:10:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:10:00.571591711Z [2024-05-25T01:10:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:10:00.572007265Z [2024-05-25T01:10:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:10:00.572309581Z [2024-05-25T01:10:00.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:10:00.572752118Z [2024-05-25T01:10:00.572+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:10:00.573055591Z [2024-05-25T01:10:00.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:10:00.573541215Z [2024-05-25T01:10:00.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:10:00.573836726Z [2024-05-25T01:10:00.573+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:10:01.111094099Z [2024-05-25T01:10:01.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status queued for try_number 1 2024-05-25T01:10:01.111293124Z [2024-05-25T01:10:01.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:08:00+00:00 exited with status queued for try_number 1 2024-05-25T01:10:01.111450211Z [2024-05-25T01:10:01.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:09:00+00:00 exited with status queued for try_number 1 2024-05-25T01:10:01.111591235Z [2024-05-25T01:10:01.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:09:00+00:00 exited with status queued for try_number 1 2024-05-25T01:10:01.111739020Z [2024-05-25T01:10:01.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:09:00+00:00 exited with status queued for try_number 1 2024-05-25T01:10:01.126849992Z [2024-05-25T01:10:01.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to 325ef5fa-bbf8-4faa-9c31-bad642f54e69 2024-05-25T01:10:01.127093076Z [2024-05-25T01:10:01.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0daeea48-5d33-4cb6-81ba-ab5f9010fefc 2024-05-25T01:10:01.127286569Z [2024-05-25T01:10:01.127+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4041c087-78e5-47e4-baef-4841c766f754 2024-05-25T01:10:01.127544190Z [2024-05-25T01:10:01.127+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf0dd8dd-9de9-4c1e-a169-6f86455fb5ba 2024-05-25T01:10:01.127786230Z [2024-05-25T01:10:01.127+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91393f24-94a3-41f8-b445-5375f6359d98 2024-05-25T01:10:03.275216588Z [2024-05-25T01:10:03.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:10:03.275963494Z [2024-05-25T01:10:03.275+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:08:00+00:00, run_id=scheduled__2024-05-25T01:08:00+00:00, run_start_date=2024-05-25 01:10:00.431929+00:00, run_end_date=2024-05-25 01:10:03.275514+00:00, run_duration=2.843585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:08:00+00:00, data_interval_end=2024-05-25 01:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:10:03.286983511Z [2024-05-25T01:10:03.286+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:10:00+00:00, run_after=2024-05-25T01:12:00+00:00 2024-05-25T01:10:03.300939154Z [2024-05-25T01:10:03.300+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:10:03.301312893Z [2024-05-25T01:10:03.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:09:00+00:00, run_id=scheduled__2024-05-25T01:09:00+00:00, run_start_date=2024-05-25 01:10:00.433403+00:00, run_end_date=2024-05-25 01:10:03.300827+00:00, run_duration=2.867424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:09:00+00:00, data_interval_end=2024-05-25 01:10:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:10:03.313275066Z [2024-05-25T01:10:03.312+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:10:00+00:00, run_after=2024-05-25T01:11:00+00:00 2024-05-25T01:10:03.417257614Z [2024-05-25T01:10:03.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:08:00+00:00 exited with status success for try_number 1 2024-05-25T01:10:03.417619637Z [2024-05-25T01:10:03.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:09:00+00:00 exited with status success for try_number 1 2024-05-25T01:10:03.432486117Z [2024-05-25T01:10:03.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:09:00+00:00, map_index=-1, run_start_date=2024-05-25 01:10:02.023396+00:00, run_end_date=2024-05-25 01:10:02.612228+00:00, run_duration=0.588832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:10:00.565946+00:00, queued_by_job_id=1, pid=8578 2024-05-25T01:10:03.433024018Z [2024-05-25T01:10:03.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:08:00+00:00, map_index=-1, run_start_date=2024-05-25 01:10:02.492411+00:00, run_end_date=2024-05-25 01:10:02.965567+00:00, run_duration=0.473156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:10:00.565946+00:00, queued_by_job_id=1, pid=8585 2024-05-25T01:10:04.525917548Z [2024-05-25T01:10:04.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:10:04.526301480Z [2024-05-25T01:10:04.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:09:00+00:00, run_id=scheduled__2024-05-25T01:09:00+00:00, run_start_date=2024-05-25 01:10:00.434935+00:00, run_end_date=2024-05-25 01:10:04.525759+00:00, run_duration=4.090824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:09:00+00:00, data_interval_end=2024-05-25 01:10:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:10:04.541581421Z [2024-05-25T01:10:04.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:10:00+00:00, run_after=2024-05-25T01:11:00+00:00 2024-05-25T01:10:04.583734089Z [2024-05-25T01:10:04.583+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:10:04.583805152Z 2024-05-25T01:10:04.583812058Z [2024-05-25T01:10:04.583+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:10:04.584410954Z [2024-05-25T01:10:04.584+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:10:04.584426964Z 2024-05-25T01:10:04.587294544Z [2024-05-25T01:10:04.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:10:04.587538634Z [2024-05-25T01:10:04.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:10:04.660864287Z [2024-05-25T01:10:04.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status queued for try_number 1 2024-05-25T01:10:04.660992891Z [2024-05-25T01:10:04.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status success for try_number 1 2024-05-25T01:10:04.661038979Z [2024-05-25T01:10:04.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:09:00+00:00 exited with status success for try_number 1 2024-05-25T01:10:04.674394687Z [2024-05-25T01:10:04.673+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:09:00+00:00, map_index=-1, run_start_date=2024-05-25 01:10:02.842966+00:00, run_end_date=2024-05-25 01:10:04.226950+00:00, run_duration=1.383984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:10:00.565946+00:00, queued_by_job_id=1, pid=8591 2024-05-25T01:10:04.674641396Z [2024-05-25T01:10:04.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:05:00+00:00, map_index=-1, run_start_date=2024-05-25 01:10:03.474620+00:00, run_end_date=2024-05-25 01:10:03.961492+00:00, run_duration=0.486872, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:10:00.565946+00:00, queued_by_job_id=1, pid=8618 2024-05-25T01:10:04.674919120Z [2024-05-25T01:10:04.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe09d221-b9a8-45dc-af7a-999876d239a7 2024-05-25T01:10:05.834083959Z [2024-05-25T01:10:05.833+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:10:05.834227982Z [2024-05-25T01:10:05.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:09:00+00:00, run_id=scheduled__2024-05-25T01:09:00+00:00, run_start_date=2024-05-25 01:10:00.436635+00:00, run_end_date=2024-05-25 01:10:05.833838+00:00, run_duration=5.397203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:09:00+00:00, data_interval_end=2024-05-25 01:10:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:10:05.843264812Z [2024-05-25T01:10:05.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:10:00+00:00, run_after=2024-05-25T01:11:00+00:00 2024-05-25T01:10:05.903963332Z [2024-05-25T01:10:05.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:09:00+00:00 exited with status success for try_number 1 2024-05-25T01:10:05.916122101Z [2024-05-25T01:10:05.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:09:00+00:00, map_index=-1, run_start_date=2024-05-25 01:10:03.144348+00:00, run_end_date=2024-05-25 01:10:04.774433+00:00, run_duration=1.630085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:10:00.565946+00:00, queued_by_job_id=1, pid=8602 2024-05-25T01:10:06.994629434Z [2024-05-25T01:10:06.994+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:10:06.994677635Z 2024-05-25T01:10:06.994825019Z [2024-05-25T01:10:06.994+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:10:06.995499354Z [2024-05-25T01:10:06.995+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:10:06.995546303Z 2024-05-25T01:10:06.998214520Z [2024-05-25T01:10:06.997+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:10:06.998354508Z [2024-05-25T01:10:06.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:10:07.072242704Z [2024-05-25T01:10:07.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status queued for try_number 1 2024-05-25T01:10:07.072394348Z [2024-05-25T01:10:07.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status success for try_number 1 2024-05-25T01:10:07.080348691Z [2024-05-25T01:10:07.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c31fc95-8c9a-4909-9357-788250c3dd9b 2024-05-25T01:10:07.080966120Z [2024-05-25T01:10:07.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T01:05:00+00:00, map_index=-1, run_start_date=2024-05-25 01:10:06.216556+00:00, run_end_date=2024-05-25 01:10:06.646016+00:00, run_duration=0.42946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:10:04.584889+00:00, queued_by_job_id=1, pid=8640 2024-05-25T01:10:09.809557283Z [2024-05-25T01:10:09.809+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:10:09.809606586Z 2024-05-25T01:10:09.809688897Z [2024-05-25T01:10:09.809+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:10:09.810991418Z [2024-05-25T01:10:09.810+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:10:09.811013557Z 2024-05-25T01:10:09.815801956Z [2024-05-25T01:10:09.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:10:09.816073663Z [2024-05-25T01:10:09.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:10:09.875869768Z [2024-05-25T01:10:09.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status queued for try_number 1 2024-05-25T01:10:09.876003061Z [2024-05-25T01:10:09.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status success for try_number 1 2024-05-25T01:10:09.885344652Z [2024-05-25T01:10:09.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 150cfcfd-984c-459b-83d0-540d1097f9c5 2024-05-25T01:10:09.885554408Z [2024-05-25T01:10:09.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:05:00+00:00, map_index=0, run_start_date=2024-05-25 01:10:08.711278+00:00, run_end_date=2024-05-25 01:10:09.065600+00:00, run_duration=0.354322, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:10:06.995910+00:00, queued_by_job_id=1, pid=8651 2024-05-25T01:10:12.175127993Z [2024-05-25T01:10:12.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:10:12.175154558Z [2024-05-25T01:10:12.173+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:05:00+00:00, run_id=scheduled__2024-05-25T01:05:00+00:00, run_start_date=2024-05-25 01:10:00.430533+00:00, run_end_date=2024-05-25 01:10:12.173760+00:00, run_duration=11.743227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:05:00+00:00, data_interval_end=2024-05-25 01:10:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T01:10:12.185423894Z [2024-05-25T01:10:12.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:10:00+00:00, run_after=2024-05-25T01:15:00+00:00 2024-05-25T01:10:12.273425180Z [2024-05-25T01:10:12.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:05:00+00:00 exited with status success for try_number 1 2024-05-25T01:10:12.282299624Z [2024-05-25T01:10:12.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:05:00+00:00, map_index=-1, run_start_date=2024-05-25 01:10:11.506206+00:00, run_end_date=2024-05-25 01:10:11.873605+00:00, run_duration=0.367399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:10:09.811929+00:00, queued_by_job_id=1, pid=8659 2024-05-25T01:10:28.953383451Z [2024-05-25T01:10:28.950+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T01:11:00.274756975Z [2024-05-25T01:11:00.274+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:11:00+00:00, run_after=2024-05-25T01:12:00+00:00 2024-05-25T01:11:00.292740623Z [2024-05-25T01:11:00.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:11:00+00:00, run_after=2024-05-25T01:12:00+00:00 2024-05-25T01:11:00.301119183Z [2024-05-25T01:11:00.300+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:11:00.374321394Z [2024-05-25T01:11:00.373+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:11:00.374374273Z 2024-05-25T01:11:00.374379783Z 2024-05-25T01:11:00.374383863Z 2024-05-25T01:11:00.374905305Z [2024-05-25T01:11:00.374+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:11:00.375166741Z [2024-05-25T01:11:00.374+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:11:00.375399678Z [2024-05-25T01:11:00.375+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:11:00.376122216Z [2024-05-25T01:11:00.375+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:11:00.376130464Z 2024-05-25T01:11:00.376136295Z 2024-05-25T01:11:00.376141672Z 2024-05-25T01:11:00.380078095Z [2024-05-25T01:11:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:11:00.380172455Z [2024-05-25T01:11:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:11:00.380503443Z [2024-05-25T01:11:00.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:11:00.380761512Z [2024-05-25T01:11:00.380+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:11:00.381125066Z [2024-05-25T01:11:00.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:11:00.381435611Z [2024-05-25T01:11:00.380+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:11:00.585904514Z [2024-05-25T01:11:00.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status queued for try_number 1 2024-05-25T01:11:00.585936903Z [2024-05-25T01:11:00.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status queued for try_number 1 2024-05-25T01:11:00.586038705Z [2024-05-25T01:11:00.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status queued for try_number 1 2024-05-25T01:11:00.596420567Z [2024-05-25T01:11:00.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbd25918-9886-4c75-a79b-a6b4a7e7bc27 2024-05-25T01:11:00.596513951Z [2024-05-25T01:11:00.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to b84cbc85-b058-4c38-a128-455b8249b235 2024-05-25T01:11:00.596696107Z [2024-05-25T01:11:00.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to c35348f8-4d30-43bb-b165-2a44b2557ee3 2024-05-25T01:11:01.781546558Z [2024-05-25T01:11:01.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:11:01.781786361Z [2024-05-25T01:11:01.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:10:00+00:00, run_id=scheduled__2024-05-25T01:10:00+00:00, run_start_date=2024-05-25 01:11:00.313674+00:00, run_end_date=2024-05-25 01:11:01.781460+00:00, run_duration=1.467786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:10:00+00:00, data_interval_end=2024-05-25 01:11:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:11:01.793274112Z [2024-05-25T01:11:01.792+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:11:00+00:00, run_after=2024-05-25T01:12:00+00:00 2024-05-25T01:11:01.840200095Z [2024-05-25T01:11:01.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status success for try_number 1 2024-05-25T01:11:01.844814366Z [2024-05-25T01:11:01.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:10:00+00:00, map_index=-1, run_start_date=2024-05-25 01:11:01.242993+00:00, run_end_date=2024-05-25 01:11:01.662939+00:00, run_duration=0.419946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:11:00.377173+00:00, queued_by_job_id=1, pid=8668 2024-05-25T01:11:03.915390018Z [2024-05-25T01:11:03.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:11:03.915420389Z [2024-05-25T01:11:03.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:10:00+00:00, run_id=scheduled__2024-05-25T01:10:00+00:00, run_start_date=2024-05-25 01:11:00.314904+00:00, run_end_date=2024-05-25 01:11:03.914452+00:00, run_duration=3.599548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:10:00+00:00, data_interval_end=2024-05-25 01:11:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:11:03.929428310Z [2024-05-25T01:11:03.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:11:00+00:00, run_after=2024-05-25T01:12:00+00:00 2024-05-25T01:11:03.985569295Z [2024-05-25T01:11:03.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status success for try_number 1 2024-05-25T01:11:03.990419350Z [2024-05-25T01:11:03.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:10:00+00:00, map_index=-1, run_start_date=2024-05-25 01:11:02.203253+00:00, run_end_date=2024-05-25 01:11:03.515331+00:00, run_duration=1.312078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:11:00.377173+00:00, queued_by_job_id=1, pid=8686 2024-05-25T01:11:04.287047844Z [2024-05-25T01:11:04.286+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:11:04.287294410Z [2024-05-25T01:11:04.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:10:00+00:00, run_id=scheduled__2024-05-25T01:10:00+00:00, run_start_date=2024-05-25 01:11:00.316283+00:00, run_end_date=2024-05-25 01:11:04.287033+00:00, run_duration=3.97075, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:10:00+00:00, data_interval_end=2024-05-25 01:11:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:11:04.295934017Z [2024-05-25T01:11:04.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:11:00+00:00, run_after=2024-05-25T01:12:00+00:00 2024-05-25T01:11:04.329872061Z [2024-05-25T01:11:04.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status success for try_number 1 2024-05-25T01:11:04.335968577Z [2024-05-25T01:11:04.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:10:00+00:00, map_index=-1, run_start_date=2024-05-25 01:11:02.299883+00:00, run_end_date=2024-05-25 01:11:03.954894+00:00, run_duration=1.655011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:11:00.377173+00:00, queued_by_job_id=1, pid=8687 2024-05-25T01:12:00.194575008Z [2024-05-25T01:12:00.193+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:12:00+00:00, run_after=2024-05-25T01:13:00+00:00 2024-05-25T01:12:00.204862510Z [2024-05-25T01:12:00.204+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:12:00.224070353Z [2024-05-25T01:12:00.223+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:12:00+00:00, run_after=2024-05-25T01:13:00+00:00 2024-05-25T01:12:00.231509623Z [2024-05-25T01:12:00.231+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:12:00.337781429Z [2024-05-25T01:12:00.337+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:12:00.337818415Z 2024-05-25T01:12:00.337846878Z 2024-05-25T01:12:00.337855156Z 2024-05-25T01:12:00.337862457Z 2024-05-25T01:12:00.338348097Z [2024-05-25T01:12:00.337+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:12:00.338621063Z [2024-05-25T01:12:00.338+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:12:00.339112770Z [2024-05-25T01:12:00.338+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:12:00.339411460Z [2024-05-25T01:12:00.339+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:12:00.340775112Z [2024-05-25T01:12:00.340+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:12:00.340797979Z 2024-05-25T01:12:00.340806492Z 2024-05-25T01:12:00.340836482Z 2024-05-25T01:12:00.340843932Z 2024-05-25T01:12:00.348004565Z [2024-05-25T01:12:00.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:12:00.348444540Z [2024-05-25T01:12:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:12:00.349000154Z [2024-05-25T01:12:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:12:00.349359018Z [2024-05-25T01:12:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:12:00.349877206Z [2024-05-25T01:12:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:12:00.350293412Z [2024-05-25T01:12:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:12:00.350593203Z [2024-05-25T01:12:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:12:00.350921380Z [2024-05-25T01:12:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:12:00.738460803Z [2024-05-25T01:12:00.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status queued for try_number 1 2024-05-25T01:12:00.738556779Z [2024-05-25T01:12:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:11:00+00:00 exited with status queued for try_number 1 2024-05-25T01:12:00.738706049Z [2024-05-25T01:12:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:11:00+00:00 exited with status queued for try_number 1 2024-05-25T01:12:00.738887022Z [2024-05-25T01:12:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:11:00+00:00 exited with status queued for try_number 1 2024-05-25T01:12:00.758599272Z [2024-05-25T01:12:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a4f7f43-288f-4490-a2d2-4550024a5570 2024-05-25T01:12:00.758765503Z [2024-05-25T01:12:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5686325-6459-44a9-b986-b9c8069276fb 2024-05-25T01:12:00.758933158Z [2024-05-25T01:12:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to e20a8c5b-11e9-4afd-9629-b1a63a5a3248 2024-05-25T01:12:00.759095114Z [2024-05-25T01:12:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to db154d92-1f56-4e96-a420-9ef6ad913dde 2024-05-25T01:12:02.043494416Z [2024-05-25T01:12:02.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:12:02.044296844Z [2024-05-25T01:12:02.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:10:00+00:00, run_id=scheduled__2024-05-25T01:10:00+00:00, run_start_date=2024-05-25 01:12:00.242749+00:00, run_end_date=2024-05-25 01:12:02.043375+00:00, run_duration=1.800626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:10:00+00:00, data_interval_end=2024-05-25 01:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:12:02.054413794Z [2024-05-25T01:12:02.054+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:12:00+00:00, run_after=2024-05-25T01:14:00+00:00 2024-05-25T01:12:02.067565832Z [2024-05-25T01:12:02.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:12:02.067592583Z [2024-05-25T01:12:02.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:11:00+00:00, run_id=scheduled__2024-05-25T01:11:00+00:00, run_start_date=2024-05-25 01:12:00.244114+00:00, run_end_date=2024-05-25 01:12:02.064838+00:00, run_duration=1.820724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:11:00+00:00, data_interval_end=2024-05-25 01:12:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:12:02.106121936Z [2024-05-25T01:12:02.105+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:12:00+00:00, run_after=2024-05-25T01:13:00+00:00 2024-05-25T01:12:02.204957920Z [2024-05-25T01:12:02.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status success for try_number 1 2024-05-25T01:12:02.204993572Z [2024-05-25T01:12:02.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:11:00+00:00 exited with status success for try_number 1 2024-05-25T01:12:02.214893416Z [2024-05-25T01:12:02.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:11:00+00:00, map_index=-1, run_start_date=2024-05-25 01:12:01.357429+00:00, run_end_date=2024-05-25 01:12:01.901639+00:00, run_duration=0.54421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:12:00.342744+00:00, queued_by_job_id=1, pid=8721 2024-05-25T01:12:02.214930390Z [2024-05-25T01:12:02.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:10:00+00:00, map_index=-1, run_start_date=2024-05-25 01:12:01.321075+00:00, run_end_date=2024-05-25 01:12:01.709383+00:00, run_duration=0.388308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:12:00.342744+00:00, queued_by_job_id=1, pid=8720 2024-05-25T01:12:05.512431845Z [2024-05-25T01:12:05.511+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:12:05.512601968Z [2024-05-25T01:12:05.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:11:00+00:00, run_id=scheduled__2024-05-25T01:11:00+00:00, run_start_date=2024-05-25 01:12:00.245408+00:00, run_end_date=2024-05-25 01:12:05.512188+00:00, run_duration=5.26678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:11:00+00:00, data_interval_end=2024-05-25 01:12:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:12:05.523182024Z [2024-05-25T01:12:05.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:12:00+00:00, run_after=2024-05-25T01:13:00+00:00 2024-05-25T01:12:05.532161161Z [2024-05-25T01:12:05.531+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:12:05.532495133Z [2024-05-25T01:12:05.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:11:00+00:00, run_id=scheduled__2024-05-25T01:11:00+00:00, run_start_date=2024-05-25 01:12:00.246894+00:00, run_end_date=2024-05-25 01:12:05.531993+00:00, run_duration=5.285099, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:11:00+00:00, data_interval_end=2024-05-25 01:12:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:12:05.550063996Z [2024-05-25T01:12:05.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:12:00+00:00, run_after=2024-05-25T01:13:00+00:00 2024-05-25T01:12:05.599046662Z [2024-05-25T01:12:05.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:11:00+00:00 exited with status success for try_number 1 2024-05-25T01:12:05.599085735Z [2024-05-25T01:12:05.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:11:00+00:00 exited with status success for try_number 1 2024-05-25T01:12:05.615004954Z [2024-05-25T01:12:05.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:11:00+00:00, map_index=-1, run_start_date=2024-05-25 01:12:02.565780+00:00, run_end_date=2024-05-25 01:12:04.291829+00:00, run_duration=1.726049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:12:00.342744+00:00, queued_by_job_id=1, pid=8745 2024-05-25T01:12:05.615484701Z [2024-05-25T01:12:05.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:11:00+00:00, map_index=-1, run_start_date=2024-05-25 01:12:02.464397+00:00, run_end_date=2024-05-25 01:12:04.780898+00:00, run_duration=2.316501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:12:00.342744+00:00, queued_by_job_id=1, pid=8744 2024-05-25T01:13:00.962635791Z [2024-05-25T01:13:00.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:13:00+00:00, run_after=2024-05-25T01:14:00+00:00 2024-05-25T01:13:00.972166377Z [2024-05-25T01:13:00.971+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:13:00.984840531Z [2024-05-25T01:13:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:13:00+00:00, run_after=2024-05-25T01:14:00+00:00 2024-05-25T01:13:01.099829989Z [2024-05-25T01:13:01.099+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:13:01.099879320Z 2024-05-25T01:13:01.099883255Z 2024-05-25T01:13:01.099886590Z 2024-05-25T01:13:01.100348484Z [2024-05-25T01:13:01.099+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:13:01.100790128Z [2024-05-25T01:13:01.100+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:13:01.101012282Z [2024-05-25T01:13:01.100+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:13:01.102335726Z [2024-05-25T01:13:01.101+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:13:01.102371226Z 2024-05-25T01:13:01.102384410Z 2024-05-25T01:13:01.102395335Z 2024-05-25T01:13:01.108415507Z [2024-05-25T01:13:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:13:01.108733050Z [2024-05-25T01:13:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:13:01.109154438Z [2024-05-25T01:13:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:13:01.109333209Z [2024-05-25T01:13:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:13:01.109784233Z [2024-05-25T01:13:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:13:01.109931658Z [2024-05-25T01:13:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:13:01.395428634Z [2024-05-25T01:13:01.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:12:00+00:00 exited with status queued for try_number 1 2024-05-25T01:13:01.395451586Z [2024-05-25T01:13:01.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:12:00+00:00 exited with status queued for try_number 1 2024-05-25T01:13:01.395455378Z [2024-05-25T01:13:01.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:12:00+00:00 exited with status queued for try_number 1 2024-05-25T01:13:01.405448965Z [2024-05-25T01:13:01.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11316ed1-d03f-4827-a0e9-e25585809bc5 2024-05-25T01:13:01.406268536Z [2024-05-25T01:13:01.405+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2589f407-fdcb-45a2-936b-7f6f9c512a0f 2024-05-25T01:13:01.406534930Z [2024-05-25T01:13:01.406+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbca28a0-2113-4b33-b6bf-28900d136e79 2024-05-25T01:13:02.900834099Z [2024-05-25T01:13:02.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:13:02.901050881Z [2024-05-25T01:13:02.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:12:00+00:00, run_id=scheduled__2024-05-25T01:12:00+00:00, run_start_date=2024-05-25 01:13:00.994773+00:00, run_end_date=2024-05-25 01:13:02.900756+00:00, run_duration=1.905983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:12:00+00:00, data_interval_end=2024-05-25 01:13:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:13:02.911307940Z [2024-05-25T01:13:02.910+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:13:00+00:00, run_after=2024-05-25T01:14:00+00:00 2024-05-25T01:13:02.965370473Z [2024-05-25T01:13:02.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:12:00+00:00 exited with status success for try_number 1 2024-05-25T01:13:02.976848967Z [2024-05-25T01:13:02.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:12:00+00:00, map_index=-1, run_start_date=2024-05-25 01:13:01.819356+00:00, run_end_date=2024-05-25 01:13:02.197311+00:00, run_duration=0.377955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:13:01.104312+00:00, queued_by_job_id=1, pid=8777 2024-05-25T01:13:05.922461599Z [2024-05-25T01:13:05.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:13:05.922899220Z [2024-05-25T01:13:05.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:12:00+00:00, run_id=scheduled__2024-05-25T01:12:00+00:00, run_start_date=2024-05-25 01:13:00.996727+00:00, run_end_date=2024-05-25 01:13:05.922517+00:00, run_duration=4.92579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:12:00+00:00, data_interval_end=2024-05-25 01:13:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:13:05.936157208Z [2024-05-25T01:13:05.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:13:00+00:00, run_after=2024-05-25T01:14:00+00:00 2024-05-25T01:13:05.946959171Z [2024-05-25T01:13:05.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:13:05.948253375Z [2024-05-25T01:13:05.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:12:00+00:00, run_id=scheduled__2024-05-25T01:12:00+00:00, run_start_date=2024-05-25 01:13:00.995785+00:00, run_end_date=2024-05-25 01:13:05.947438+00:00, run_duration=4.951653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:12:00+00:00, data_interval_end=2024-05-25 01:13:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:13:05.969420510Z [2024-05-25T01:13:05.968+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:13:00+00:00, run_after=2024-05-25T01:14:00+00:00 2024-05-25T01:13:06.013286924Z [2024-05-25T01:13:06.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:12:00+00:00 exited with status success for try_number 1 2024-05-25T01:13:06.013524327Z [2024-05-25T01:13:06.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:12:00+00:00 exited with status success for try_number 1 2024-05-25T01:13:06.024095259Z [2024-05-25T01:13:06.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:12:00+00:00, map_index=-1, run_start_date=2024-05-25 01:13:03.056506+00:00, run_end_date=2024-05-25 01:13:05.058817+00:00, run_duration=2.002311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:13:01.104312+00:00, queued_by_job_id=1, pid=8796 2024-05-25T01:13:06.024459228Z [2024-05-25T01:13:06.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:12:00+00:00, map_index=-1, run_start_date=2024-05-25 01:13:02.917370+00:00, run_end_date=2024-05-25 01:13:05.398915+00:00, run_duration=2.481545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:13:01.104312+00:00, queued_by_job_id=1, pid=8795 2024-05-25T01:14:00.916911993Z [2024-05-25T01:14:00.916+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:14:00+00:00, run_after=2024-05-25T01:15:00+00:00 2024-05-25T01:14:00.928506800Z [2024-05-25T01:14:00.928+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:14:00.939083867Z [2024-05-25T01:14:00.938+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:14:00.955381586Z [2024-05-25T01:14:00.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:14:00+00:00, run_after=2024-05-25T01:15:00+00:00 2024-05-25T01:14:01.072744158Z [2024-05-25T01:14:01.072+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:14:01.072787135Z 2024-05-25T01:14:01.072792977Z 2024-05-25T01:14:01.072797545Z 2024-05-25T01:14:01.072801825Z 2024-05-25T01:14:01.072829551Z [2024-05-25T01:14:01.072+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:14:01.072943368Z [2024-05-25T01:14:01.072+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:14:01.073058094Z [2024-05-25T01:14:01.072+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:14:01.073183350Z [2024-05-25T01:14:01.073+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:14:01.074168870Z [2024-05-25T01:14:01.073+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:14:01.074179232Z 2024-05-25T01:14:01.074183911Z 2024-05-25T01:14:01.074188243Z 2024-05-25T01:14:01.074192450Z 2024-05-25T01:14:01.078997270Z [2024-05-25T01:14:01.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:14:01.079041056Z [2024-05-25T01:14:01.078+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:14:01.079336760Z [2024-05-25T01:14:01.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:14:01.079407138Z [2024-05-25T01:14:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:14:01.079623114Z [2024-05-25T01:14:01.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:14:01.079681450Z [2024-05-25T01:14:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:14:01.079963212Z [2024-05-25T01:14:01.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:14:01.080033859Z [2024-05-25T01:14:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:14:01.420927178Z [2024-05-25T01:14:01.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:12:00+00:00 exited with status queued for try_number 1 2024-05-25T01:14:01.420965618Z [2024-05-25T01:14:01.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:13:00+00:00 exited with status queued for try_number 1 2024-05-25T01:14:01.437650041Z [2024-05-25T01:14:01.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:13:00+00:00 exited with status queued for try_number 1 2024-05-25T01:14:01.441382994Z [2024-05-25T01:14:01.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:13:00+00:00 exited with status queued for try_number 1 2024-05-25T01:14:01.468521045Z [2024-05-25T01:14:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to fed321a9-16ca-4519-a31b-5d96e38e605f 2024-05-25T01:14:01.468597350Z [2024-05-25T01:14:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 432638e6-f263-4ea6-be25-f2d4123c197c 2024-05-25T01:14:01.470645866Z [2024-05-25T01:14:01.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to 781b3849-7daf-4755-bde2-ef89125385b5 2024-05-25T01:14:01.470823038Z [2024-05-25T01:14:01.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to 472cc444-1596-448f-ae52-58b01669c54f 2024-05-25T01:14:02.782707412Z [2024-05-25T01:14:02.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:14:02.783157114Z [2024-05-25T01:14:02.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:13:00+00:00, run_id=scheduled__2024-05-25T01:13:00+00:00, run_start_date=2024-05-25 01:14:00.969868+00:00, run_end_date=2024-05-25 01:14:02.782623+00:00, run_duration=1.812755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:13:00+00:00, data_interval_end=2024-05-25 01:14:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:14:02.800094565Z [2024-05-25T01:14:02.799+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:14:00+00:00, run_after=2024-05-25T01:15:00+00:00 2024-05-25T01:14:02.852969885Z [2024-05-25T01:14:02.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:13:00+00:00 exited with status success for try_number 1 2024-05-25T01:14:02.859374988Z [2024-05-25T01:14:02.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:13:00+00:00, map_index=-1, run_start_date=2024-05-25 01:14:01.996102+00:00, run_end_date=2024-05-25 01:14:02.457340+00:00, run_duration=0.461238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:14:01.075335+00:00, queued_by_job_id=1, pid=8828 2024-05-25T01:14:03.937203291Z [2024-05-25T01:14:03.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:14:03.938044307Z [2024-05-25T01:14:03.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:12:00+00:00, run_id=scheduled__2024-05-25T01:12:00+00:00, run_start_date=2024-05-25 01:14:00.968241+00:00, run_end_date=2024-05-25 01:14:03.937434+00:00, run_duration=2.969193, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:12:00+00:00, data_interval_end=2024-05-25 01:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:14:03.947599276Z [2024-05-25T01:14:03.947+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:14:00+00:00, run_after=2024-05-25T01:16:00+00:00 2024-05-25T01:14:04.015344008Z [2024-05-25T01:14:04.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:12:00+00:00 exited with status success for try_number 1 2024-05-25T01:14:04.020770937Z [2024-05-25T01:14:04.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:12:00+00:00, map_index=-1, run_start_date=2024-05-25 01:14:02.384231+00:00, run_end_date=2024-05-25 01:14:02.792915+00:00, run_duration=0.408684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:14:01.075335+00:00, queued_by_job_id=1, pid=8834 2024-05-25T01:14:05.081322415Z [2024-05-25T01:14:05.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:14:05.081688900Z [2024-05-25T01:14:05.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:13:00+00:00, run_id=scheduled__2024-05-25T01:13:00+00:00, run_start_date=2024-05-25 01:14:00.971394+00:00, run_end_date=2024-05-25 01:14:05.081144+00:00, run_duration=4.10975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:13:00+00:00, data_interval_end=2024-05-25 01:14:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:14:05.095584426Z [2024-05-25T01:14:05.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:14:00+00:00, run_after=2024-05-25T01:15:00+00:00 2024-05-25T01:14:05.153983468Z [2024-05-25T01:14:05.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:13:00+00:00 exited with status success for try_number 1 2024-05-25T01:14:05.163767103Z [2024-05-25T01:14:05.163+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:13:00+00:00, map_index=-1, run_start_date=2024-05-25 01:14:03.249305+00:00, run_end_date=2024-05-25 01:14:04.804889+00:00, run_duration=1.555584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:14:01.075335+00:00, queued_by_job_id=1, pid=8852 2024-05-25T01:14:05.332953524Z [2024-05-25T01:14:05.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:14:05.333444673Z [2024-05-25T01:14:05.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:13:00+00:00, run_id=scheduled__2024-05-25T01:13:00+00:00, run_start_date=2024-05-25 01:14:00.978112+00:00, run_end_date=2024-05-25 01:14:05.332761+00:00, run_duration=4.354649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:13:00+00:00, data_interval_end=2024-05-25 01:14:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:14:05.342271659Z [2024-05-25T01:14:05.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:14:00+00:00, run_after=2024-05-25T01:15:00+00:00 2024-05-25T01:14:05.377043603Z [2024-05-25T01:14:05.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:13:00+00:00 exited with status success for try_number 1 2024-05-25T01:14:05.383811704Z [2024-05-25T01:14:05.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:13:00+00:00, map_index=-1, run_start_date=2024-05-25 01:14:03.263878+00:00, run_end_date=2024-05-25 01:14:05.050780+00:00, run_duration=1.786902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:14:01.075335+00:00, queued_by_job_id=1, pid=8853 2024-05-25T01:15:00.922683965Z [2024-05-25T01:15:00.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:15:00+00:00, run_after=2024-05-25T01:20:00+00:00 2024-05-25T01:15:00.934132300Z [2024-05-25T01:15:00.933+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:15:00.948761079Z [2024-05-25T01:15:00.948+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:15:00+00:00, run_after=2024-05-25T01:16:00+00:00 2024-05-25T01:15:00.960104804Z [2024-05-25T01:15:00.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:15:00+00:00, run_after=2024-05-25T01:16:00+00:00 2024-05-25T01:15:01.095042441Z [2024-05-25T01:15:01.094+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:15:01.095103326Z 2024-05-25T01:15:01.095114280Z 2024-05-25T01:15:01.095122543Z 2024-05-25T01:15:01.095130130Z 2024-05-25T01:15:01.095612284Z [2024-05-25T01:15:01.095+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:15:01.096005939Z [2024-05-25T01:15:01.095+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:15:01.096329931Z [2024-05-25T01:15:01.096+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:15:01.096638699Z [2024-05-25T01:15:01.096+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:15:01.098244961Z [2024-05-25T01:15:01.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:15:01.098261648Z 2024-05-25T01:15:01.098266483Z 2024-05-25T01:15:01.098270818Z 2024-05-25T01:15:01.098275796Z 2024-05-25T01:15:01.104690327Z [2024-05-25T01:15:01.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:15:01.105154152Z [2024-05-25T01:15:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:15:01.105737503Z [2024-05-25T01:15:01.105+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:15:01.106061897Z [2024-05-25T01:15:01.105+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:15:01.106557391Z [2024-05-25T01:15:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:15:01.106962212Z [2024-05-25T01:15:01.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:15:01.107449764Z [2024-05-25T01:15:01.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:15:01.107764380Z [2024-05-25T01:15:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:15:01.363899221Z [2024-05-25T01:15:01.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status queued for try_number 1 2024-05-25T01:15:01.363911756Z [2024-05-25T01:15:01.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:14:00+00:00 exited with status queued for try_number 1 2024-05-25T01:15:01.363915214Z [2024-05-25T01:15:01.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:14:00+00:00 exited with status queued for try_number 1 2024-05-25T01:15:01.363918512Z [2024-05-25T01:15:01.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:14:00+00:00 exited with status queued for try_number 1 2024-05-25T01:15:01.379238947Z [2024-05-25T01:15:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c2dd4fa-7bcb-48a1-9451-1b47d2e79ca2 2024-05-25T01:15:01.379261010Z [2024-05-25T01:15:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3679d356-847e-49db-bcf6-26f262833dbd 2024-05-25T01:15:01.379264550Z [2024-05-25T01:15:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to a570eacb-4c9b-4aaf-b476-ef247f0ff882 2024-05-25T01:15:01.379267981Z [2024-05-25T01:15:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d670ebe-bab0-448d-99b3-0777168d8bc6 2024-05-25T01:15:02.664566637Z [2024-05-25T01:15:02.664+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:15:02.665220793Z [2024-05-25T01:15:02.664+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:14:00+00:00, run_id=scheduled__2024-05-25T01:14:00+00:00, run_start_date=2024-05-25 01:15:00.983685+00:00, run_end_date=2024-05-25 01:15:02.664637+00:00, run_duration=1.680952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:14:00+00:00, data_interval_end=2024-05-25 01:15:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:15:02.677859840Z [2024-05-25T01:15:02.677+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:15:00+00:00, run_after=2024-05-25T01:16:00+00:00 2024-05-25T01:15:02.725595301Z [2024-05-25T01:15:02.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:14:00+00:00 exited with status success for try_number 1 2024-05-25T01:15:02.731278790Z [2024-05-25T01:15:02.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:14:00+00:00, map_index=-1, run_start_date=2024-05-25 01:15:01.976331+00:00, run_end_date=2024-05-25 01:15:02.444627+00:00, run_duration=0.468296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:15:01.099984+00:00, queued_by_job_id=1, pid=8886 2024-05-25T01:15:03.832067716Z [2024-05-25T01:15:03.831+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:15:03.832157295Z 2024-05-25T01:15:03.832389993Z [2024-05-25T01:15:03.832+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:15:03.833095805Z [2024-05-25T01:15:03.832+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:15:03.833104555Z 2024-05-25T01:15:03.837105663Z [2024-05-25T01:15:03.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:15:03.838808313Z [2024-05-25T01:15:03.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:15:03.960182387Z [2024-05-25T01:15:03.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status queued for try_number 1 2024-05-25T01:15:03.960475246Z [2024-05-25T01:15:03.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status success for try_number 1 2024-05-25T01:15:03.966987239Z [2024-05-25T01:15:03.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 326557e0-59a5-4e96-aacc-1885aae1f257 2024-05-25T01:15:03.967409056Z [2024-05-25T01:15:03.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:10:00+00:00, map_index=-1, run_start_date=2024-05-25 01:15:03.178025+00:00, run_end_date=2024-05-25 01:15:03.573047+00:00, run_duration=0.395022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:15:01.099984+00:00, queued_by_job_id=1, pid=8912 2024-05-25T01:15:05.224733419Z [2024-05-25T01:15:05.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:15:05.225375747Z [2024-05-25T01:15:05.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:14:00+00:00, run_id=scheduled__2024-05-25T01:14:00+00:00, run_start_date=2024-05-25 01:15:00.986132+00:00, run_end_date=2024-05-25 01:15:05.224836+00:00, run_duration=4.238704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:14:00+00:00, data_interval_end=2024-05-25 01:15:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:15:05.242411683Z [2024-05-25T01:15:05.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:15:00+00:00, run_after=2024-05-25T01:16:00+00:00 2024-05-25T01:15:05.251447854Z [2024-05-25T01:15:05.251+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:15:05.251838673Z [2024-05-25T01:15:05.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:14:00+00:00, run_id=scheduled__2024-05-25T01:14:00+00:00, run_start_date=2024-05-25 01:15:00.988345+00:00, run_end_date=2024-05-25 01:15:05.251366+00:00, run_duration=4.263021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:14:00+00:00, data_interval_end=2024-05-25 01:15:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:15:05.262090423Z [2024-05-25T01:15:05.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:15:00+00:00, run_after=2024-05-25T01:16:00+00:00 2024-05-25T01:15:05.350697833Z [2024-05-25T01:15:05.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:14:00+00:00 exited with status success for try_number 1 2024-05-25T01:15:05.352429400Z [2024-05-25T01:15:05.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:14:00+00:00 exited with status success for try_number 1 2024-05-25T01:15:05.354981527Z [2024-05-25T01:15:05.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:14:00+00:00, map_index=-1, run_start_date=2024-05-25 01:15:03.175364+00:00, run_end_date=2024-05-25 01:15:04.509435+00:00, run_duration=1.334071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:15:01.099984+00:00, queued_by_job_id=1, pid=8911 2024-05-25T01:15:05.355299432Z [2024-05-25T01:15:05.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:14:00+00:00, map_index=-1, run_start_date=2024-05-25 01:15:03.167450+00:00, run_end_date=2024-05-25 01:15:04.933626+00:00, run_duration=1.766176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:15:01.099984+00:00, queued_by_job_id=1, pid=8910 2024-05-25T01:15:06.944021107Z [2024-05-25T01:15:06.943+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:15:06.944049856Z 2024-05-25T01:15:06.944252450Z [2024-05-25T01:15:06.943+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:15:06.945614522Z [2024-05-25T01:15:06.945+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:15:06.945643363Z 2024-05-25T01:15:06.949560813Z [2024-05-25T01:15:06.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:15:06.949788151Z [2024-05-25T01:15:06.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:15:07.012376809Z [2024-05-25T01:15:07.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status queued for try_number 1 2024-05-25T01:15:07.012471302Z [2024-05-25T01:15:07.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status success for try_number 1 2024-05-25T01:15:07.022701230Z [2024-05-25T01:15:07.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d4b9406-7c95-43aa-a1b9-4fccee44e27a 2024-05-25T01:15:07.022797624Z [2024-05-25T01:15:07.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T01:10:00+00:00, map_index=-1, run_start_date=2024-05-25 01:15:05.817551+00:00, run_end_date=2024-05-25 01:15:06.183628+00:00, run_duration=0.366077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:15:03.833696+00:00, queued_by_job_id=1, pid=8935 2024-05-25T01:15:10.119625316Z [2024-05-25T01:15:10.113+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:15:10.119671730Z 2024-05-25T01:15:10.119681982Z [2024-05-25T01:15:10.114+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:15:10.119692351Z [2024-05-25T01:15:10.115+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:15:10.119700984Z 2024-05-25T01:15:10.119710519Z [2024-05-25T01:15:10.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:15:10.119719948Z [2024-05-25T01:15:10.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:15:10.190500508Z [2024-05-25T01:15:10.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status queued for try_number 1 2024-05-25T01:15:10.191004594Z [2024-05-25T01:15:10.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status success for try_number 1 2024-05-25T01:15:10.202130958Z [2024-05-25T01:15:10.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06cae2fc-2926-432d-b70a-1e026872f9ed 2024-05-25T01:15:10.202587090Z [2024-05-25T01:15:10.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:10:00+00:00, map_index=0, run_start_date=2024-05-25 01:15:08.822016+00:00, run_end_date=2024-05-25 01:15:09.180512+00:00, run_duration=0.358496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:15:06.946275+00:00, queued_by_job_id=1, pid=8956 2024-05-25T01:15:12.571262813Z [2024-05-25T01:15:12.570+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:15:12.571458869Z [2024-05-25T01:15:12.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:10:00+00:00, run_id=scheduled__2024-05-25T01:10:00+00:00, run_start_date=2024-05-25 01:15:00.980723+00:00, run_end_date=2024-05-25 01:15:12.571003+00:00, run_duration=11.59028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:10:00+00:00, data_interval_end=2024-05-25 01:15:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T01:15:12.577697403Z [2024-05-25T01:15:12.577+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:15:00+00:00, run_after=2024-05-25T01:20:00+00:00 2024-05-25T01:15:12.624746225Z [2024-05-25T01:15:12.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:10:00+00:00 exited with status success for try_number 1 2024-05-25T01:15:12.635173254Z [2024-05-25T01:15:12.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:10:00+00:00, map_index=-1, run_start_date=2024-05-25 01:15:11.683264+00:00, run_end_date=2024-05-25 01:15:12.112812+00:00, run_duration=0.429548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:15:10.116476+00:00, queued_by_job_id=1, pid=8964 2024-05-25T01:15:29.025562872Z [2024-05-25T01:15:29.024+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T01:16:00.867726219Z [2024-05-25T01:16:00.867+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:16:00.886486275Z [2024-05-25T01:16:00.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:16:00+00:00, run_after=2024-05-25T01:17:00+00:00 2024-05-25T01:16:00.900691643Z [2024-05-25T01:16:00.900+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:16:00+00:00, run_after=2024-05-25T01:17:00+00:00 2024-05-25T01:16:00.960242137Z [2024-05-25T01:16:00.959+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:16:00.960377455Z 2024-05-25T01:16:00.960386553Z 2024-05-25T01:16:00.960394023Z 2024-05-25T01:16:00.960422351Z [2024-05-25T01:16:00.960+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:16:00.960604147Z [2024-05-25T01:16:00.960+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:16:00.960767986Z [2024-05-25T01:16:00.960+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:16:00.962513164Z [2024-05-25T01:16:00.961+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:16:00.962538744Z 2024-05-25T01:16:00.962610022Z 2024-05-25T01:16:00.962617932Z 2024-05-25T01:16:00.967365953Z [2024-05-25T01:16:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:16:00.967546668Z [2024-05-25T01:16:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:16:00.968144009Z [2024-05-25T01:16:00.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:16:00.968353622Z [2024-05-25T01:16:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:16:00.968748680Z [2024-05-25T01:16:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:16:00.968914302Z [2024-05-25T01:16:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:16:01.186025740Z [2024-05-25T01:16:01.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:14:00+00:00 exited with status queued for try_number 1 2024-05-25T01:16:01.186392064Z [2024-05-25T01:16:01.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status queued for try_number 1 2024-05-25T01:16:01.186633830Z [2024-05-25T01:16:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status queued for try_number 1 2024-05-25T01:16:01.199164013Z [2024-05-25T01:16:01.198+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6fc4d50-8950-4aab-a78b-953573a7f1f3 2024-05-25T01:16:01.199439818Z [2024-05-25T01:16:01.199+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f6c3f62-87fd-4924-94ac-f3074960b4f1 2024-05-25T01:16:01.199686558Z [2024-05-25T01:16:01.199+0000] {scheduler_job.py:635} INFO - Setting external_id for to 448e8160-a1aa-4644-8f31-1bbe09d0f2b9 2024-05-25T01:16:01.240435509Z [2024-05-25T01:16:01.240+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:16:01.302255840Z [2024-05-25T01:16:01.301+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:16:01.302280056Z 2024-05-25T01:16:01.302298480Z [2024-05-25T01:16:01.302+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:16:01.302846200Z [2024-05-25T01:16:01.302+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:16:01.302856751Z 2024-05-25T01:16:01.305905261Z [2024-05-25T01:16:01.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:16:01.305936358Z [2024-05-25T01:16:01.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:16:01.469003946Z [2024-05-25T01:16:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status queued for try_number 1 2024-05-25T01:16:01.480554028Z [2024-05-25T01:16:01.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77e007a8-175c-4c17-b371-69125f36ff7a 2024-05-25T01:16:02.626747656Z [2024-05-25T01:16:02.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:16:02.627196849Z [2024-05-25T01:16:02.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:14:00+00:00, run_id=scheduled__2024-05-25T01:14:00+00:00, run_start_date=2024-05-25 01:16:00.911914+00:00, run_end_date=2024-05-25 01:16:02.626621+00:00, run_duration=1.714707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:14:00+00:00, data_interval_end=2024-05-25 01:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:16:02.637393551Z [2024-05-25T01:16:02.637+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:16:00+00:00, run_after=2024-05-25T01:18:00+00:00 2024-05-25T01:16:02.644904419Z [2024-05-25T01:16:02.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:16:02.645404113Z [2024-05-25T01:16:02.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:15:00+00:00, run_id=scheduled__2024-05-25T01:15:00+00:00, run_start_date=2024-05-25 01:16:00.913052+00:00, run_end_date=2024-05-25 01:16:02.644781+00:00, run_duration=1.731729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:15:00+00:00, data_interval_end=2024-05-25 01:16:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:16:02.656189749Z [2024-05-25T01:16:02.655+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:16:00+00:00, run_after=2024-05-25T01:17:00+00:00 2024-05-25T01:16:02.709358171Z [2024-05-25T01:16:02.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:14:00+00:00 exited with status success for try_number 1 2024-05-25T01:16:02.710143397Z [2024-05-25T01:16:02.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status success for try_number 1 2024-05-25T01:16:02.720756765Z [2024-05-25T01:16:02.720+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:14:00+00:00, map_index=-1, run_start_date=2024-05-25 01:16:01.752250+00:00, run_end_date=2024-05-25 01:16:02.048342+00:00, run_duration=0.296092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:16:00.963856+00:00, queued_by_job_id=1, pid=8975 2024-05-25T01:16:02.721353003Z [2024-05-25T01:16:02.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:15:00+00:00, map_index=-1, run_start_date=2024-05-25 01:16:01.726260+00:00, run_end_date=2024-05-25 01:16:02.137255+00:00, run_duration=0.410995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:16:00.963856+00:00, queued_by_job_id=1, pid=8974 2024-05-25T01:16:04.875074253Z [2024-05-25T01:16:04.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:16:04.875478805Z [2024-05-25T01:16:04.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:15:00+00:00, run_id=scheduled__2024-05-25T01:15:00+00:00, run_start_date=2024-05-25 01:16:00.914144+00:00, run_end_date=2024-05-25 01:16:04.874908+00:00, run_duration=3.960764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:15:00+00:00, data_interval_end=2024-05-25 01:16:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:16:04.885432194Z [2024-05-25T01:16:04.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:16:00+00:00, run_after=2024-05-25T01:17:00+00:00 2024-05-25T01:16:04.939844537Z [2024-05-25T01:16:04.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status success for try_number 1 2024-05-25T01:16:04.946014942Z [2024-05-25T01:16:04.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:15:00+00:00, map_index=-1, run_start_date=2024-05-25 01:16:02.999512+00:00, run_end_date=2024-05-25 01:16:04.689839+00:00, run_duration=1.690327, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:16:00.963856+00:00, queued_by_job_id=1, pid=8998 2024-05-25T01:16:06.017458333Z [2024-05-25T01:16:06.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:16:06.018498456Z [2024-05-25T01:16:06.017+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:15:00+00:00, run_id=scheduled__2024-05-25T01:15:00+00:00, run_start_date=2024-05-25 01:16:01.250050+00:00, run_end_date=2024-05-25 01:16:06.017354+00:00, run_duration=4.767304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:15:00+00:00, data_interval_end=2024-05-25 01:16:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:16:06.031870358Z [2024-05-25T01:16:06.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:16:00+00:00, run_after=2024-05-25T01:17:00+00:00 2024-05-25T01:16:06.062281285Z [2024-05-25T01:16:06.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status success for try_number 1 2024-05-25T01:16:06.072075583Z [2024-05-25T01:16:06.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:15:00+00:00, map_index=-1, run_start_date=2024-05-25 01:16:03.043765+00:00, run_end_date=2024-05-25 01:16:05.178440+00:00, run_duration=2.134675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:16:01.303120+00:00, queued_by_job_id=1, pid=8999 2024-05-25T01:17:00.779198429Z [2024-05-25T01:17:00.778+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:17:00+00:00, run_after=2024-05-25T01:18:00+00:00 2024-05-25T01:17:00.793818336Z [2024-05-25T01:17:00.793+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:17:00+00:00, run_after=2024-05-25T01:18:00+00:00 2024-05-25T01:17:00.801684491Z [2024-05-25T01:17:00.801+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:17:00.878944280Z [2024-05-25T01:17:00.878+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:17:00.879011569Z 2024-05-25T01:17:00.879022261Z 2024-05-25T01:17:00.879031043Z 2024-05-25T01:17:00.879608261Z [2024-05-25T01:17:00.879+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:17:00.880204955Z [2024-05-25T01:17:00.879+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:17:00.880773848Z [2024-05-25T01:17:00.880+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:17:00.882630150Z [2024-05-25T01:17:00.882+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:17:00.882679775Z 2024-05-25T01:17:00.882691744Z 2024-05-25T01:17:00.882701604Z 2024-05-25T01:17:00.888166057Z [2024-05-25T01:17:00.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:17:00.888218479Z [2024-05-25T01:17:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:17:00.888670038Z [2024-05-25T01:17:00.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:17:00.888779509Z [2024-05-25T01:17:00.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:17:00.889247350Z [2024-05-25T01:17:00.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:17:00.889447215Z [2024-05-25T01:17:00.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:17:01.142420669Z [2024-05-25T01:17:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:16:00+00:00 exited with status queued for try_number 1 2024-05-25T01:17:01.142729368Z [2024-05-25T01:17:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:16:00+00:00 exited with status queued for try_number 1 2024-05-25T01:17:01.142879269Z [2024-05-25T01:17:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:16:00+00:00 exited with status queued for try_number 1 2024-05-25T01:17:01.154534715Z [2024-05-25T01:17:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ddd5659-4f56-4057-9f25-416415abee16 2024-05-25T01:17:01.154733716Z [2024-05-25T01:17:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3b1daa3-7036-4290-93f0-c3bf069442af 2024-05-25T01:17:01.154919811Z [2024-05-25T01:17:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46fa019e-2ebb-4e80-a822-3435fb607628 2024-05-25T01:17:02.372488079Z [2024-05-25T01:17:02.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:17:02.372871148Z [2024-05-25T01:17:02.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:16:00+00:00, run_id=scheduled__2024-05-25T01:16:00+00:00, run_start_date=2024-05-25 01:17:00.812010+00:00, run_end_date=2024-05-25 01:17:02.372458+00:00, run_duration=1.560448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:16:00+00:00, data_interval_end=2024-05-25 01:17:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:17:02.387901121Z [2024-05-25T01:17:02.387+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:17:00+00:00, run_after=2024-05-25T01:18:00+00:00 2024-05-25T01:17:02.437413936Z [2024-05-25T01:17:02.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:16:00+00:00 exited with status success for try_number 1 2024-05-25T01:17:02.442745665Z [2024-05-25T01:17:02.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:16:00+00:00, map_index=-1, run_start_date=2024-05-25 01:17:01.700564+00:00, run_end_date=2024-05-25 01:17:02.090297+00:00, run_duration=0.389733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:17:00.884154+00:00, queued_by_job_id=1, pid=9031 2024-05-25T01:17:04.582261230Z [2024-05-25T01:17:04.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:17:04.582587746Z [2024-05-25T01:17:04.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:16:00+00:00, run_id=scheduled__2024-05-25T01:16:00+00:00, run_start_date=2024-05-25 01:17:00.813264+00:00, run_end_date=2024-05-25 01:17:04.582116+00:00, run_duration=3.768852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:16:00+00:00, data_interval_end=2024-05-25 01:17:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:17:04.591385839Z [2024-05-25T01:17:04.591+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:17:00+00:00, run_after=2024-05-25T01:18:00+00:00 2024-05-25T01:17:04.655895316Z [2024-05-25T01:17:04.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:16:00+00:00 exited with status success for try_number 1 2024-05-25T01:17:04.663596778Z [2024-05-25T01:17:04.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:16:00+00:00, map_index=-1, run_start_date=2024-05-25 01:17:02.796168+00:00, run_end_date=2024-05-25 01:17:04.385060+00:00, run_duration=1.588892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=613, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:17:00.884154+00:00, queued_by_job_id=1, pid=9049 2024-05-25T01:17:05.721618742Z [2024-05-25T01:17:05.720+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:17:05.721962358Z [2024-05-25T01:17:05.721+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:16:00+00:00, run_id=scheduled__2024-05-25T01:16:00+00:00, run_start_date=2024-05-25 01:17:00.814392+00:00, run_end_date=2024-05-25 01:17:05.721397+00:00, run_duration=4.907005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:16:00+00:00, data_interval_end=2024-05-25 01:17:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:17:05.734884743Z [2024-05-25T01:17:05.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:17:00+00:00, run_after=2024-05-25T01:18:00+00:00 2024-05-25T01:17:05.781806209Z [2024-05-25T01:17:05.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:16:00+00:00 exited with status success for try_number 1 2024-05-25T01:17:05.791334198Z [2024-05-25T01:17:05.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:16:00+00:00, map_index=-1, run_start_date=2024-05-25 01:17:02.885901+00:00, run_end_date=2024-05-25 01:17:04.986198+00:00, run_duration=2.100297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=614, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:17:00.884154+00:00, queued_by_job_id=1, pid=9050 2024-05-25T01:18:00.217751752Z [2024-05-25T01:18:00.217+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:18:00.227484933Z [2024-05-25T01:18:00.225+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:18:00.244602928Z [2024-05-25T01:18:00.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:18:00+00:00, run_after=2024-05-25T01:19:00+00:00 2024-05-25T01:18:00.263673030Z [2024-05-25T01:18:00.263+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:18:00+00:00, run_after=2024-05-25T01:19:00+00:00 2024-05-25T01:18:00.344332155Z [2024-05-25T01:18:00.343+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:18:00.344375256Z 2024-05-25T01:18:00.344385990Z 2024-05-25T01:18:00.344394818Z 2024-05-25T01:18:00.344403341Z 2024-05-25T01:18:00.344860181Z [2024-05-25T01:18:00.344+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:18:00.345465108Z [2024-05-25T01:18:00.344+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:18:00.345997681Z [2024-05-25T01:18:00.345+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:18:00.346504856Z [2024-05-25T01:18:00.346+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:18:00.348857342Z [2024-05-25T01:18:00.348+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:18:00.348880130Z 2024-05-25T01:18:00.348890338Z 2024-05-25T01:18:00.348899069Z 2024-05-25T01:18:00.348907508Z 2024-05-25T01:18:00.356432442Z [2024-05-25T01:18:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:18:00.356733545Z [2024-05-25T01:18:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:18:00.357318696Z [2024-05-25T01:18:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:18:00.357727036Z [2024-05-25T01:18:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:18:00.358268089Z [2024-05-25T01:18:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:18:00.358645254Z [2024-05-25T01:18:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:18:00.359189502Z [2024-05-25T01:18:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:18:00.359500991Z [2024-05-25T01:18:00.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:18:00.810405788Z [2024-05-25T01:18:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:16:00+00:00 exited with status queued for try_number 1 2024-05-25T01:18:00.810438771Z [2024-05-25T01:18:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:17:00+00:00 exited with status queued for try_number 1 2024-05-25T01:18:00.810687707Z [2024-05-25T01:18:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:17:00+00:00 exited with status queued for try_number 1 2024-05-25T01:18:00.810754008Z [2024-05-25T01:18:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:17:00+00:00 exited with status queued for try_number 1 2024-05-25T01:18:00.830577203Z [2024-05-25T01:18:00.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9731d9ea-62e4-4a46-ac1f-344232348025 2024-05-25T01:18:00.830656088Z [2024-05-25T01:18:00.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbd3eba2-6f6d-4c51-9aa4-669750f656ea 2024-05-25T01:18:00.830757779Z [2024-05-25T01:18:00.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb3afc34-cc4c-4a7d-98ba-2008135107ca 2024-05-25T01:18:00.830966287Z [2024-05-25T01:18:00.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1642b73-6453-4ad6-82b0-f083f96f38a1 2024-05-25T01:18:02.106422448Z [2024-05-25T01:18:02.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:18:02.107088484Z [2024-05-25T01:18:02.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:16:00+00:00, run_id=scheduled__2024-05-25T01:16:00+00:00, run_start_date=2024-05-25 01:18:00.276941+00:00, run_end_date=2024-05-25 01:18:02.106613+00:00, run_duration=1.829672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:16:00+00:00, data_interval_end=2024-05-25 01:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:18:02.120933498Z [2024-05-25T01:18:02.120+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:18:00+00:00, run_after=2024-05-25T01:20:00+00:00 2024-05-25T01:18:02.131370820Z [2024-05-25T01:18:02.130+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:18:02.131792146Z [2024-05-25T01:18:02.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:17:00+00:00, run_id=scheduled__2024-05-25T01:17:00+00:00, run_start_date=2024-05-25 01:18:00.278508+00:00, run_end_date=2024-05-25 01:18:02.131452+00:00, run_duration=1.852944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:17:00+00:00, data_interval_end=2024-05-25 01:18:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:18:02.146393965Z [2024-05-25T01:18:02.145+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:18:00+00:00, run_after=2024-05-25T01:19:00+00:00 2024-05-25T01:18:02.246044027Z [2024-05-25T01:18:02.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:16:00+00:00 exited with status success for try_number 1 2024-05-25T01:18:02.246830619Z [2024-05-25T01:18:02.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:17:00+00:00 exited with status success for try_number 1 2024-05-25T01:18:02.254168672Z [2024-05-25T01:18:02.253+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:16:00+00:00, map_index=-1, run_start_date=2024-05-25 01:18:01.087880+00:00, run_end_date=2024-05-25 01:18:01.512446+00:00, run_duration=0.424566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=615, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:18:00.351279+00:00, queued_by_job_id=1, pid=9084 2024-05-25T01:18:02.254445541Z [2024-05-25T01:18:02.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:17:00+00:00, map_index=-1, run_start_date=2024-05-25 01:18:01.201295+00:00, run_end_date=2024-05-25 01:18:01.690293+00:00, run_duration=0.488998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=616, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:18:00.351279+00:00, queued_by_job_id=1, pid=9085 2024-05-25T01:18:04.462566035Z [2024-05-25T01:18:04.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:18:04.463385055Z [2024-05-25T01:18:04.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:17:00+00:00, run_id=scheduled__2024-05-25T01:17:00+00:00, run_start_date=2024-05-25 01:18:00.279710+00:00, run_end_date=2024-05-25 01:18:04.462836+00:00, run_duration=4.183126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:17:00+00:00, data_interval_end=2024-05-25 01:18:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:18:04.487282249Z [2024-05-25T01:18:04.486+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:18:00+00:00, run_after=2024-05-25T01:19:00+00:00 2024-05-25T01:18:04.496937737Z [2024-05-25T01:18:04.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:18:04.501425335Z [2024-05-25T01:18:04.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:17:00+00:00, run_id=scheduled__2024-05-25T01:17:00+00:00, run_start_date=2024-05-25 01:18:00.280877+00:00, run_end_date=2024-05-25 01:18:04.496783+00:00, run_duration=4.215906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:17:00+00:00, data_interval_end=2024-05-25 01:18:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:18:04.522253406Z [2024-05-25T01:18:04.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:18:00+00:00, run_after=2024-05-25T01:19:00+00:00 2024-05-25T01:18:04.560086637Z [2024-05-25T01:18:04.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:17:00+00:00 exited with status success for try_number 1 2024-05-25T01:18:04.560437667Z [2024-05-25T01:18:04.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:17:00+00:00 exited with status success for try_number 1 2024-05-25T01:18:04.568966138Z [2024-05-25T01:18:04.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:17:00+00:00, map_index=-1, run_start_date=2024-05-25 01:18:02.420525+00:00, run_end_date=2024-05-25 01:18:03.722008+00:00, run_duration=1.301483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=618, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:18:00.351279+00:00, queued_by_job_id=1, pid=9109 2024-05-25T01:18:04.569283032Z [2024-05-25T01:18:04.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:17:00+00:00, map_index=-1, run_start_date=2024-05-25 01:18:02.144198+00:00, run_end_date=2024-05-25 01:18:03.872295+00:00, run_duration=1.728097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=617, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:18:00.351279+00:00, queued_by_job_id=1, pid=9103 2024-05-25T01:19:00.214080214Z [2024-05-25T01:19:00.213+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:19:00+00:00, run_after=2024-05-25T01:20:00+00:00 2024-05-25T01:19:00.222899516Z [2024-05-25T01:19:00.222+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:19:00.234527647Z [2024-05-25T01:19:00.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:19:00+00:00, run_after=2024-05-25T01:20:00+00:00 2024-05-25T01:19:00.291785111Z [2024-05-25T01:19:00.291+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:19:00.291816797Z 2024-05-25T01:19:00.291820767Z 2024-05-25T01:19:00.291824018Z 2024-05-25T01:19:00.292204484Z [2024-05-25T01:19:00.291+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:19:00.292827161Z [2024-05-25T01:19:00.292+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:19:00.293546311Z [2024-05-25T01:19:00.293+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:19:00.295418230Z [2024-05-25T01:19:00.294+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:19:00.295450165Z 2024-05-25T01:19:00.295461032Z 2024-05-25T01:19:00.295469647Z 2024-05-25T01:19:00.302215104Z [2024-05-25T01:19:00.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:19:00.302556128Z [2024-05-25T01:19:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:19:00.302945655Z [2024-05-25T01:19:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:19:00.303239434Z [2024-05-25T01:19:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:19:00.303764457Z [2024-05-25T01:19:00.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:19:00.304107258Z [2024-05-25T01:19:00.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:19:00.640294565Z [2024-05-25T01:19:00.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:18:00+00:00 exited with status queued for try_number 1 2024-05-25T01:19:00.640508852Z [2024-05-25T01:19:00.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:18:00+00:00 exited with status queued for try_number 1 2024-05-25T01:19:00.640653491Z [2024-05-25T01:19:00.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:18:00+00:00 exited with status queued for try_number 1 2024-05-25T01:19:00.648088911Z [2024-05-25T01:19:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a07b478-b9ab-4819-a644-04c62027e237 2024-05-25T01:19:00.648295779Z [2024-05-25T01:19:00.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c87c04b-dc44-47c8-9296-925c6cb2bb88 2024-05-25T01:19:00.648617314Z [2024-05-25T01:19:00.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 822d89b4-0ee6-4ac4-ab65-d1cb9b76a7bc 2024-05-25T01:19:01.798669831Z [2024-05-25T01:19:01.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:19:01.799225810Z [2024-05-25T01:19:01.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:18:00+00:00, run_id=scheduled__2024-05-25T01:18:00+00:00, run_start_date=2024-05-25 01:19:00.243723+00:00, run_end_date=2024-05-25 01:19:01.798540+00:00, run_duration=1.554817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:18:00+00:00, data_interval_end=2024-05-25 01:19:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:19:01.810927867Z [2024-05-25T01:19:01.810+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:19:00+00:00, run_after=2024-05-25T01:20:00+00:00 2024-05-25T01:19:01.864505306Z [2024-05-25T01:19:01.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:18:00+00:00 exited with status success for try_number 1 2024-05-25T01:19:01.879850754Z [2024-05-25T01:19:01.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:18:00+00:00, map_index=-1, run_start_date=2024-05-25 01:19:01.111514+00:00, run_end_date=2024-05-25 01:19:01.509938+00:00, run_duration=0.398424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=619, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:19:00.297101+00:00, queued_by_job_id=1, pid=9142 2024-05-25T01:19:04.273428877Z [2024-05-25T01:19:04.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:19:04.274359996Z [2024-05-25T01:19:04.273+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:18:00+00:00, run_id=scheduled__2024-05-25T01:18:00+00:00, run_start_date=2024-05-25 01:19:00.244853+00:00, run_end_date=2024-05-25 01:19:04.273174+00:00, run_duration=4.028321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:18:00+00:00, data_interval_end=2024-05-25 01:19:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:19:04.289615279Z [2024-05-25T01:19:04.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:19:00+00:00, run_after=2024-05-25T01:20:00+00:00 2024-05-25T01:19:04.299532404Z [2024-05-25T01:19:04.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:19:04.299894534Z [2024-05-25T01:19:04.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:18:00+00:00, run_id=scheduled__2024-05-25T01:18:00+00:00, run_start_date=2024-05-25 01:19:00.245791+00:00, run_end_date=2024-05-25 01:19:04.299412+00:00, run_duration=4.053621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:18:00+00:00, data_interval_end=2024-05-25 01:19:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:19:04.310292423Z [2024-05-25T01:19:04.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:19:00+00:00, run_after=2024-05-25T01:20:00+00:00 2024-05-25T01:19:04.356231111Z [2024-05-25T01:19:04.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:18:00+00:00 exited with status success for try_number 1 2024-05-25T01:19:04.356506120Z [2024-05-25T01:19:04.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:18:00+00:00 exited with status success for try_number 1 2024-05-25T01:19:04.367273909Z [2024-05-25T01:19:04.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:18:00+00:00, map_index=-1, run_start_date=2024-05-25 01:19:02.394156+00:00, run_end_date=2024-05-25 01:19:03.763963+00:00, run_duration=1.369807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=621, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:19:00.297101+00:00, queued_by_job_id=1, pid=9161 2024-05-25T01:19:04.368090576Z [2024-05-25T01:19:04.367+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:18:00+00:00, map_index=-1, run_start_date=2024-05-25 01:19:02.236320+00:00, run_end_date=2024-05-25 01:19:03.868005+00:00, run_duration=1.631685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=620, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:19:00.297101+00:00, queued_by_job_id=1, pid=9160 2024-05-25T01:20:00.082747377Z [2024-05-25T01:20:00.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:20:00+00:00, run_after=2024-05-25T01:21:00+00:00 2024-05-25T01:20:00.100441469Z [2024-05-25T01:20:00.100+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:20:00+00:00, run_after=2024-05-25T01:21:00+00:00 2024-05-25T01:20:00.116694117Z [2024-05-25T01:20:00.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:20:00+00:00, run_after=2024-05-25T01:25:00+00:00 2024-05-25T01:20:00.125805164Z [2024-05-25T01:20:00.125+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:20:00.133829502Z [2024-05-25T01:20:00.133+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:20:00.309386902Z [2024-05-25T01:20:00.308+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T01:20:00.309462270Z 2024-05-25T01:20:00.309468374Z 2024-05-25T01:20:00.309474350Z 2024-05-25T01:20:00.309479471Z 2024-05-25T01:20:00.309505723Z 2024-05-25T01:20:00.309511314Z [2024-05-25T01:20:00.308+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:20:00.309517364Z [2024-05-25T01:20:00.309+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:20:00.309629636Z [2024-05-25T01:20:00.309+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:20:00.309806044Z [2024-05-25T01:20:00.309+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:20:00.309978920Z [2024-05-25T01:20:00.309+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:20:00.310797075Z [2024-05-25T01:20:00.310+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:20:00.310830059Z 2024-05-25T01:20:00.310853680Z 2024-05-25T01:20:00.310859251Z 2024-05-25T01:20:00.310864207Z 2024-05-25T01:20:00.310869458Z 2024-05-25T01:20:00.315701139Z [2024-05-25T01:20:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:20:00.315717353Z [2024-05-25T01:20:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:20:00.315722353Z [2024-05-25T01:20:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:20:00.315725956Z [2024-05-25T01:20:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:20:00.315729447Z [2024-05-25T01:20:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:20:00.315907432Z [2024-05-25T01:20:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:20:00.316140537Z [2024-05-25T01:20:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:20:00.316251414Z [2024-05-25T01:20:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:20:00.316465875Z [2024-05-25T01:20:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:20:00.316602610Z [2024-05-25T01:20:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:20:00.870316928Z [2024-05-25T01:20:00.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status queued for try_number 1 2024-05-25T01:20:00.870344510Z [2024-05-25T01:20:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:18:00+00:00 exited with status queued for try_number 1 2024-05-25T01:20:00.870392019Z [2024-05-25T01:20:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:19:00+00:00 exited with status queued for try_number 1 2024-05-25T01:20:00.870444115Z [2024-05-25T01:20:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:19:00+00:00 exited with status queued for try_number 1 2024-05-25T01:20:00.870508800Z [2024-05-25T01:20:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:19:00+00:00 exited with status queued for try_number 1 2024-05-25T01:20:00.879358352Z [2024-05-25T01:20:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1370844e-d13a-45b8-9422-b0b21a400cb7 2024-05-25T01:20:00.879410402Z [2024-05-25T01:20:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to d75aaecc-bb4b-4578-baa4-83780e4ed6cb 2024-05-25T01:20:00.879565237Z [2024-05-25T01:20:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18cb2a1e-189e-4aab-8ddf-bcbc4aa550e7 2024-05-25T01:20:00.879716712Z [2024-05-25T01:20:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b1b15e3-c121-42ef-ae4c-5a0ec3771152 2024-05-25T01:20:00.879871147Z [2024-05-25T01:20:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58de2303-94e2-4792-8672-adcb5ab7adc6 2024-05-25T01:20:02.044919203Z [2024-05-25T01:20:02.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:20:02.045263816Z [2024-05-25T01:20:02.045+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:18:00+00:00, run_id=scheduled__2024-05-25T01:18:00+00:00, run_start_date=2024-05-25 01:20:00.147472+00:00, run_end_date=2024-05-25 01:20:02.044830+00:00, run_duration=1.897358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:18:00+00:00, data_interval_end=2024-05-25 01:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:20:02.053105171Z [2024-05-25T01:20:02.052+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:20:00+00:00, run_after=2024-05-25T01:22:00+00:00 2024-05-25T01:20:02.059349669Z [2024-05-25T01:20:02.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:20:02.059716820Z [2024-05-25T01:20:02.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:19:00+00:00, run_id=scheduled__2024-05-25T01:19:00+00:00, run_start_date=2024-05-25 01:20:00.148940+00:00, run_end_date=2024-05-25 01:20:02.059262+00:00, run_duration=1.910322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:19:00+00:00, data_interval_end=2024-05-25 01:20:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:20:02.069264943Z [2024-05-25T01:20:02.068+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:20:00+00:00, run_after=2024-05-25T01:21:00+00:00 2024-05-25T01:20:02.115311834Z [2024-05-25T01:20:02.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:18:00+00:00 exited with status success for try_number 1 2024-05-25T01:20:02.115394710Z [2024-05-25T01:20:02.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:19:00+00:00 exited with status success for try_number 1 2024-05-25T01:20:02.121758226Z [2024-05-25T01:20:02.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:19:00+00:00, map_index=-1, run_start_date=2024-05-25 01:20:01.325478+00:00, run_end_date=2024-05-25 01:20:01.765078+00:00, run_duration=0.4396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=623, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:20:00.312104+00:00, queued_by_job_id=1, pid=9196 2024-05-25T01:20:02.121965564Z [2024-05-25T01:20:02.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:18:00+00:00, map_index=-1, run_start_date=2024-05-25 01:20:01.292193+00:00, run_end_date=2024-05-25 01:20:01.775880+00:00, run_duration=0.483687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=622, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:20:00.312104+00:00, queued_by_job_id=1, pid=9195 2024-05-25T01:20:03.233875401Z [2024-05-25T01:20:03.233+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:20:03.233908886Z 2024-05-25T01:20:03.233997965Z [2024-05-25T01:20:03.233+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:20:03.234698038Z [2024-05-25T01:20:03.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:20:03.234715387Z 2024-05-25T01:20:03.237304528Z [2024-05-25T01:20:03.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:20:03.237572909Z [2024-05-25T01:20:03.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:20:03.289770157Z [2024-05-25T01:20:03.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status queued for try_number 1 2024-05-25T01:20:03.289896097Z [2024-05-25T01:20:03.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status success for try_number 1 2024-05-25T01:20:03.300943592Z [2024-05-25T01:20:03.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to 811202f8-950b-4b1f-a2a7-c535e85f25cb 2024-05-25T01:20:03.301192191Z [2024-05-25T01:20:03.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:15:00+00:00, map_index=-1, run_start_date=2024-05-25 01:20:02.697177+00:00, run_end_date=2024-05-25 01:20:03.003709+00:00, run_duration=0.306532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=626, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:20:00.312104+00:00, queued_by_job_id=1, pid=9227 2024-05-25T01:20:04.067534480Z [2024-05-25T01:20:04.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:20:04.067785557Z [2024-05-25T01:20:04.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:19:00+00:00, run_id=scheduled__2024-05-25T01:19:00+00:00, run_start_date=2024-05-25 01:20:00.150417+00:00, run_end_date=2024-05-25 01:20:04.067389+00:00, run_duration=3.916972, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:19:00+00:00, data_interval_end=2024-05-25 01:20:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:20:04.076624415Z [2024-05-25T01:20:04.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:20:00+00:00, run_after=2024-05-25T01:21:00+00:00 2024-05-25T01:20:04.171128232Z [2024-05-25T01:20:04.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:19:00+00:00 exited with status success for try_number 1 2024-05-25T01:20:04.178758945Z [2024-05-25T01:20:04.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:19:00+00:00, map_index=-1, run_start_date=2024-05-25 01:20:02.669128+00:00, run_end_date=2024-05-25 01:20:04.003965+00:00, run_duration=1.334837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=625, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:20:00.312104+00:00, queued_by_job_id=1, pid=9226 2024-05-25T01:20:05.285606901Z [2024-05-25T01:20:05.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:20:05.286033157Z [2024-05-25T01:20:05.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:19:00+00:00, run_id=scheduled__2024-05-25T01:19:00+00:00, run_start_date=2024-05-25 01:20:00.151906+00:00, run_end_date=2024-05-25 01:20:05.285510+00:00, run_duration=5.133604, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:19:00+00:00, data_interval_end=2024-05-25 01:20:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:20:05.296004373Z [2024-05-25T01:20:05.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:20:00+00:00, run_after=2024-05-25T01:21:00+00:00 2024-05-25T01:20:05.344720340Z [2024-05-25T01:20:05.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:19:00+00:00 exited with status success for try_number 1 2024-05-25T01:20:05.354239256Z [2024-05-25T01:20:05.353+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:19:00+00:00, map_index=-1, run_start_date=2024-05-25 01:20:02.553179+00:00, run_end_date=2024-05-25 01:20:04.502698+00:00, run_duration=1.949519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=624, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:20:00.312104+00:00, queued_by_job_id=1, pid=9225 2024-05-25T01:20:06.432868458Z [2024-05-25T01:20:06.432+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:20:06.432898053Z 2024-05-25T01:20:06.432902084Z [2024-05-25T01:20:06.432+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:20:06.434417481Z [2024-05-25T01:20:06.434+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:20:06.434431044Z 2024-05-25T01:20:06.437771952Z [2024-05-25T01:20:06.437+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:20:06.437791729Z [2024-05-25T01:20:06.437+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:20:06.498740069Z [2024-05-25T01:20:06.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status queued for try_number 1 2024-05-25T01:20:06.500790168Z [2024-05-25T01:20:06.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status success for try_number 1 2024-05-25T01:20:06.535881543Z [2024-05-25T01:20:06.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to eaaca740-0c5c-429e-83b5-b178efec60cc 2024-05-25T01:20:06.535920274Z [2024-05-25T01:20:06.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T01:15:00+00:00, map_index=-1, run_start_date=2024-05-25 01:20:04.938331+00:00, run_end_date=2024-05-25 01:20:05.338428+00:00, run_duration=0.400097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=627, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:20:03.235100+00:00, queued_by_job_id=1, pid=9250 2024-05-25T01:20:09.138452392Z [2024-05-25T01:20:09.138+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:20:09.138493427Z 2024-05-25T01:20:09.138524151Z [2024-05-25T01:20:09.138+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:20:09.139033401Z [2024-05-25T01:20:09.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:20:09.139139841Z 2024-05-25T01:20:09.141001403Z [2024-05-25T01:20:09.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:20:09.141070652Z [2024-05-25T01:20:09.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:20:09.209058417Z [2024-05-25T01:20:09.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status queued for try_number 1 2024-05-25T01:20:09.209399131Z [2024-05-25T01:20:09.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status success for try_number 1 2024-05-25T01:20:09.218467893Z [2024-05-25T01:20:09.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7b11720-cfe6-41ff-8452-e0246811a4b4 2024-05-25T01:20:09.218853288Z [2024-05-25T01:20:09.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:15:00+00:00, map_index=0, run_start_date=2024-05-25 01:20:08.118152+00:00, run_end_date=2024-05-25 01:20:08.485356+00:00, run_duration=0.367204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=628, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:20:06.435341+00:00, queued_by_job_id=1, pid=9271 2024-05-25T01:20:11.506124266Z [2024-05-25T01:20:11.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:20:11.506699495Z [2024-05-25T01:20:11.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:15:00+00:00, run_id=scheduled__2024-05-25T01:15:00+00:00, run_start_date=2024-05-25 01:20:00.146000+00:00, run_end_date=2024-05-25 01:20:11.506236+00:00, run_duration=11.360236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:15:00+00:00, data_interval_end=2024-05-25 01:20:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T01:20:11.514741877Z [2024-05-25T01:20:11.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:20:00+00:00, run_after=2024-05-25T01:25:00+00:00 2024-05-25T01:20:11.569773648Z [2024-05-25T01:20:11.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:15:00+00:00 exited with status success for try_number 1 2024-05-25T01:20:11.580794344Z [2024-05-25T01:20:11.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:15:00+00:00, map_index=-1, run_start_date=2024-05-25 01:20:10.755824+00:00, run_end_date=2024-05-25 01:20:11.126409+00:00, run_duration=0.370585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=629, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:20:09.139212+00:00, queued_by_job_id=1, pid=9279 2024-05-25T01:20:29.102708630Z [2024-05-25T01:20:29.101+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T01:21:01.105318198Z [2024-05-25T01:21:01.104+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:21:00+00:00, run_after=2024-05-25T01:22:00+00:00 2024-05-25T01:21:01.123452950Z [2024-05-25T01:21:01.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:21:00+00:00, run_after=2024-05-25T01:22:00+00:00 2024-05-25T01:21:01.134932095Z [2024-05-25T01:21:01.134+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:21:01.225987662Z [2024-05-25T01:21:01.225+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:21:01.226038777Z 2024-05-25T01:21:01.226050320Z 2024-05-25T01:21:01.226058311Z 2024-05-25T01:21:01.226565400Z [2024-05-25T01:21:01.225+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:21:01.226999938Z [2024-05-25T01:21:01.226+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:21:01.227018033Z [2024-05-25T01:21:01.226+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:21:01.228202703Z [2024-05-25T01:21:01.227+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:21:01.228247632Z 2024-05-25T01:21:01.228256445Z 2024-05-25T01:21:01.228264442Z 2024-05-25T01:21:01.235361142Z [2024-05-25T01:21:01.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:21:01.235402122Z [2024-05-25T01:21:01.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:21:01.235899235Z [2024-05-25T01:21:01.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:21:01.236194132Z [2024-05-25T01:21:01.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:21:01.236731105Z [2024-05-25T01:21:01.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:21:01.237002911Z [2024-05-25T01:21:01.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:21:01.635105780Z [2024-05-25T01:21:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status queued for try_number 1 2024-05-25T01:21:01.636013854Z [2024-05-25T01:21:01.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status queued for try_number 1 2024-05-25T01:21:01.636420494Z [2024-05-25T01:21:01.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status queued for try_number 1 2024-05-25T01:21:01.653851076Z [2024-05-25T01:21:01.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to 250d14ef-b04a-483c-b82f-7b7041c85abf 2024-05-25T01:21:01.654226721Z [2024-05-25T01:21:01.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8e6d235-975b-4aff-b389-10b40bfe72a7 2024-05-25T01:21:01.654570876Z [2024-05-25T01:21:01.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a4fa049-801b-48af-b7f9-bb23c4611f6e 2024-05-25T01:21:02.797802600Z [2024-05-25T01:21:02.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:21:02.798515850Z [2024-05-25T01:21:02.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:20:00+00:00, run_id=scheduled__2024-05-25T01:20:00+00:00, run_start_date=2024-05-25 01:21:01.148728+00:00, run_end_date=2024-05-25 01:21:02.797880+00:00, run_duration=1.649152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:20:00+00:00, data_interval_end=2024-05-25 01:21:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:21:02.809377198Z [2024-05-25T01:21:02.809+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:21:00+00:00, run_after=2024-05-25T01:22:00+00:00 2024-05-25T01:21:02.868814097Z [2024-05-25T01:21:02.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status success for try_number 1 2024-05-25T01:21:02.879220371Z [2024-05-25T01:21:02.878+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:20:00+00:00, map_index=-1, run_start_date=2024-05-25 01:21:02.058132+00:00, run_end_date=2024-05-25 01:21:02.523620+00:00, run_duration=0.465488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=630, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:21:01.230081+00:00, queued_by_job_id=1, pid=9288 2024-05-25T01:21:05.042528200Z [2024-05-25T01:21:05.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:21:05.043040480Z [2024-05-25T01:21:05.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:20:00+00:00, run_id=scheduled__2024-05-25T01:20:00+00:00, run_start_date=2024-05-25 01:21:01.150477+00:00, run_end_date=2024-05-25 01:21:05.042373+00:00, run_duration=3.891896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:20:00+00:00, data_interval_end=2024-05-25 01:21:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:21:05.059711868Z [2024-05-25T01:21:05.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:21:00+00:00, run_after=2024-05-25T01:22:00+00:00 2024-05-25T01:21:05.119121627Z [2024-05-25T01:21:05.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status success for try_number 1 2024-05-25T01:21:05.125777942Z [2024-05-25T01:21:05.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:20:00+00:00, map_index=-1, run_start_date=2024-05-25 01:21:03.018987+00:00, run_end_date=2024-05-25 01:21:04.781655+00:00, run_duration=1.762668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=631, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:21:01.230081+00:00, queued_by_job_id=1, pid=9306 2024-05-25T01:21:06.188642865Z [2024-05-25T01:21:06.188+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:21:06.188860649Z [2024-05-25T01:21:06.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:20:00+00:00, run_id=scheduled__2024-05-25T01:20:00+00:00, run_start_date=2024-05-25 01:21:01.151828+00:00, run_end_date=2024-05-25 01:21:06.188471+00:00, run_duration=5.036643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:20:00+00:00, data_interval_end=2024-05-25 01:21:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:21:06.198394888Z [2024-05-25T01:21:06.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:21:00+00:00, run_after=2024-05-25T01:22:00+00:00 2024-05-25T01:21:06.231868237Z [2024-05-25T01:21:06.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status success for try_number 1 2024-05-25T01:21:06.237806484Z [2024-05-25T01:21:06.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:20:00+00:00, map_index=-1, run_start_date=2024-05-25 01:21:03.046095+00:00, run_end_date=2024-05-25 01:21:05.190435+00:00, run_duration=2.14434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=632, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:21:01.230081+00:00, queued_by_job_id=1, pid=9307 2024-05-25T01:22:01.009088334Z [2024-05-25T01:22:01.008+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:22:00+00:00, run_after=2024-05-25T01:23:00+00:00 2024-05-25T01:22:01.017939403Z [2024-05-25T01:22:01.017+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:22:01.024935136Z [2024-05-25T01:22:01.024+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:22:01.036309772Z [2024-05-25T01:22:01.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:22:00+00:00, run_after=2024-05-25T01:23:00+00:00 2024-05-25T01:22:01.115682027Z [2024-05-25T01:22:01.115+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:22:01.115707925Z 2024-05-25T01:22:01.115712003Z 2024-05-25T01:22:01.115715189Z 2024-05-25T01:22:01.115734165Z 2024-05-25T01:22:01.115944209Z [2024-05-25T01:22:01.115+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:22:01.116098865Z [2024-05-25T01:22:01.115+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:22:01.116234216Z [2024-05-25T01:22:01.116+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:22:01.116380689Z [2024-05-25T01:22:01.116+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:22:01.116995616Z [2024-05-25T01:22:01.116+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:22:01.117006139Z 2024-05-25T01:22:01.117010098Z 2024-05-25T01:22:01.117013221Z 2024-05-25T01:22:01.117016490Z 2024-05-25T01:22:01.120955521Z [2024-05-25T01:22:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:22:01.121068445Z [2024-05-25T01:22:01.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:22:01.121260976Z [2024-05-25T01:22:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:22:01.121387464Z [2024-05-25T01:22:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:22:01.121623579Z [2024-05-25T01:22:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:22:01.121785358Z [2024-05-25T01:22:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:22:01.122031921Z [2024-05-25T01:22:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:22:01.122153321Z [2024-05-25T01:22:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:22:01.508099458Z [2024-05-25T01:22:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status queued for try_number 1 2024-05-25T01:22:01.510354060Z [2024-05-25T01:22:01.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:21:00+00:00 exited with status queued for try_number 1 2024-05-25T01:22:01.510451557Z [2024-05-25T01:22:01.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:21:00+00:00 exited with status queued for try_number 1 2024-05-25T01:22:01.510553518Z [2024-05-25T01:22:01.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:21:00+00:00 exited with status queued for try_number 1 2024-05-25T01:22:01.534741036Z [2024-05-25T01:22:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39501510-1305-4460-8e38-66a601e8287f 2024-05-25T01:22:01.534987828Z [2024-05-25T01:22:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae249270-c86c-480e-8de1-d67b8c8c7843 2024-05-25T01:22:01.535138104Z [2024-05-25T01:22:01.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to b63b2c39-7141-477f-926a-f2f142c14889 2024-05-25T01:22:01.535582978Z [2024-05-25T01:22:01.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0982256a-0790-49bc-ac84-b12ae276525e 2024-05-25T01:22:02.783286588Z [2024-05-25T01:22:02.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:22:02.783674776Z [2024-05-25T01:22:02.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:20:00+00:00, run_id=scheduled__2024-05-25T01:20:00+00:00, run_start_date=2024-05-25 01:22:01.046501+00:00, run_end_date=2024-05-25 01:22:02.783275+00:00, run_duration=1.736774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:20:00+00:00, data_interval_end=2024-05-25 01:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:22:02.793360902Z [2024-05-25T01:22:02.792+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:22:00+00:00, run_after=2024-05-25T01:24:00+00:00 2024-05-25T01:22:02.800450758Z [2024-05-25T01:22:02.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:22:02.800854726Z [2024-05-25T01:22:02.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:21:00+00:00, run_id=scheduled__2024-05-25T01:21:00+00:00, run_start_date=2024-05-25 01:22:01.047647+00:00, run_end_date=2024-05-25 01:22:02.800543+00:00, run_duration=1.752896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:21:00+00:00, data_interval_end=2024-05-25 01:22:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:22:02.812500676Z [2024-05-25T01:22:02.811+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:22:00+00:00, run_after=2024-05-25T01:23:00+00:00 2024-05-25T01:22:02.869913142Z [2024-05-25T01:22:02.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status success for try_number 1 2024-05-25T01:22:02.869944573Z [2024-05-25T01:22:02.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:21:00+00:00 exited with status success for try_number 1 2024-05-25T01:22:02.879574219Z [2024-05-25T01:22:02.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:21:00+00:00, map_index=-1, run_start_date=2024-05-25 01:22:02.029991+00:00, run_end_date=2024-05-25 01:22:02.505452+00:00, run_duration=0.475461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=634, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:22:01.117848+00:00, queued_by_job_id=1, pid=9341 2024-05-25T01:22:02.879976323Z [2024-05-25T01:22:02.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:20:00+00:00, map_index=-1, run_start_date=2024-05-25 01:22:02.011489+00:00, run_end_date=2024-05-25 01:22:02.469862+00:00, run_duration=0.458373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=633, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:22:01.117848+00:00, queued_by_job_id=1, pid=9340 2024-05-25T01:22:05.045451821Z [2024-05-25T01:22:05.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:22:05.045762612Z [2024-05-25T01:22:05.045+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:21:00+00:00, run_id=scheduled__2024-05-25T01:21:00+00:00, run_start_date=2024-05-25 01:22:01.048806+00:00, run_end_date=2024-05-25 01:22:05.045405+00:00, run_duration=3.996599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:21:00+00:00, data_interval_end=2024-05-25 01:22:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:22:05.058016073Z [2024-05-25T01:22:05.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:22:00+00:00, run_after=2024-05-25T01:23:00+00:00 2024-05-25T01:22:05.122286671Z [2024-05-25T01:22:05.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:21:00+00:00 exited with status success for try_number 1 2024-05-25T01:22:05.127640767Z [2024-05-25T01:22:05.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:21:00+00:00, map_index=-1, run_start_date=2024-05-25 01:22:03.122944+00:00, run_end_date=2024-05-25 01:22:04.511673+00:00, run_duration=1.388729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=635, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:22:01.117848+00:00, queued_by_job_id=1, pid=9359 2024-05-25T01:22:06.176190944Z [2024-05-25T01:22:06.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:22:06.176594984Z [2024-05-25T01:22:06.176+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:21:00+00:00, run_id=scheduled__2024-05-25T01:21:00+00:00, run_start_date=2024-05-25 01:22:01.049799+00:00, run_end_date=2024-05-25 01:22:06.176227+00:00, run_duration=5.126428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:21:00+00:00, data_interval_end=2024-05-25 01:22:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:22:06.190594061Z [2024-05-25T01:22:06.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:22:00+00:00, run_after=2024-05-25T01:23:00+00:00 2024-05-25T01:22:06.257929201Z [2024-05-25T01:22:06.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:21:00+00:00 exited with status success for try_number 1 2024-05-25T01:22:06.265843851Z [2024-05-25T01:22:06.265+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:21:00+00:00, map_index=-1, run_start_date=2024-05-25 01:22:03.413542+00:00, run_end_date=2024-05-25 01:22:05.126227+00:00, run_duration=1.712685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=636, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:22:01.117848+00:00, queued_by_job_id=1, pid=9370 2024-05-25T01:23:00.386793745Z [2024-05-25T01:23:00.386+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:23:00.406873132Z [2024-05-25T01:23:00.406+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:23:00+00:00, run_after=2024-05-25T01:24:00+00:00 2024-05-25T01:23:00.432107911Z [2024-05-25T01:23:00.431+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:23:00+00:00, run_after=2024-05-25T01:24:00+00:00 2024-05-25T01:23:00.553009251Z [2024-05-25T01:23:00.552+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:23:00.553051239Z 2024-05-25T01:23:00.553060163Z 2024-05-25T01:23:00.553068088Z 2024-05-25T01:23:00.553568968Z [2024-05-25T01:23:00.553+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:23:00.554096476Z [2024-05-25T01:23:00.553+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:23:00.554561194Z [2024-05-25T01:23:00.554+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:23:00.556141657Z [2024-05-25T01:23:00.555+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:23:00.556163089Z 2024-05-25T01:23:00.556171432Z 2024-05-25T01:23:00.556179220Z 2024-05-25T01:23:00.561148401Z [2024-05-25T01:23:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:23:00.561181833Z [2024-05-25T01:23:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:23:00.561565960Z [2024-05-25T01:23:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:23:00.561839321Z [2024-05-25T01:23:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:23:00.562253348Z [2024-05-25T01:23:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:23:00.562618473Z [2024-05-25T01:23:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:23:00.795051338Z [2024-05-25T01:23:00.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:22:00+00:00 exited with status queued for try_number 1 2024-05-25T01:23:00.797277933Z [2024-05-25T01:23:00.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:22:00+00:00 exited with status queued for try_number 1 2024-05-25T01:23:00.797310260Z [2024-05-25T01:23:00.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:22:00+00:00 exited with status queued for try_number 1 2024-05-25T01:23:00.805127989Z [2024-05-25T01:23:00.804+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8845260-e651-4fb4-ad9d-dcf0fbe12e75 2024-05-25T01:23:00.805191201Z [2024-05-25T01:23:00.804+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c28eadf-c0a1-4ba4-ab27-1c52d4442048 2024-05-25T01:23:00.805412476Z [2024-05-25T01:23:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4616e74c-5c7f-4d9c-95a1-0ae8a61dad45 2024-05-25T01:23:01.980140170Z [2024-05-25T01:23:01.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:23:01.981200188Z [2024-05-25T01:23:01.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:22:00+00:00, run_id=scheduled__2024-05-25T01:22:00+00:00, run_start_date=2024-05-25 01:23:00.446629+00:00, run_end_date=2024-05-25 01:23:01.980516+00:00, run_duration=1.533887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:22:00+00:00, data_interval_end=2024-05-25 01:23:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:23:01.996630186Z [2024-05-25T01:23:01.996+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:23:00+00:00, run_after=2024-05-25T01:24:00+00:00 2024-05-25T01:23:02.053018007Z [2024-05-25T01:23:02.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:22:00+00:00 exited with status success for try_number 1 2024-05-25T01:23:02.059968881Z [2024-05-25T01:23:02.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:22:00+00:00, map_index=-1, run_start_date=2024-05-25 01:23:01.489500+00:00, run_end_date=2024-05-25 01:23:01.875781+00:00, run_duration=0.386281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=637, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:23:00.558106+00:00, queued_by_job_id=1, pid=9396 2024-05-25T01:23:04.682531499Z [2024-05-25T01:23:04.682+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:23:04.682793559Z [2024-05-25T01:23:04.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:22:00+00:00, run_id=scheduled__2024-05-25T01:22:00+00:00, run_start_date=2024-05-25 01:23:00.448114+00:00, run_end_date=2024-05-25 01:23:04.682464+00:00, run_duration=4.23435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:22:00+00:00, data_interval_end=2024-05-25 01:23:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:23:04.692537154Z [2024-05-25T01:23:04.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:23:00+00:00, run_after=2024-05-25T01:24:00+00:00 2024-05-25T01:23:04.698897892Z [2024-05-25T01:23:04.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:23:04.699141754Z [2024-05-25T01:23:04.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:22:00+00:00, run_id=scheduled__2024-05-25T01:22:00+00:00, run_start_date=2024-05-25 01:23:00.449375+00:00, run_end_date=2024-05-25 01:23:04.698879+00:00, run_duration=4.249504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:22:00+00:00, data_interval_end=2024-05-25 01:23:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:23:04.707612753Z [2024-05-25T01:23:04.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:23:00+00:00, run_after=2024-05-25T01:24:00+00:00 2024-05-25T01:23:04.762842072Z [2024-05-25T01:23:04.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:22:00+00:00 exited with status success for try_number 1 2024-05-25T01:23:04.763269158Z [2024-05-25T01:23:04.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:22:00+00:00 exited with status success for try_number 1 2024-05-25T01:23:04.778899484Z [2024-05-25T01:23:04.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:22:00+00:00, map_index=-1, run_start_date=2024-05-25 01:23:02.534295+00:00, run_end_date=2024-05-25 01:23:04.091866+00:00, run_duration=1.557571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=639, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:23:00.558106+00:00, queued_by_job_id=1, pid=9415 2024-05-25T01:23:04.779900361Z [2024-05-25T01:23:04.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:22:00+00:00, map_index=-1, run_start_date=2024-05-25 01:23:02.416737+00:00, run_end_date=2024-05-25 01:23:04.464631+00:00, run_duration=2.047894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=638, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:23:00.558106+00:00, queued_by_job_id=1, pid=9414 2024-05-25T01:24:00.843281799Z [2024-05-25T01:24:00.842+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:24:00.872810844Z [2024-05-25T01:24:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:24:00+00:00, run_after=2024-05-25T01:25:00+00:00 2024-05-25T01:24:00.898000438Z [2024-05-25T01:24:00.897+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:24:00+00:00, run_after=2024-05-25T01:25:00+00:00 2024-05-25T01:24:00.908057236Z [2024-05-25T01:24:00.907+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:24:01.036507839Z [2024-05-25T01:24:01.036+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:24:01.036532055Z 2024-05-25T01:24:01.036535909Z 2024-05-25T01:24:01.036552874Z 2024-05-25T01:24:01.036556379Z 2024-05-25T01:24:01.036724281Z [2024-05-25T01:24:01.036+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:24:01.036866640Z [2024-05-25T01:24:01.036+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:24:01.037019482Z [2024-05-25T01:24:01.036+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:24:01.037269396Z [2024-05-25T01:24:01.037+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:24:01.037976583Z [2024-05-25T01:24:01.037+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:24:01.038005394Z 2024-05-25T01:24:01.038013922Z 2024-05-25T01:24:01.038021190Z 2024-05-25T01:24:01.038027888Z 2024-05-25T01:24:01.043336030Z [2024-05-25T01:24:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:24:01.043483891Z [2024-05-25T01:24:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:24:01.043814590Z [2024-05-25T01:24:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:24:01.043969189Z [2024-05-25T01:24:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:24:01.044225454Z [2024-05-25T01:24:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:24:01.044451352Z [2024-05-25T01:24:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:24:01.045916895Z [2024-05-25T01:24:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:24:01.046228928Z [2024-05-25T01:24:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:24:01.613407090Z [2024-05-25T01:24:01.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:22:00+00:00 exited with status queued for try_number 1 2024-05-25T01:24:01.615575914Z [2024-05-25T01:24:01.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:23:00+00:00 exited with status queued for try_number 1 2024-05-25T01:24:01.615891119Z [2024-05-25T01:24:01.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:23:00+00:00 exited with status queued for try_number 1 2024-05-25T01:24:01.616018233Z [2024-05-25T01:24:01.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:23:00+00:00 exited with status queued for try_number 1 2024-05-25T01:24:01.624664296Z [2024-05-25T01:24:01.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to c07079fe-6c40-4b6a-8d1b-aaf46a631789 2024-05-25T01:24:01.624982813Z [2024-05-25T01:24:01.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a8fab58-14a9-4b22-bc59-fa9a67f24ff3 2024-05-25T01:24:01.625324261Z [2024-05-25T01:24:01.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2346574f-552c-43d9-a36e-7c8a5a67c3ad 2024-05-25T01:24:01.625483307Z [2024-05-25T01:24:01.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1677203-303f-4db1-8cf2-d743067651ad 2024-05-25T01:24:02.803619482Z [2024-05-25T01:24:02.803+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:24:02.807662186Z [2024-05-25T01:24:02.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:22:00+00:00, run_id=scheduled__2024-05-25T01:22:00+00:00, run_start_date=2024-05-25 01:24:00.924106+00:00, run_end_date=2024-05-25 01:24:02.803515+00:00, run_duration=1.879409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:22:00+00:00, data_interval_end=2024-05-25 01:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:24:02.819521871Z [2024-05-25T01:24:02.819+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:24:00+00:00, run_after=2024-05-25T01:26:00+00:00 2024-05-25T01:24:02.929959294Z [2024-05-25T01:24:02.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:22:00+00:00 exited with status success for try_number 1 2024-05-25T01:24:02.936491624Z [2024-05-25T01:24:02.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:22:00+00:00, map_index=-1, run_start_date=2024-05-25 01:24:01.923422+00:00, run_end_date=2024-05-25 01:24:02.532032+00:00, run_duration=0.60861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=640, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:24:01.038921+00:00, queued_by_job_id=1, pid=9443 2024-05-25T01:24:03.505391319Z [2024-05-25T01:24:03.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:24:03.505752858Z [2024-05-25T01:24:03.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:23:00+00:00, run_id=scheduled__2024-05-25T01:23:00+00:00, run_start_date=2024-05-25 01:24:00.926112+00:00, run_end_date=2024-05-25 01:24:03.505428+00:00, run_duration=2.579316, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:23:00+00:00, data_interval_end=2024-05-25 01:24:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:24:03.514455829Z [2024-05-25T01:24:03.514+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:24:00+00:00, run_after=2024-05-25T01:25:00+00:00 2024-05-25T01:24:03.560224902Z [2024-05-25T01:24:03.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:23:00+00:00 exited with status success for try_number 1 2024-05-25T01:24:03.566719130Z [2024-05-25T01:24:03.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:23:00+00:00, map_index=-1, run_start_date=2024-05-25 01:24:02.396386+00:00, run_end_date=2024-05-25 01:24:02.959329+00:00, run_duration=0.562943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=641, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:24:01.038921+00:00, queued_by_job_id=1, pid=9453 2024-05-25T01:24:05.757352011Z [2024-05-25T01:24:05.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:24:05.757424402Z [2024-05-25T01:24:05.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:23:00+00:00, run_id=scheduled__2024-05-25T01:23:00+00:00, run_start_date=2024-05-25 01:24:00.927956+00:00, run_end_date=2024-05-25 01:24:05.756754+00:00, run_duration=4.828798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:23:00+00:00, data_interval_end=2024-05-25 01:24:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:24:05.766820015Z [2024-05-25T01:24:05.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:24:00+00:00, run_after=2024-05-25T01:25:00+00:00 2024-05-25T01:24:05.773532541Z [2024-05-25T01:24:05.772+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:24:05.773604408Z [2024-05-25T01:24:05.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:23:00+00:00, run_id=scheduled__2024-05-25T01:23:00+00:00, run_start_date=2024-05-25 01:24:00.929675+00:00, run_end_date=2024-05-25 01:24:05.773272+00:00, run_duration=4.843597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:23:00+00:00, data_interval_end=2024-05-25 01:24:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:24:05.782931991Z [2024-05-25T01:24:05.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:24:00+00:00, run_after=2024-05-25T01:25:00+00:00 2024-05-25T01:24:05.832518078Z [2024-05-25T01:24:05.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:23:00+00:00 exited with status success for try_number 1 2024-05-25T01:24:05.832581266Z [2024-05-25T01:24:05.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:23:00+00:00 exited with status success for try_number 1 2024-05-25T01:24:05.842238610Z [2024-05-25T01:24:05.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:23:00+00:00, map_index=-1, run_start_date=2024-05-25 01:24:03.331457+00:00, run_end_date=2024-05-25 01:24:04.706696+00:00, run_duration=1.375239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=643, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:24:01.038921+00:00, queued_by_job_id=1, pid=9473 2024-05-25T01:24:05.842414235Z [2024-05-25T01:24:05.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:23:00+00:00, map_index=-1, run_start_date=2024-05-25 01:24:03.284693+00:00, run_end_date=2024-05-25 01:24:04.833363+00:00, run_duration=1.54867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=642, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:24:01.038921+00:00, queued_by_job_id=1, pid=9472 2024-05-25T01:25:00.244083331Z [2024-05-25T01:25:00.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:25:00+00:00, run_after=2024-05-25T01:26:00+00:00 2024-05-25T01:25:00.256543922Z [2024-05-25T01:25:00.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:25:00+00:00, run_after=2024-05-25T01:30:00+00:00 2024-05-25T01:25:00.263863827Z [2024-05-25T01:25:00.263+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:25:00.274764916Z [2024-05-25T01:25:00.274+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:25:00+00:00, run_after=2024-05-25T01:26:00+00:00 2024-05-25T01:25:00.387261132Z [2024-05-25T01:25:00.386+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:25:00.387314943Z 2024-05-25T01:25:00.387339229Z 2024-05-25T01:25:00.387352136Z 2024-05-25T01:25:00.387364585Z 2024-05-25T01:25:00.387835641Z [2024-05-25T01:25:00.387+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:25:00.388213792Z [2024-05-25T01:25:00.387+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:25:00.388602908Z [2024-05-25T01:25:00.388+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:25:00.388903057Z [2024-05-25T01:25:00.388+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:25:00.389941206Z [2024-05-25T01:25:00.389+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:25:00.389972123Z 2024-05-25T01:25:00.389984567Z 2024-05-25T01:25:00.389996696Z 2024-05-25T01:25:00.390008179Z 2024-05-25T01:25:00.399337040Z [2024-05-25T01:25:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:25:00.399746676Z [2024-05-25T01:25:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:25:00.400367589Z [2024-05-25T01:25:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:25:00.400843577Z [2024-05-25T01:25:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:25:00.401276915Z [2024-05-25T01:25:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:25:00.401556994Z [2024-05-25T01:25:00.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:25:00.402043420Z [2024-05-25T01:25:00.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:25:00.402338481Z [2024-05-25T01:25:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:25:00.808849006Z [2024-05-25T01:25:00.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status queued for try_number 1 2024-05-25T01:25:00.809019670Z [2024-05-25T01:25:00.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:24:00+00:00 exited with status queued for try_number 1 2024-05-25T01:25:00.809162022Z [2024-05-25T01:25:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:24:00+00:00 exited with status queued for try_number 1 2024-05-25T01:25:00.809301905Z [2024-05-25T01:25:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:24:00+00:00 exited with status queued for try_number 1 2024-05-25T01:25:00.817561841Z [2024-05-25T01:25:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to de2b249a-fb4d-4c69-a56a-8d5239806b6e 2024-05-25T01:25:00.817759610Z [2024-05-25T01:25:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to c102627f-d901-46f7-a278-169ccf11bbb2 2024-05-25T01:25:00.818049400Z [2024-05-25T01:25:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae4f4482-8ddc-4b56-a48d-4c7a3ef390c1 2024-05-25T01:25:00.818279550Z [2024-05-25T01:25:00.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb720c4d-7bf8-428a-96f9-d4580009fb7f 2024-05-25T01:25:02.261725506Z [2024-05-25T01:25:02.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:24:00+00:00 exited with status success for try_number 1 2024-05-25T01:25:02.269688804Z [2024-05-25T01:25:02.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:24:00+00:00, map_index=-1, run_start_date=2024-05-25 01:25:01.564736+00:00, run_end_date=2024-05-25 01:25:02.077703+00:00, run_duration=0.512967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=644, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:25:00.392244+00:00, queued_by_job_id=1, pid=9507 2024-05-25T01:25:03.342877584Z [2024-05-25T01:25:03.342+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:25:03.343347232Z [2024-05-25T01:25:03.342+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:24:00+00:00, run_id=scheduled__2024-05-25T01:24:00+00:00, run_start_date=2024-05-25 01:25:00.289250+00:00, run_end_date=2024-05-25 01:25:03.342704+00:00, run_duration=3.053454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:24:00+00:00, data_interval_end=2024-05-25 01:25:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:25:03.361843529Z [2024-05-25T01:25:03.361+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:25:00+00:00, run_after=2024-05-25T01:26:00+00:00 2024-05-25T01:25:03.428314469Z [2024-05-25T01:25:03.427+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:25:03.428355039Z 2024-05-25T01:25:03.428697743Z [2024-05-25T01:25:03.428+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:25:03.429940594Z [2024-05-25T01:25:03.429+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:25:03.429962352Z 2024-05-25T01:25:03.434438494Z [2024-05-25T01:25:03.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:25:03.434733820Z [2024-05-25T01:25:03.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:25:03.513895981Z [2024-05-25T01:25:03.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status queued for try_number 1 2024-05-25T01:25:03.514004811Z [2024-05-25T01:25:03.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status success for try_number 1 2024-05-25T01:25:03.524411875Z [2024-05-25T01:25:03.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82d83f50-c4ae-43ac-a9fc-29eec8bb3472 2024-05-25T01:25:03.524948257Z [2024-05-25T01:25:03.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:20:00+00:00, map_index=-1, run_start_date=2024-05-25 01:25:02.726293+00:00, run_end_date=2024-05-25 01:25:03.099898+00:00, run_duration=0.373605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=647, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:25:00.392244+00:00, queued_by_job_id=1, pid=9532 2024-05-25T01:25:04.526787234Z [2024-05-25T01:25:04.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:25:04.526815916Z [2024-05-25T01:25:04.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:24:00+00:00, run_id=scheduled__2024-05-25T01:24:00+00:00, run_start_date=2024-05-25 01:25:00.290306+00:00, run_end_date=2024-05-25 01:25:04.525932+00:00, run_duration=4.235626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:24:00+00:00, data_interval_end=2024-05-25 01:25:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:25:04.536945641Z [2024-05-25T01:25:04.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:25:00+00:00, run_after=2024-05-25T01:26:00+00:00 2024-05-25T01:25:04.547934382Z [2024-05-25T01:25:04.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:25:04.548090890Z [2024-05-25T01:25:04.547+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:24:00+00:00, run_id=scheduled__2024-05-25T01:24:00+00:00, run_start_date=2024-05-25 01:25:00.291426+00:00, run_end_date=2024-05-25 01:25:04.547824+00:00, run_duration=4.256398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:24:00+00:00, data_interval_end=2024-05-25 01:25:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:25:04.558364813Z [2024-05-25T01:25:04.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:25:00+00:00, run_after=2024-05-25T01:26:00+00:00 2024-05-25T01:25:04.624795651Z [2024-05-25T01:25:04.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:24:00+00:00 exited with status success for try_number 1 2024-05-25T01:25:04.624830468Z [2024-05-25T01:25:04.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:24:00+00:00 exited with status success for try_number 1 2024-05-25T01:25:04.633607685Z [2024-05-25T01:25:04.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:24:00+00:00, map_index=-1, run_start_date=2024-05-25 01:25:02.622039+00:00, run_end_date=2024-05-25 01:25:03.897380+00:00, run_duration=1.275341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=646, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:25:00.392244+00:00, queued_by_job_id=1, pid=9531 2024-05-25T01:25:04.633910712Z [2024-05-25T01:25:04.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:24:00+00:00, map_index=-1, run_start_date=2024-05-25 01:25:02.623764+00:00, run_end_date=2024-05-25 01:25:04.254564+00:00, run_duration=1.6308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=645, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:25:00.392244+00:00, queued_by_job_id=1, pid=9530 2024-05-25T01:25:06.782515712Z [2024-05-25T01:25:06.782+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:25:06.782554487Z 2024-05-25T01:25:06.782790927Z [2024-05-25T01:25:06.782+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:25:06.783419350Z [2024-05-25T01:25:06.783+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:25:06.783435150Z 2024-05-25T01:25:06.786210708Z [2024-05-25T01:25:06.785+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:25:06.786474488Z [2024-05-25T01:25:06.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:25:06.844039317Z [2024-05-25T01:25:06.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status queued for try_number 1 2024-05-25T01:25:06.844179234Z [2024-05-25T01:25:06.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status success for try_number 1 2024-05-25T01:25:06.849327196Z [2024-05-25T01:25:06.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77865e2d-c2d0-4816-b067-5bce840e9a16 2024-05-25T01:25:06.849606006Z [2024-05-25T01:25:06.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T01:20:00+00:00, map_index=-1, run_start_date=2024-05-25 01:25:05.210343+00:00, run_end_date=2024-05-25 01:25:05.631088+00:00, run_duration=0.420745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=648, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:25:03.430651+00:00, queued_by_job_id=1, pid=9555 2024-05-25T01:25:09.115481190Z [2024-05-25T01:25:09.114+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:25:09.115539232Z 2024-05-25T01:25:09.115932873Z [2024-05-25T01:25:09.115+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:25:09.116907372Z [2024-05-25T01:25:09.116+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:25:09.116923656Z 2024-05-25T01:25:09.120533117Z [2024-05-25T01:25:09.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:25:09.120921260Z [2024-05-25T01:25:09.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:25:09.199875065Z [2024-05-25T01:25:09.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status queued for try_number 1 2024-05-25T01:25:09.200304274Z [2024-05-25T01:25:09.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status success for try_number 1 2024-05-25T01:25:09.210344215Z [2024-05-25T01:25:09.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35daab2b-ea54-4c9c-8ee9-2e41f0882a6c 2024-05-25T01:25:09.211091437Z [2024-05-25T01:25:09.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:20:00+00:00, map_index=0, run_start_date=2024-05-25 01:25:08.555482+00:00, run_end_date=2024-05-25 01:25:08.949705+00:00, run_duration=0.394223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=649, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:25:06.783957+00:00, queued_by_job_id=1, pid=9577 2024-05-25T01:25:11.931893398Z [2024-05-25T01:25:11.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:25:11.932435958Z [2024-05-25T01:25:11.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:20:00+00:00, run_id=scheduled__2024-05-25T01:20:00+00:00, run_start_date=2024-05-25 01:25:00.287915+00:00, run_end_date=2024-05-25 01:25:11.931697+00:00, run_duration=11.643782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:20:00+00:00, data_interval_end=2024-05-25 01:25:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T01:25:11.946388697Z [2024-05-25T01:25:11.945+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:25:00+00:00, run_after=2024-05-25T01:30:00+00:00 2024-05-25T01:25:11.987597762Z [2024-05-25T01:25:11.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:20:00+00:00 exited with status success for try_number 1 2024-05-25T01:25:11.995015655Z [2024-05-25T01:25:11.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:20:00+00:00, map_index=-1, run_start_date=2024-05-25 01:25:10.796457+00:00, run_end_date=2024-05-25 01:25:11.194304+00:00, run_duration=0.397847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=650, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:25:09.117609+00:00, queued_by_job_id=1, pid=9585 2024-05-25T01:25:29.191206866Z [2024-05-25T01:25:29.190+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T01:26:00.340402036Z [2024-05-25T01:26:00.339+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:26:00.349674320Z [2024-05-25T01:26:00.349+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:26:00.365528935Z [2024-05-25T01:26:00.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:26:00+00:00, run_after=2024-05-25T01:27:00+00:00 2024-05-25T01:26:00.377589763Z [2024-05-25T01:26:00.377+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:26:00+00:00, run_after=2024-05-25T01:27:00+00:00 2024-05-25T01:26:00.461329802Z [2024-05-25T01:26:00.460+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:26:00.461363988Z 2024-05-25T01:26:00.461370789Z 2024-05-25T01:26:00.461376332Z 2024-05-25T01:26:00.461380819Z 2024-05-25T01:26:00.461708999Z [2024-05-25T01:26:00.461+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:26:00.461905534Z [2024-05-25T01:26:00.461+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:26:00.462171798Z [2024-05-25T01:26:00.461+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:26:00.462446461Z [2024-05-25T01:26:00.462+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:26:00.463472020Z [2024-05-25T01:26:00.463+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:26:00.463486632Z 2024-05-25T01:26:00.463491684Z 2024-05-25T01:26:00.463495005Z 2024-05-25T01:26:00.463498080Z 2024-05-25T01:26:00.469090043Z [2024-05-25T01:26:00.468+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:26:00.469627728Z [2024-05-25T01:26:00.469+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:26:00.469934351Z [2024-05-25T01:26:00.469+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:26:00.470227188Z [2024-05-25T01:26:00.469+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:26:00.470637933Z [2024-05-25T01:26:00.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:26:00.471087051Z [2024-05-25T01:26:00.470+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:26:00.471569037Z [2024-05-25T01:26:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:26:00.471949260Z [2024-05-25T01:26:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:26:00.810401957Z [2024-05-25T01:26:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:24:00+00:00 exited with status queued for try_number 1 2024-05-25T01:26:00.810621567Z [2024-05-25T01:26:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status queued for try_number 1 2024-05-25T01:26:00.810963026Z [2024-05-25T01:26:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status queued for try_number 1 2024-05-25T01:26:00.811188059Z [2024-05-25T01:26:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status queued for try_number 1 2024-05-25T01:26:00.827947965Z [2024-05-25T01:26:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ed4b001-c081-4c5e-b4b0-317dc7b57529 2024-05-25T01:26:00.828338316Z [2024-05-25T01:26:00.828+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc0a28d7-3d8f-4eec-8f6e-203a95fdf682 2024-05-25T01:26:00.828562570Z [2024-05-25T01:26:00.828+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e96efaa-1785-4feb-9514-b78ee2192567 2024-05-25T01:26:00.828763243Z [2024-05-25T01:26:00.828+0000] {scheduler_job.py:635} INFO - Setting external_id for to a00a84e7-4f8d-49aa-8418-d6097a3354d1 2024-05-25T01:26:02.514418518Z [2024-05-25T01:26:02.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:26:02.515160375Z [2024-05-25T01:26:02.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:25:00+00:00, run_id=scheduled__2024-05-25T01:25:00+00:00, run_start_date=2024-05-25 01:26:00.399347+00:00, run_end_date=2024-05-25 01:26:02.514345+00:00, run_duration=2.114998, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:25:00+00:00, data_interval_end=2024-05-25 01:26:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:26:02.528948151Z [2024-05-25T01:26:02.528+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:26:00+00:00, run_after=2024-05-25T01:27:00+00:00 2024-05-25T01:26:02.535594685Z [2024-05-25T01:26:02.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:26:02.535919731Z [2024-05-25T01:26:02.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:24:00+00:00, run_id=scheduled__2024-05-25T01:24:00+00:00, run_start_date=2024-05-25 01:26:00.397992+00:00, run_end_date=2024-05-25 01:26:02.535492+00:00, run_duration=2.1375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:24:00+00:00, data_interval_end=2024-05-25 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:26:02.549937147Z [2024-05-25T01:26:02.549+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:26:00+00:00, run_after=2024-05-25T01:28:00+00:00 2024-05-25T01:26:02.606089570Z [2024-05-25T01:26:02.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:24:00+00:00 exited with status success for try_number 1 2024-05-25T01:26:02.606312783Z [2024-05-25T01:26:02.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status success for try_number 1 2024-05-25T01:26:02.618841300Z [2024-05-25T01:26:02.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:24:00+00:00, map_index=-1, run_start_date=2024-05-25 01:26:01.206330+00:00, run_end_date=2024-05-25 01:26:01.724914+00:00, run_duration=0.518584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=651, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:26:00.465093+00:00, queued_by_job_id=1, pid=9595 2024-05-25T01:26:02.618966221Z [2024-05-25T01:26:02.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:25:00+00:00, map_index=-1, run_start_date=2024-05-25 01:26:01.519803+00:00, run_end_date=2024-05-25 01:26:02.055248+00:00, run_duration=0.535445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=652, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:26:00.465093+00:00, queued_by_job_id=1, pid=9596 2024-05-25T01:26:04.783129133Z [2024-05-25T01:26:04.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:26:04.783623054Z [2024-05-25T01:26:04.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:25:00+00:00, run_id=scheduled__2024-05-25T01:25:00+00:00, run_start_date=2024-05-25 01:26:00.400535+00:00, run_end_date=2024-05-25 01:26:04.782970+00:00, run_duration=4.382435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:25:00+00:00, data_interval_end=2024-05-25 01:26:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:26:04.804093081Z [2024-05-25T01:26:04.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:26:00+00:00, run_after=2024-05-25T01:27:00+00:00 2024-05-25T01:26:04.841761204Z [2024-05-25T01:26:04.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status success for try_number 1 2024-05-25T01:26:04.848809193Z [2024-05-25T01:26:04.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:25:00+00:00, map_index=-1, run_start_date=2024-05-25 01:26:03.023234+00:00, run_end_date=2024-05-25 01:26:04.656226+00:00, run_duration=1.632992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=653, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:26:00.465093+00:00, queued_by_job_id=1, pid=9619 2024-05-25T01:26:05.892642625Z [2024-05-25T01:26:05.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:26:05.892833380Z [2024-05-25T01:26:05.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:25:00+00:00, run_id=scheduled__2024-05-25T01:25:00+00:00, run_start_date=2024-05-25 01:26:00.401645+00:00, run_end_date=2024-05-25 01:26:05.892458+00:00, run_duration=5.490813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:25:00+00:00, data_interval_end=2024-05-25 01:26:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:26:05.903024636Z [2024-05-25T01:26:05.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:26:00+00:00, run_after=2024-05-25T01:27:00+00:00 2024-05-25T01:26:05.949673675Z [2024-05-25T01:26:05.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status success for try_number 1 2024-05-25T01:26:05.956448366Z [2024-05-25T01:26:05.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:25:00+00:00, map_index=-1, run_start_date=2024-05-25 01:26:03.195586+00:00, run_end_date=2024-05-25 01:26:05.137482+00:00, run_duration=1.941896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=654, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:26:00.465093+00:00, queued_by_job_id=1, pid=9620 2024-05-25T01:27:00.581971322Z [2024-05-25T01:27:00.581+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:27:00.606493610Z [2024-05-25T01:27:00.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:27:00+00:00, run_after=2024-05-25T01:28:00+00:00 2024-05-25T01:27:00.623030476Z [2024-05-25T01:27:00.622+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:27:00+00:00, run_after=2024-05-25T01:28:00+00:00 2024-05-25T01:27:00.712476754Z [2024-05-25T01:27:00.711+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:27:00.712522984Z 2024-05-25T01:27:00.712532348Z 2024-05-25T01:27:00.712541094Z 2024-05-25T01:27:00.712911914Z [2024-05-25T01:27:00.712+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:27:00.713365098Z [2024-05-25T01:27:00.713+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:27:00.713751939Z [2024-05-25T01:27:00.713+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:27:00.715084399Z [2024-05-25T01:27:00.714+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:27:00.715110020Z 2024-05-25T01:27:00.715126272Z 2024-05-25T01:27:00.715140877Z 2024-05-25T01:27:00.721812346Z [2024-05-25T01:27:00.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:27:00.721901833Z [2024-05-25T01:27:00.721+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:27:00.722430474Z [2024-05-25T01:27:00.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:27:00.722661705Z [2024-05-25T01:27:00.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:27:00.723085544Z [2024-05-25T01:27:00.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:27:00.723305784Z [2024-05-25T01:27:00.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:27:00.958516748Z [2024-05-25T01:27:00.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:26:00+00:00 exited with status queued for try_number 1 2024-05-25T01:27:00.960638221Z [2024-05-25T01:27:00.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:26:00+00:00 exited with status queued for try_number 1 2024-05-25T01:27:00.960798099Z [2024-05-25T01:27:00.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:26:00+00:00 exited with status queued for try_number 1 2024-05-25T01:27:00.970543373Z [2024-05-25T01:27:00.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a0a946c-2a9c-4f9c-853e-a39d70268283 2024-05-25T01:27:00.970736238Z [2024-05-25T01:27:00.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63b367ff-83bb-45ed-ace1-33b8facb0592 2024-05-25T01:27:00.971036267Z [2024-05-25T01:27:00.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61e71a3c-af87-407d-86f4-c8968bf215d2 2024-05-25T01:27:01.861320927Z [2024-05-25T01:27:01.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:27:01.861700881Z [2024-05-25T01:27:01.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:26:00+00:00, run_id=scheduled__2024-05-25T01:26:00+00:00, run_start_date=2024-05-25 01:27:00.637550+00:00, run_end_date=2024-05-25 01:27:01.861308+00:00, run_duration=1.223758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:26:00+00:00, data_interval_end=2024-05-25 01:27:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:27:01.871569495Z [2024-05-25T01:27:01.871+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:27:00+00:00, run_after=2024-05-25T01:28:00+00:00 2024-05-25T01:27:03.077101465Z [2024-05-25T01:27:03.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:26:00+00:00 exited with status success for try_number 1 2024-05-25T01:27:03.084686453Z [2024-05-25T01:27:03.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:26:00+00:00, map_index=-1, run_start_date=2024-05-25 01:27:01.453315+00:00, run_end_date=2024-05-25 01:27:01.819773+00:00, run_duration=0.366458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=655, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:27:00.716824+00:00, queued_by_job_id=1, pid=9652 2024-05-25T01:27:05.242479083Z [2024-05-25T01:27:05.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:27:05.242544223Z [2024-05-25T01:27:05.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:26:00+00:00, run_id=scheduled__2024-05-25T01:26:00+00:00, run_start_date=2024-05-25 01:27:00.638872+00:00, run_end_date=2024-05-25 01:27:05.242160+00:00, run_duration=4.603288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:26:00+00:00, data_interval_end=2024-05-25 01:27:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:27:05.251647473Z [2024-05-25T01:27:05.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:27:00+00:00, run_after=2024-05-25T01:28:00+00:00 2024-05-25T01:27:05.260984616Z [2024-05-25T01:27:05.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:27:05.261343399Z [2024-05-25T01:27:05.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:26:00+00:00, run_id=scheduled__2024-05-25T01:26:00+00:00, run_start_date=2024-05-25 01:27:00.640024+00:00, run_end_date=2024-05-25 01:27:05.260852+00:00, run_duration=4.620828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:26:00+00:00, data_interval_end=2024-05-25 01:27:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:27:05.270409894Z [2024-05-25T01:27:05.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:27:00+00:00, run_after=2024-05-25T01:28:00+00:00 2024-05-25T01:27:05.305293620Z [2024-05-25T01:27:05.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:26:00+00:00 exited with status success for try_number 1 2024-05-25T01:27:05.305635452Z [2024-05-25T01:27:05.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:26:00+00:00 exited with status success for try_number 1 2024-05-25T01:27:05.312705813Z [2024-05-25T01:27:05.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:26:00+00:00, map_index=-1, run_start_date=2024-05-25 01:27:02.510894+00:00, run_end_date=2024-05-25 01:27:04.268124+00:00, run_duration=1.75723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=656, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:27:00.716824+00:00, queued_by_job_id=1, pid=9670 2024-05-25T01:27:05.312910770Z [2024-05-25T01:27:05.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:26:00+00:00, map_index=-1, run_start_date=2024-05-25 01:27:02.623570+00:00, run_end_date=2024-05-25 01:27:04.288384+00:00, run_duration=1.664814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=657, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:27:00.716824+00:00, queued_by_job_id=1, pid=9671 2024-05-25T01:28:00.863449450Z [2024-05-25T01:28:00.862+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:28:00.877671907Z [2024-05-25T01:28:00.877+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:28:00.897380122Z [2024-05-25T01:28:00.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:28:00+00:00, run_after=2024-05-25T01:29:00+00:00 2024-05-25T01:28:00.912036773Z [2024-05-25T01:28:00.911+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:28:00+00:00, run_after=2024-05-25T01:29:00+00:00 2024-05-25T01:28:01.019366210Z [2024-05-25T01:28:01.018+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:28:01.019406539Z 2024-05-25T01:28:01.019417965Z 2024-05-25T01:28:01.019426590Z 2024-05-25T01:28:01.019435197Z 2024-05-25T01:28:01.019943081Z [2024-05-25T01:28:01.019+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:28:01.019982825Z [2024-05-25T01:28:01.019+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:28:01.020366831Z [2024-05-25T01:28:01.020+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:28:01.020658428Z [2024-05-25T01:28:01.020+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:28:01.021553600Z [2024-05-25T01:28:01.021+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:28:01.021562086Z 2024-05-25T01:28:01.021575616Z 2024-05-25T01:28:01.021578766Z 2024-05-25T01:28:01.021581725Z 2024-05-25T01:28:01.027054848Z [2024-05-25T01:28:01.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:28:01.027378883Z [2024-05-25T01:28:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:28:01.027869243Z [2024-05-25T01:28:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:28:01.028014979Z [2024-05-25T01:28:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:28:01.028468334Z [2024-05-25T01:28:01.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:28:01.028695568Z [2024-05-25T01:28:01.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:28:01.029036148Z [2024-05-25T01:28:01.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:28:01.029174657Z [2024-05-25T01:28:01.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:28:01.500593903Z [2024-05-25T01:28:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:26:00+00:00 exited with status queued for try_number 1 2024-05-25T01:28:01.500636049Z [2024-05-25T01:28:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:27:00+00:00 exited with status queued for try_number 1 2024-05-25T01:28:01.500640189Z [2024-05-25T01:28:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:27:00+00:00 exited with status queued for try_number 1 2024-05-25T01:28:01.500704694Z [2024-05-25T01:28:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:27:00+00:00 exited with status queued for try_number 1 2024-05-25T01:28:01.518875003Z [2024-05-25T01:28:01.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87f6287b-5656-47ff-b018-ae88df3685d3 2024-05-25T01:28:01.518912578Z [2024-05-25T01:28:01.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96f8c86a-a3c5-4cc5-8f2d-75408f53bc05 2024-05-25T01:28:01.519035346Z [2024-05-25T01:28:01.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to f22920c9-b128-4fe2-95c2-fd905bf2613f 2024-05-25T01:28:01.519136383Z [2024-05-25T01:28:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84dc820a-6453-427c-b04e-ad22cb47a783 2024-05-25T01:28:02.462446657Z [2024-05-25T01:28:02.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:28:02.465766485Z [2024-05-25T01:28:02.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:26:00+00:00, run_id=scheduled__2024-05-25T01:26:00+00:00, run_start_date=2024-05-25 01:28:00.927599+00:00, run_end_date=2024-05-25 01:28:02.465323+00:00, run_duration=1.537724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:26:00+00:00, data_interval_end=2024-05-25 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:28:02.473010271Z [2024-05-25T01:28:02.472+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:28:00+00:00, run_after=2024-05-25T01:30:00+00:00 2024-05-25T01:28:02.865712894Z [2024-05-25T01:28:02.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:28:02.866446329Z [2024-05-25T01:28:02.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:27:00+00:00, run_id=scheduled__2024-05-25T01:27:00+00:00, run_start_date=2024-05-25 01:28:00.929872+00:00, run_end_date=2024-05-25 01:28:02.865602+00:00, run_duration=1.93573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:27:00+00:00, data_interval_end=2024-05-25 01:28:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:28:02.886887531Z [2024-05-25T01:28:02.886+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:28:00+00:00, run_after=2024-05-25T01:29:00+00:00 2024-05-25T01:28:02.974308419Z [2024-05-25T01:28:02.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:26:00+00:00 exited with status success for try_number 1 2024-05-25T01:28:02.974601744Z [2024-05-25T01:28:02.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:27:00+00:00 exited with status success for try_number 1 2024-05-25T01:28:02.981550651Z [2024-05-25T01:28:02.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:26:00+00:00, map_index=-1, run_start_date=2024-05-25 01:28:01.913080+00:00, run_end_date=2024-05-25 01:28:02.444155+00:00, run_duration=0.531075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=658, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:28:01.023064+00:00, queued_by_job_id=1, pid=9704 2024-05-25T01:28:02.981950106Z [2024-05-25T01:28:02.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:27:00+00:00, map_index=-1, run_start_date=2024-05-25 01:28:01.939334+00:00, run_end_date=2024-05-25 01:28:02.490355+00:00, run_duration=0.551021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=659, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:28:01.023064+00:00, queued_by_job_id=1, pid=9705 2024-05-25T01:28:05.142350315Z [2024-05-25T01:28:05.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:28:05.143146415Z [2024-05-25T01:28:05.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:27:00+00:00, run_id=scheduled__2024-05-25T01:27:00+00:00, run_start_date=2024-05-25 01:28:00.931330+00:00, run_end_date=2024-05-25 01:28:05.142500+00:00, run_duration=4.21117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:27:00+00:00, data_interval_end=2024-05-25 01:28:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:28:05.161059898Z [2024-05-25T01:28:05.160+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:28:00+00:00, run_after=2024-05-25T01:29:00+00:00 2024-05-25T01:28:06.258895177Z [2024-05-25T01:28:06.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:28:06.258956289Z [2024-05-25T01:28:06.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:27:00+00:00, run_id=scheduled__2024-05-25T01:27:00+00:00, run_start_date=2024-05-25 01:28:00.932753+00:00, run_end_date=2024-05-25 01:28:06.258598+00:00, run_duration=5.325845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:27:00+00:00, data_interval_end=2024-05-25 01:28:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:28:06.268224208Z [2024-05-25T01:28:06.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:28:00+00:00, run_after=2024-05-25T01:29:00+00:00 2024-05-25T01:28:06.325588233Z [2024-05-25T01:28:06.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:27:00+00:00 exited with status success for try_number 1 2024-05-25T01:28:06.325705988Z [2024-05-25T01:28:06.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:27:00+00:00 exited with status success for try_number 1 2024-05-25T01:28:06.337659070Z [2024-05-25T01:28:06.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:27:00+00:00, map_index=-1, run_start_date=2024-05-25 01:28:03.168905+00:00, run_end_date=2024-05-25 01:28:05.083626+00:00, run_duration=1.914721, state=success, executor_state=success, try_number=1, max_tries=1, job_id=661, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:28:01.023064+00:00, queued_by_job_id=1, pid=9729 2024-05-25T01:28:06.337903336Z [2024-05-25T01:28:06.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:27:00+00:00, map_index=-1, run_start_date=2024-05-25 01:28:03.121545+00:00, run_end_date=2024-05-25 01:28:05.787462+00:00, run_duration=2.665917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=660, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:28:01.023064+00:00, queued_by_job_id=1, pid=9728 2024-05-25T01:29:00.041064782Z [2024-05-25T01:29:00.040+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:29:00+00:00, run_after=2024-05-25T01:30:00+00:00 2024-05-25T01:29:00.060346336Z [2024-05-25T01:29:00.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:29:00+00:00, run_after=2024-05-25T01:30:00+00:00 2024-05-25T01:29:00.067383081Z [2024-05-25T01:29:00.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:29:00.119681449Z [2024-05-25T01:29:00.119+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:29:00.119821262Z 2024-05-25T01:29:00.119831364Z 2024-05-25T01:29:00.119839169Z 2024-05-25T01:29:00.119847513Z [2024-05-25T01:29:00.119+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:29:00.119855070Z [2024-05-25T01:29:00.119+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:29:00.119862902Z [2024-05-25T01:29:00.119+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:29:00.120134615Z [2024-05-25T01:29:00.119+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:29:00.120148985Z 2024-05-25T01:29:00.120157180Z 2024-05-25T01:29:00.120165245Z 2024-05-25T01:29:00.122791072Z [2024-05-25T01:29:00.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:29:00.122815724Z [2024-05-25T01:29:00.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:29:00.123060131Z [2024-05-25T01:29:00.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:29:00.123070548Z [2024-05-25T01:29:00.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:29:00.123208043Z [2024-05-25T01:29:00.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:29:00.123280531Z [2024-05-25T01:29:00.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:29:00.392320111Z [2024-05-25T01:29:00.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:28:00+00:00 exited with status queued for try_number 1 2024-05-25T01:29:00.392588182Z [2024-05-25T01:29:00.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:28:00+00:00 exited with status queued for try_number 1 2024-05-25T01:29:00.392845474Z [2024-05-25T01:29:00.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:28:00+00:00 exited with status queued for try_number 1 2024-05-25T01:29:00.403917505Z [2024-05-25T01:29:00.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to 850e5a23-0e14-4027-b2cf-ef736ceeb1de 2024-05-25T01:29:00.404035846Z [2024-05-25T01:29:00.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to 518a1723-8d03-4493-a1c6-303339fc9e6a 2024-05-25T01:29:00.404212056Z [2024-05-25T01:29:00.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f788f82-97e2-41b8-bf1c-d772d33ee31e 2024-05-25T01:29:01.535629792Z [2024-05-25T01:29:01.534+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:29:01.535661078Z [2024-05-25T01:29:01.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:28:00+00:00, run_id=scheduled__2024-05-25T01:28:00+00:00, run_start_date=2024-05-25 01:29:00.075544+00:00, run_end_date=2024-05-25 01:29:01.535220+00:00, run_duration=1.459676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:28:00+00:00, data_interval_end=2024-05-25 01:29:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:29:01.545228690Z [2024-05-25T01:29:01.544+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:29:00+00:00, run_after=2024-05-25T01:30:00+00:00 2024-05-25T01:29:01.597188404Z [2024-05-25T01:29:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:28:00+00:00 exited with status success for try_number 1 2024-05-25T01:29:01.603731441Z [2024-05-25T01:29:01.603+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:28:00+00:00, map_index=-1, run_start_date=2024-05-25 01:29:00.945845+00:00, run_end_date=2024-05-25 01:29:01.304978+00:00, run_duration=0.359133, state=success, executor_state=success, try_number=1, max_tries=1, job_id=662, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:29:00.120619+00:00, queued_by_job_id=1, pid=9761 2024-05-25T01:29:04.040963939Z [2024-05-25T01:29:04.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:29:04.041344363Z [2024-05-25T01:29:04.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:28:00+00:00, run_id=scheduled__2024-05-25T01:28:00+00:00, run_start_date=2024-05-25 01:29:00.076714+00:00, run_end_date=2024-05-25 01:29:04.040754+00:00, run_duration=3.96404, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:28:00+00:00, data_interval_end=2024-05-25 01:29:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:29:04.072592231Z [2024-05-25T01:29:04.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:29:00+00:00, run_after=2024-05-25T01:30:00+00:00 2024-05-25T01:29:04.080670446Z [2024-05-25T01:29:04.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:29:04.081090811Z [2024-05-25T01:29:04.080+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:28:00+00:00, run_id=scheduled__2024-05-25T01:28:00+00:00, run_start_date=2024-05-25 01:29:00.077658+00:00, run_end_date=2024-05-25 01:29:04.080582+00:00, run_duration=4.002924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:28:00+00:00, data_interval_end=2024-05-25 01:29:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:29:04.090800493Z [2024-05-25T01:29:04.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:29:00+00:00, run_after=2024-05-25T01:30:00+00:00 2024-05-25T01:29:04.134428764Z [2024-05-25T01:29:04.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:28:00+00:00 exited with status success for try_number 1 2024-05-25T01:29:04.134506556Z [2024-05-25T01:29:04.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:28:00+00:00 exited with status success for try_number 1 2024-05-25T01:29:04.145296869Z [2024-05-25T01:29:04.144+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:28:00+00:00, map_index=-1, run_start_date=2024-05-25 01:29:01.775353+00:00, run_end_date=2024-05-25 01:29:03.403868+00:00, run_duration=1.628515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=663, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:29:00.120619+00:00, queued_by_job_id=1, pid=9779 2024-05-25T01:29:04.145495525Z [2024-05-25T01:29:04.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:28:00+00:00, map_index=-1, run_start_date=2024-05-25 01:29:01.906503+00:00, run_end_date=2024-05-25 01:29:03.230840+00:00, run_duration=1.324337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=664, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:29:00.120619+00:00, queued_by_job_id=1, pid=9780 2024-05-25T01:30:01.095104527Z [2024-05-25T01:30:01.094+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:30:01.115658568Z [2024-05-25T01:30:01.115+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:30:00+00:00, run_after=2024-05-25T01:31:00+00:00 2024-05-25T01:30:01.131053441Z [2024-05-25T01:30:01.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:30:00+00:00, run_after=2024-05-25T01:31:00+00:00 2024-05-25T01:30:01.137749003Z [2024-05-25T01:30:01.137+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:30:01.152584795Z [2024-05-25T01:30:01.152+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:30:00+00:00, run_after=2024-05-25T01:35:00+00:00 2024-05-25T01:30:01.288848199Z [2024-05-25T01:30:01.288+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T01:30:01.288912217Z 2024-05-25T01:30:01.288920641Z 2024-05-25T01:30:01.288932842Z 2024-05-25T01:30:01.288976152Z 2024-05-25T01:30:01.289003045Z 2024-05-25T01:30:01.289009574Z [2024-05-25T01:30:01.288+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:30:01.289061457Z [2024-05-25T01:30:01.288+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:30:01.289068261Z [2024-05-25T01:30:01.288+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:30:01.289079847Z [2024-05-25T01:30:01.288+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:30:01.289121017Z [2024-05-25T01:30:01.289+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:30:01.289720983Z [2024-05-25T01:30:01.289+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:30:01.289734360Z 2024-05-25T01:30:01.289769230Z 2024-05-25T01:30:01.289774565Z 2024-05-25T01:30:01.289778210Z 2024-05-25T01:30:01.289782644Z 2024-05-25T01:30:01.296195834Z [2024-05-25T01:30:01.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:30:01.296214485Z [2024-05-25T01:30:01.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:30:01.296219265Z [2024-05-25T01:30:01.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:30:01.296224217Z [2024-05-25T01:30:01.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:30:01.296245642Z [2024-05-25T01:30:01.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:30:01.296249710Z [2024-05-25T01:30:01.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:30:01.296267185Z [2024-05-25T01:30:01.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:30:01.296278402Z [2024-05-25T01:30:01.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:30:01.296282481Z [2024-05-25T01:30:01.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:30:01.296286343Z [2024-05-25T01:30:01.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:30:01.866549694Z [2024-05-25T01:30:01.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status queued for try_number 1 2024-05-25T01:30:01.866585776Z [2024-05-25T01:30:01.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:28:00+00:00 exited with status queued for try_number 1 2024-05-25T01:30:01.866631178Z [2024-05-25T01:30:01.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:29:00+00:00 exited with status queued for try_number 1 2024-05-25T01:30:01.866670428Z [2024-05-25T01:30:01.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:29:00+00:00 exited with status queued for try_number 1 2024-05-25T01:30:01.866741917Z [2024-05-25T01:30:01.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:29:00+00:00 exited with status queued for try_number 1 2024-05-25T01:30:01.878769366Z [2024-05-25T01:30:01.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ca94ec8-200c-41b3-a2cb-218bf3f64782 2024-05-25T01:30:01.880650542Z [2024-05-25T01:30:01.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfc85466-7b00-4850-a082-66e75ac6cadb 2024-05-25T01:30:01.880926567Z [2024-05-25T01:30:01.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to c04b16e7-ea40-48f7-a4f3-3fc82c4f2543 2024-05-25T01:30:01.881148764Z [2024-05-25T01:30:01.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65eb3552-04f6-4790-8e7f-31a45323c67b 2024-05-25T01:30:01.881424496Z [2024-05-25T01:30:01.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29982fd0-024e-49a9-a4d4-86e4e69e82e5 2024-05-25T01:30:03.167197935Z [2024-05-25T01:30:03.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:30:03.167459004Z [2024-05-25T01:30:03.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:28:00+00:00, run_id=scheduled__2024-05-25T01:28:00+00:00, run_start_date=2024-05-25 01:30:01.184743+00:00, run_end_date=2024-05-25 01:30:03.167164+00:00, run_duration=1.982421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:28:00+00:00, data_interval_end=2024-05-25 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:30:03.175213626Z [2024-05-25T01:30:03.174+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:30:00+00:00, run_after=2024-05-25T01:32:00+00:00 2024-05-25T01:30:03.181608505Z [2024-05-25T01:30:03.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:30:03.181802251Z [2024-05-25T01:30:03.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:29:00+00:00, run_id=scheduled__2024-05-25T01:29:00+00:00, run_start_date=2024-05-25 01:30:01.186589+00:00, run_end_date=2024-05-25 01:30:03.181540+00:00, run_duration=1.994951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:29:00+00:00, data_interval_end=2024-05-25 01:30:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:30:03.190638769Z [2024-05-25T01:30:03.190+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:30:00+00:00, run_after=2024-05-25T01:31:00+00:00 2024-05-25T01:30:03.238101671Z [2024-05-25T01:30:03.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:28:00+00:00 exited with status success for try_number 1 2024-05-25T01:30:03.238182962Z [2024-05-25T01:30:03.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:29:00+00:00 exited with status success for try_number 1 2024-05-25T01:30:03.246689402Z [2024-05-25T01:30:03.246+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:29:00+00:00, map_index=-1, run_start_date=2024-05-25 01:30:02.674067+00:00, run_end_date=2024-05-25 01:30:03.039617+00:00, run_duration=0.36555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=666, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:30:01.290634+00:00, queued_by_job_id=1, pid=9822 2024-05-25T01:30:03.246799694Z [2024-05-25T01:30:03.246+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:28:00+00:00, map_index=-1, run_start_date=2024-05-25 01:30:02.268072+00:00, run_end_date=2024-05-25 01:30:02.682645+00:00, run_duration=0.414573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=665, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:30:01.290634+00:00, queued_by_job_id=1, pid=9809 2024-05-25T01:30:04.624884990Z [2024-05-25T01:30:04.624+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:30:04.625001713Z 2024-05-25T01:30:04.625558819Z [2024-05-25T01:30:04.625+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:30:04.628068547Z [2024-05-25T01:30:04.627+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:30:04.628087974Z 2024-05-25T01:30:04.633516049Z [2024-05-25T01:30:04.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:30:04.633990935Z [2024-05-25T01:30:04.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:30:04.716209282Z [2024-05-25T01:30:04.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status queued for try_number 1 2024-05-25T01:30:04.716636054Z [2024-05-25T01:30:04.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status success for try_number 1 2024-05-25T01:30:04.726892021Z [2024-05-25T01:30:04.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to f125a8df-21ca-4f78-8ec1-463a522b522a 2024-05-25T01:30:04.727412943Z [2024-05-25T01:30:04.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:25:00+00:00, map_index=-1, run_start_date=2024-05-25 01:30:03.460395+00:00, run_end_date=2024-05-25 01:30:03.840009+00:00, run_duration=0.379614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=668, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:30:01.290634+00:00, queued_by_job_id=1, pid=9840 2024-05-25T01:30:05.177156016Z [2024-05-25T01:30:05.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:29:00+00:00 exited with status success for try_number 1 2024-05-25T01:30:05.186343109Z [2024-05-25T01:30:05.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:29:00+00:00, map_index=-1, run_start_date=2024-05-25 01:30:03.681882+00:00, run_end_date=2024-05-25 01:30:04.986589+00:00, run_duration=1.304707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=669, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:30:01.290634+00:00, queued_by_job_id=1, pid=9846 2024-05-25T01:30:06.255299221Z [2024-05-25T01:30:06.254+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:30:06.255538464Z [2024-05-25T01:30:06.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:29:00+00:00, run_id=scheduled__2024-05-25T01:29:00+00:00, run_start_date=2024-05-25 01:30:01.187956+00:00, run_end_date=2024-05-25 01:30:06.255199+00:00, run_duration=5.067243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:29:00+00:00, data_interval_end=2024-05-25 01:30:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:30:06.264567542Z [2024-05-25T01:30:06.264+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:30:00+00:00, run_after=2024-05-25T01:31:00+00:00 2024-05-25T01:30:07.412905825Z [2024-05-25T01:30:07.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:30:07.414019083Z [2024-05-25T01:30:07.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:29:00+00:00, run_id=scheduled__2024-05-25T01:29:00+00:00, run_start_date=2024-05-25 01:30:01.190473+00:00, run_end_date=2024-05-25 01:30:07.412856+00:00, run_duration=6.222383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:29:00+00:00, data_interval_end=2024-05-25 01:30:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:30:07.439004856Z [2024-05-25T01:30:07.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:30:00+00:00, run_after=2024-05-25T01:31:00+00:00 2024-05-25T01:30:07.486137407Z [2024-05-25T01:30:07.485+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:30:07.486173739Z 2024-05-25T01:30:07.487779618Z [2024-05-25T01:30:07.487+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:30:07.488567082Z [2024-05-25T01:30:07.488+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:30:07.488601948Z 2024-05-25T01:30:07.491233879Z [2024-05-25T01:30:07.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:30:07.491671862Z [2024-05-25T01:30:07.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:30:07.551008359Z [2024-05-25T01:30:07.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status queued for try_number 1 2024-05-25T01:30:07.553547648Z [2024-05-25T01:30:07.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:29:00+00:00 exited with status success for try_number 1 2024-05-25T01:30:07.553647418Z [2024-05-25T01:30:07.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status success for try_number 1 2024-05-25T01:30:07.561545095Z [2024-05-25T01:30:07.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 355ddddc-db98-45ae-b668-0c32bb4b6e69 2024-05-25T01:30:07.561858184Z [2024-05-25T01:30:07.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:29:00+00:00, map_index=-1, run_start_date=2024-05-25 01:30:03.449115+00:00, run_end_date=2024-05-25 01:30:06.412246+00:00, run_duration=2.963131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=667, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:30:01.290634+00:00, queued_by_job_id=1, pid=9839 2024-05-25T01:30:07.562009718Z [2024-05-25T01:30:07.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T01:25:00+00:00, map_index=-1, run_start_date=2024-05-25 01:30:06.175837+00:00, run_end_date=2024-05-25 01:30:06.608217+00:00, run_duration=0.43238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=670, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:30:04.629199+00:00, queued_by_job_id=1, pid=9879 2024-05-25T01:30:09.844106386Z [2024-05-25T01:30:09.843+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:30:09.844177627Z 2024-05-25T01:30:09.844204174Z [2024-05-25T01:30:09.843+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:30:09.844966699Z [2024-05-25T01:30:09.844+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:30:09.844994031Z 2024-05-25T01:30:09.849738196Z [2024-05-25T01:30:09.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:30:09.849987522Z [2024-05-25T01:30:09.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:30:09.918968102Z [2024-05-25T01:30:09.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status queued for try_number 1 2024-05-25T01:30:09.919520374Z [2024-05-25T01:30:09.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status success for try_number 1 2024-05-25T01:30:09.927726934Z [2024-05-25T01:30:09.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c55ba35-7747-4baa-bc58-b56f5a1874b9 2024-05-25T01:30:09.928258551Z [2024-05-25T01:30:09.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:25:00+00:00, map_index=0, run_start_date=2024-05-25 01:30:09.037737+00:00, run_end_date=2024-05-25 01:30:09.360710+00:00, run_duration=0.322973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=671, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:30:07.488989+00:00, queued_by_job_id=1, pid=9890 2024-05-25T01:30:12.531112138Z [2024-05-25T01:30:12.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:30:12.531516443Z [2024-05-25T01:30:12.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:25:00+00:00, run_id=scheduled__2024-05-25T01:25:00+00:00, run_start_date=2024-05-25 01:30:01.182639+00:00, run_end_date=2024-05-25 01:30:12.531113+00:00, run_duration=11.348474, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:25:00+00:00, data_interval_end=2024-05-25 01:30:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T01:30:12.538921055Z [2024-05-25T01:30:12.538+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:30:00+00:00, run_after=2024-05-25T01:35:00+00:00 2024-05-25T01:30:12.596235542Z [2024-05-25T01:30:12.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:25:00+00:00 exited with status success for try_number 1 2024-05-25T01:30:12.603455547Z [2024-05-25T01:30:12.603+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:25:00+00:00, map_index=-1, run_start_date=2024-05-25 01:30:11.448517+00:00, run_end_date=2024-05-25 01:30:11.847687+00:00, run_duration=0.39917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=672, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:30:09.845749+00:00, queued_by_job_id=1, pid=9898 2024-05-25T01:30:29.263693161Z [2024-05-25T01:30:29.263+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T01:31:00.519692700Z [2024-05-25T01:31:00.519+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:31:00+00:00, run_after=2024-05-25T01:32:00+00:00 2024-05-25T01:31:00.532423917Z [2024-05-25T01:31:00.532+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:31:00+00:00, run_after=2024-05-25T01:32:00+00:00 2024-05-25T01:31:00.540714070Z [2024-05-25T01:31:00.540+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:31:00.599957392Z [2024-05-25T01:31:00.599+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:31:00.599982937Z 2024-05-25T01:31:00.600001157Z 2024-05-25T01:31:00.600004280Z 2024-05-25T01:31:00.601165985Z [2024-05-25T01:31:00.600+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:31:00.601856068Z [2024-05-25T01:31:00.601+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:31:00.602900235Z [2024-05-25T01:31:00.602+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:31:00.605478115Z [2024-05-25T01:31:00.605+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:31:00.605491556Z 2024-05-25T01:31:00.605495797Z 2024-05-25T01:31:00.605499873Z 2024-05-25T01:31:00.611342388Z [2024-05-25T01:31:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:31:00.611698546Z [2024-05-25T01:31:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:31:00.612116078Z [2024-05-25T01:31:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:31:00.612357309Z [2024-05-25T01:31:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:31:00.612711508Z [2024-05-25T01:31:00.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:31:00.612872350Z [2024-05-25T01:31:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:31:00.941001008Z [2024-05-25T01:31:00.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status queued for try_number 1 2024-05-25T01:31:00.941579371Z [2024-05-25T01:31:00.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status queued for try_number 1 2024-05-25T01:31:00.941722709Z [2024-05-25T01:31:00.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status queued for try_number 1 2024-05-25T01:31:00.949870639Z [2024-05-25T01:31:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bef0f22-bef4-4aa0-a9e9-32acaf1e446b 2024-05-25T01:31:00.950088715Z [2024-05-25T01:31:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b91c07c-547f-4f1a-92d3-8ad08855dd43 2024-05-25T01:31:00.950292863Z [2024-05-25T01:31:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccfba3d8-6418-4ae0-97a9-bda048166955 2024-05-25T01:31:02.160394479Z [2024-05-25T01:31:02.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:31:02.160422990Z [2024-05-25T01:31:02.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:30:00+00:00, run_id=scheduled__2024-05-25T01:30:00+00:00, run_start_date=2024-05-25 01:31:00.549323+00:00, run_end_date=2024-05-25 01:31:02.159934+00:00, run_duration=1.610611, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:30:00+00:00, data_interval_end=2024-05-25 01:31:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:31:02.181752151Z [2024-05-25T01:31:02.180+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:31:00+00:00, run_after=2024-05-25T01:32:00+00:00 2024-05-25T01:31:02.277590427Z [2024-05-25T01:31:02.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status success for try_number 1 2024-05-25T01:31:02.286435256Z [2024-05-25T01:31:02.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:30:00+00:00, map_index=-1, run_start_date=2024-05-25 01:31:01.363973+00:00, run_end_date=2024-05-25 01:31:01.764615+00:00, run_duration=0.400642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=673, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:31:00.607104+00:00, queued_by_job_id=1, pid=9907 2024-05-25T01:31:05.040441457Z [2024-05-25T01:31:05.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:31:05.040990363Z [2024-05-25T01:31:05.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:30:00+00:00, run_id=scheduled__2024-05-25T01:30:00+00:00, run_start_date=2024-05-25 01:31:00.550389+00:00, run_end_date=2024-05-25 01:31:05.040257+00:00, run_duration=4.489868, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:30:00+00:00, data_interval_end=2024-05-25 01:31:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:31:05.056061767Z [2024-05-25T01:31:05.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:31:00+00:00, run_after=2024-05-25T01:32:00+00:00 2024-05-25T01:31:05.064787319Z [2024-05-25T01:31:05.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:31:05.065132181Z [2024-05-25T01:31:05.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:30:00+00:00, run_id=scheduled__2024-05-25T01:30:00+00:00, run_start_date=2024-05-25 01:31:00.551261+00:00, run_end_date=2024-05-25 01:31:05.064671+00:00, run_duration=4.51341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:30:00+00:00, data_interval_end=2024-05-25 01:31:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:31:05.075195426Z [2024-05-25T01:31:05.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:31:00+00:00, run_after=2024-05-25T01:32:00+00:00 2024-05-25T01:31:05.130715969Z [2024-05-25T01:31:05.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status success for try_number 1 2024-05-25T01:31:05.130858672Z [2024-05-25T01:31:05.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status success for try_number 1 2024-05-25T01:31:05.142204439Z [2024-05-25T01:31:05.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:30:00+00:00, map_index=-1, run_start_date=2024-05-25 01:31:02.515777+00:00, run_end_date=2024-05-25 01:31:03.792664+00:00, run_duration=1.276887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=674, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:31:00.607104+00:00, queued_by_job_id=1, pid=9925 2024-05-25T01:31:05.142474002Z [2024-05-25T01:31:05.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:30:00+00:00, map_index=-1, run_start_date=2024-05-25 01:31:02.535036+00:00, run_end_date=2024-05-25 01:31:04.161901+00:00, run_duration=1.626865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=675, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:31:00.607104+00:00, queued_by_job_id=1, pid=9926 2024-05-25T01:32:00.871260085Z [2024-05-25T01:32:00.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:32:00+00:00, run_after=2024-05-25T01:33:00+00:00 2024-05-25T01:32:00.881368667Z [2024-05-25T01:32:00.880+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:32:00.895386386Z [2024-05-25T01:32:00.894+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:32:00+00:00, run_after=2024-05-25T01:33:00+00:00 2024-05-25T01:32:00.905071173Z [2024-05-25T01:32:00.904+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:32:01.005846775Z [2024-05-25T01:32:01.005+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:32:01.005874893Z 2024-05-25T01:32:01.005895312Z 2024-05-25T01:32:01.005900493Z 2024-05-25T01:32:01.005905036Z 2024-05-25T01:32:01.006125399Z [2024-05-25T01:32:01.005+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:32:01.006461542Z [2024-05-25T01:32:01.006+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:32:01.006697702Z [2024-05-25T01:32:01.006+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:32:01.006944236Z [2024-05-25T01:32:01.006+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:32:01.008320699Z [2024-05-25T01:32:01.008+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:32:01.008330977Z 2024-05-25T01:32:01.008335213Z 2024-05-25T01:32:01.008339019Z 2024-05-25T01:32:01.008342925Z 2024-05-25T01:32:01.013248642Z [2024-05-25T01:32:01.012+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:32:01.013504820Z [2024-05-25T01:32:01.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:32:01.014118598Z [2024-05-25T01:32:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:32:01.014292299Z [2024-05-25T01:32:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:32:01.014721335Z [2024-05-25T01:32:01.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:32:01.014990136Z [2024-05-25T01:32:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:32:01.015384595Z [2024-05-25T01:32:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:32:01.015704476Z [2024-05-25T01:32:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:32:01.523915120Z [2024-05-25T01:32:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status queued for try_number 1 2024-05-25T01:32:01.523944650Z [2024-05-25T01:32:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:31:00+00:00 exited with status queued for try_number 1 2024-05-25T01:32:01.523973529Z [2024-05-25T01:32:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:31:00+00:00 exited with status queued for try_number 1 2024-05-25T01:32:01.524076921Z [2024-05-25T01:32:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:31:00+00:00 exited with status queued for try_number 1 2024-05-25T01:32:01.544873631Z [2024-05-25T01:32:01.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bdee540-e82f-4ee1-a900-f37e5d9a21ca 2024-05-25T01:32:01.545024038Z [2024-05-25T01:32:01.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12dda14c-922f-4836-9f71-c518dbd19597 2024-05-25T01:32:01.545286342Z [2024-05-25T01:32:01.545+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d41cad2-1bcc-4990-ad89-de4eb8e16389 2024-05-25T01:32:01.545542210Z [2024-05-25T01:32:01.545+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c1ce282-6167-4a68-b0d9-6235b5fa1c3e 2024-05-25T01:32:03.310725193Z [2024-05-25T01:32:03.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:32:03.311244316Z [2024-05-25T01:32:03.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:30:00+00:00, run_id=scheduled__2024-05-25T01:30:00+00:00, run_start_date=2024-05-25 01:32:00.917182+00:00, run_end_date=2024-05-25 01:32:03.310678+00:00, run_duration=2.393496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:30:00+00:00, data_interval_end=2024-05-25 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:32:03.323402827Z [2024-05-25T01:32:03.323+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:32:00+00:00, run_after=2024-05-25T01:34:00+00:00 2024-05-25T01:32:03.335132833Z [2024-05-25T01:32:03.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:32:03.342175904Z [2024-05-25T01:32:03.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:31:00+00:00, run_id=scheduled__2024-05-25T01:31:00+00:00, run_start_date=2024-05-25 01:32:00.918852+00:00, run_end_date=2024-05-25 01:32:03.335064+00:00, run_duration=2.416212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:31:00+00:00, data_interval_end=2024-05-25 01:32:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:32:03.354323573Z [2024-05-25T01:32:03.354+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:32:00+00:00, run_after=2024-05-25T01:33:00+00:00 2024-05-25T01:32:03.417622410Z [2024-05-25T01:32:03.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status success for try_number 1 2024-05-25T01:32:03.418149639Z [2024-05-25T01:32:03.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:31:00+00:00 exited with status success for try_number 1 2024-05-25T01:32:03.429927738Z [2024-05-25T01:32:03.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:30:00+00:00, map_index=-1, run_start_date=2024-05-25 01:32:01.885319+00:00, run_end_date=2024-05-25 01:32:02.376484+00:00, run_duration=0.491165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=676, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:32:01.009651+00:00, queued_by_job_id=1, pid=9959 2024-05-25T01:32:03.430534797Z [2024-05-25T01:32:03.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:31:00+00:00, map_index=-1, run_start_date=2024-05-25 01:32:01.923245+00:00, run_end_date=2024-05-25 01:32:02.349510+00:00, run_duration=0.426265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=677, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:32:01.009651+00:00, queued_by_job_id=1, pid=9960 2024-05-25T01:32:05.542687605Z [2024-05-25T01:32:05.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:32:05.543394505Z [2024-05-25T01:32:05.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:31:00+00:00, run_id=scheduled__2024-05-25T01:31:00+00:00, run_start_date=2024-05-25 01:32:00.920240+00:00, run_end_date=2024-05-25 01:32:05.542534+00:00, run_duration=4.622294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:31:00+00:00, data_interval_end=2024-05-25 01:32:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:32:05.557615724Z [2024-05-25T01:32:05.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:32:00+00:00, run_after=2024-05-25T01:33:00+00:00 2024-05-25T01:32:05.564985389Z [2024-05-25T01:32:05.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:32:05.565384163Z [2024-05-25T01:32:05.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:31:00+00:00, run_id=scheduled__2024-05-25T01:31:00+00:00, run_start_date=2024-05-25 01:32:00.921566+00:00, run_end_date=2024-05-25 01:32:05.564861+00:00, run_duration=4.643295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:31:00+00:00, data_interval_end=2024-05-25 01:32:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:32:05.574465364Z [2024-05-25T01:32:05.574+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:32:00+00:00, run_after=2024-05-25T01:33:00+00:00 2024-05-25T01:32:05.634520794Z [2024-05-25T01:32:05.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:31:00+00:00 exited with status success for try_number 1 2024-05-25T01:32:05.634909901Z [2024-05-25T01:32:05.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:31:00+00:00 exited with status success for try_number 1 2024-05-25T01:32:05.645922702Z [2024-05-25T01:32:05.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:31:00+00:00, map_index=-1, run_start_date=2024-05-25 01:32:02.975573+00:00, run_end_date=2024-05-25 01:32:04.492756+00:00, run_duration=1.517183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=679, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:32:01.009651+00:00, queued_by_job_id=1, pid=9984 2024-05-25T01:32:05.646459553Z [2024-05-25T01:32:05.646+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:31:00+00:00, map_index=-1, run_start_date=2024-05-25 01:32:02.913593+00:00, run_end_date=2024-05-25 01:32:05.128996+00:00, run_duration=2.215403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=678, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:32:01.009651+00:00, queued_by_job_id=1, pid=9983 2024-05-25T01:33:00.078961825Z [2024-05-25T01:33:00.078+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:33:00.109022579Z [2024-05-25T01:33:00.108+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:33:00+00:00, run_after=2024-05-25T01:34:00+00:00 2024-05-25T01:33:00.127822311Z [2024-05-25T01:33:00.127+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:33:00+00:00, run_after=2024-05-25T01:34:00+00:00 2024-05-25T01:33:00.211648224Z [2024-05-25T01:33:00.211+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:33:00.211685876Z 2024-05-25T01:33:00.211692729Z 2024-05-25T01:33:00.211698326Z 2024-05-25T01:33:00.211954017Z [2024-05-25T01:33:00.211+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:33:00.212772659Z [2024-05-25T01:33:00.212+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:33:00.213027720Z [2024-05-25T01:33:00.212+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:33:00.214537268Z [2024-05-25T01:33:00.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:33:00.214560106Z 2024-05-25T01:33:00.214567376Z 2024-05-25T01:33:00.214574027Z 2024-05-25T01:33:00.220036388Z [2024-05-25T01:33:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:33:00.220452193Z [2024-05-25T01:33:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:33:00.221007158Z [2024-05-25T01:33:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:33:00.221436085Z [2024-05-25T01:33:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:33:00.222043881Z [2024-05-25T01:33:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:33:00.222518251Z [2024-05-25T01:33:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:33:00.508469569Z [2024-05-25T01:33:00.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:32:00+00:00 exited with status queued for try_number 1 2024-05-25T01:33:00.508602014Z [2024-05-25T01:33:00.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:32:00+00:00 exited with status queued for try_number 1 2024-05-25T01:33:00.508757951Z [2024-05-25T01:33:00.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:32:00+00:00 exited with status queued for try_number 1 2024-05-25T01:33:00.526365585Z [2024-05-25T01:33:00.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 839da832-85e5-472e-acd4-fef52543f631 2024-05-25T01:33:00.526594195Z [2024-05-25T01:33:00.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fc6de7f-16b2-44b8-a079-0bec14e84659 2024-05-25T01:33:00.526851778Z [2024-05-25T01:33:00.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17213b18-c275-4bed-b292-702a0a74d3d9 2024-05-25T01:33:01.645905689Z [2024-05-25T01:33:01.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:33:01.646443674Z [2024-05-25T01:33:01.646+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:32:00+00:00, run_id=scheduled__2024-05-25T01:32:00+00:00, run_start_date=2024-05-25 01:33:00.142092+00:00, run_end_date=2024-05-25 01:33:01.645812+00:00, run_duration=1.50372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:32:00+00:00, data_interval_end=2024-05-25 01:33:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:33:01.655363032Z [2024-05-25T01:33:01.655+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:33:00+00:00, run_after=2024-05-25T01:34:00+00:00 2024-05-25T01:33:01.698891711Z [2024-05-25T01:33:01.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:32:00+00:00 exited with status success for try_number 1 2024-05-25T01:33:01.703519519Z [2024-05-25T01:33:01.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:32:00+00:00, map_index=-1, run_start_date=2024-05-25 01:33:00.951505+00:00, run_end_date=2024-05-25 01:33:01.414931+00:00, run_duration=0.463426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=680, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:33:00.215909+00:00, queued_by_job_id=1, pid=10016 2024-05-25T01:33:04.324128166Z [2024-05-25T01:33:04.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:33:04.324168466Z [2024-05-25T01:33:04.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:32:00+00:00, run_id=scheduled__2024-05-25T01:32:00+00:00, run_start_date=2024-05-25 01:33:00.144607+00:00, run_end_date=2024-05-25 01:33:04.323157+00:00, run_duration=4.17855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:32:00+00:00, data_interval_end=2024-05-25 01:33:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:33:04.333362384Z [2024-05-25T01:33:04.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:33:00+00:00, run_after=2024-05-25T01:34:00+00:00 2024-05-25T01:33:04.385911899Z [2024-05-25T01:33:04.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:32:00+00:00 exited with status success for try_number 1 2024-05-25T01:33:04.396890113Z [2024-05-25T01:33:04.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:32:00+00:00, map_index=-1, run_start_date=2024-05-25 01:33:01.945458+00:00, run_end_date=2024-05-25 01:33:03.734316+00:00, run_duration=1.788858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=682, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:33:00.215909+00:00, queued_by_job_id=1, pid=10035 2024-05-25T01:33:04.875702253Z [2024-05-25T01:33:04.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:33:04.876300461Z [2024-05-25T01:33:04.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:32:00+00:00, run_id=scheduled__2024-05-25T01:32:00+00:00, run_start_date=2024-05-25 01:33:00.143472+00:00, run_end_date=2024-05-25 01:33:04.875515+00:00, run_duration=4.732043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:32:00+00:00, data_interval_end=2024-05-25 01:33:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:33:04.885658536Z [2024-05-25T01:33:04.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:33:00+00:00, run_after=2024-05-25T01:34:00+00:00 2024-05-25T01:33:04.928755186Z [2024-05-25T01:33:04.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:32:00+00:00 exited with status success for try_number 1 2024-05-25T01:33:04.937300359Z [2024-05-25T01:33:04.936+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:32:00+00:00, map_index=-1, run_start_date=2024-05-25 01:33:01.909628+00:00, run_end_date=2024-05-25 01:33:04.722727+00:00, run_duration=2.813099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=681, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:33:00.215909+00:00, queued_by_job_id=1, pid=10034 2024-05-25T01:34:00.300161466Z [2024-05-25T01:34:00.299+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:34:00.313182873Z [2024-05-25T01:34:00.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:34:00+00:00, run_after=2024-05-25T01:35:00+00:00 2024-05-25T01:34:00.333279371Z [2024-05-25T01:34:00.332+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:34:00+00:00, run_after=2024-05-25T01:35:00+00:00 2024-05-25T01:34:00.341562052Z [2024-05-25T01:34:00.341+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:34:00.452432445Z [2024-05-25T01:34:00.451+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:34:00.452458675Z 2024-05-25T01:34:00.452463516Z 2024-05-25T01:34:00.452467077Z 2024-05-25T01:34:00.452470621Z 2024-05-25T01:34:00.452733560Z [2024-05-25T01:34:00.452+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:34:00.453048407Z [2024-05-25T01:34:00.452+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:34:00.453413182Z [2024-05-25T01:34:00.453+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:34:00.453739420Z [2024-05-25T01:34:00.453+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:34:00.454912799Z [2024-05-25T01:34:00.454+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:34:00.454938532Z 2024-05-25T01:34:00.454946111Z 2024-05-25T01:34:00.454952471Z 2024-05-25T01:34:00.454958674Z 2024-05-25T01:34:00.461748609Z [2024-05-25T01:34:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:34:00.461804997Z [2024-05-25T01:34:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:34:00.462128841Z [2024-05-25T01:34:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:34:00.462292487Z [2024-05-25T01:34:00.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:34:00.462593087Z [2024-05-25T01:34:00.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:34:00.462742046Z [2024-05-25T01:34:00.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:34:00.463039877Z [2024-05-25T01:34:00.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:34:00.463190055Z [2024-05-25T01:34:00.463+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:34:00.930432204Z [2024-05-25T01:34:00.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:32:00+00:00 exited with status queued for try_number 1 2024-05-25T01:34:00.930528223Z [2024-05-25T01:34:00.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:33:00+00:00 exited with status queued for try_number 1 2024-05-25T01:34:00.930647475Z [2024-05-25T01:34:00.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:33:00+00:00 exited with status queued for try_number 1 2024-05-25T01:34:00.930747805Z [2024-05-25T01:34:00.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:33:00+00:00 exited with status queued for try_number 1 2024-05-25T01:34:00.953756670Z [2024-05-25T01:34:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2980198d-03b2-4ce8-8f27-3c53c3b00655 2024-05-25T01:34:00.953976244Z [2024-05-25T01:34:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to e11c4b1c-3865-4351-82e8-716045770d37 2024-05-25T01:34:00.954128529Z [2024-05-25T01:34:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 318697f6-3c69-4047-b38b-247c15e21172 2024-05-25T01:34:00.954273284Z [2024-05-25T01:34:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8e8a4e2-105b-40ff-9b74-2c322d86a0d1 2024-05-25T01:34:02.338000407Z [2024-05-25T01:34:02.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:34:02.338569073Z [2024-05-25T01:34:02.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:32:00+00:00, run_id=scheduled__2024-05-25T01:32:00+00:00, run_start_date=2024-05-25 01:34:00.353744+00:00, run_end_date=2024-05-25 01:34:02.337943+00:00, run_duration=1.984199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:32:00+00:00, data_interval_end=2024-05-25 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:34:02.346472427Z [2024-05-25T01:34:02.346+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:34:00+00:00, run_after=2024-05-25T01:36:00+00:00 2024-05-25T01:34:02.352289872Z [2024-05-25T01:34:02.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:34:02.352594877Z [2024-05-25T01:34:02.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:33:00+00:00, run_id=scheduled__2024-05-25T01:33:00+00:00, run_start_date=2024-05-25 01:34:00.355128+00:00, run_end_date=2024-05-25 01:34:02.352230+00:00, run_duration=1.997102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:33:00+00:00, data_interval_end=2024-05-25 01:34:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:34:02.361796181Z [2024-05-25T01:34:02.361+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:34:00+00:00, run_after=2024-05-25T01:35:00+00:00 2024-05-25T01:34:02.446586174Z [2024-05-25T01:34:02.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:32:00+00:00 exited with status success for try_number 1 2024-05-25T01:34:02.446769681Z [2024-05-25T01:34:02.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:33:00+00:00 exited with status success for try_number 1 2024-05-25T01:34:02.453644963Z [2024-05-25T01:34:02.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:32:00+00:00, map_index=-1, run_start_date=2024-05-25 01:34:01.297205+00:00, run_end_date=2024-05-25 01:34:01.688228+00:00, run_duration=0.391023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=683, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:34:00.457838+00:00, queued_by_job_id=1, pid=10068 2024-05-25T01:34:02.453975436Z [2024-05-25T01:34:02.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:33:00+00:00, map_index=-1, run_start_date=2024-05-25 01:34:01.318190+00:00, run_end_date=2024-05-25 01:34:01.723562+00:00, run_duration=0.405372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=684, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:34:00.457838+00:00, queued_by_job_id=1, pid=10069 2024-05-25T01:34:04.327332302Z [2024-05-25T01:34:04.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:34:04.328024917Z [2024-05-25T01:34:04.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:33:00+00:00, run_id=scheduled__2024-05-25T01:33:00+00:00, run_start_date=2024-05-25 01:34:00.356247+00:00, run_end_date=2024-05-25 01:34:04.327471+00:00, run_duration=3.971224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:33:00+00:00, data_interval_end=2024-05-25 01:34:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:34:04.343630901Z [2024-05-25T01:34:04.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:34:00+00:00, run_after=2024-05-25T01:35:00+00:00 2024-05-25T01:34:04.352841380Z [2024-05-25T01:34:04.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:34:04.353903651Z [2024-05-25T01:34:04.353+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:33:00+00:00, run_id=scheduled__2024-05-25T01:33:00+00:00, run_start_date=2024-05-25 01:34:00.357351+00:00, run_end_date=2024-05-25 01:34:04.353438+00:00, run_duration=3.996087, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:33:00+00:00, data_interval_end=2024-05-25 01:34:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:34:04.367138796Z [2024-05-25T01:34:04.366+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:34:00+00:00, run_after=2024-05-25T01:35:00+00:00 2024-05-25T01:34:04.416161461Z [2024-05-25T01:34:04.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:33:00+00:00 exited with status success for try_number 1 2024-05-25T01:34:04.416436097Z [2024-05-25T01:34:04.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:33:00+00:00 exited with status success for try_number 1 2024-05-25T01:34:04.424405778Z [2024-05-25T01:34:04.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:33:00+00:00, map_index=-1, run_start_date=2024-05-25 01:34:02.303497+00:00, run_end_date=2024-05-25 01:34:03.685402+00:00, run_duration=1.381905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=685, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:34:00.457838+00:00, queued_by_job_id=1, pid=10092 2024-05-25T01:34:04.424669495Z [2024-05-25T01:34:04.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:33:00+00:00, map_index=-1, run_start_date=2024-05-25 01:34:02.365635+00:00, run_end_date=2024-05-25 01:34:03.963834+00:00, run_duration=1.598199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=686, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:34:00.457838+00:00, queued_by_job_id=1, pid=10093 2024-05-25T01:35:00.376391456Z [2024-05-25T01:35:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:35:00+00:00, run_after=2024-05-25T01:36:00+00:00 2024-05-25T01:35:00.396980398Z [2024-05-25T01:35:00.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:35:00+00:00, run_after=2024-05-25T01:40:00+00:00 2024-05-25T01:35:00.409361411Z [2024-05-25T01:35:00.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:35:00+00:00, run_after=2024-05-25T01:36:00+00:00 2024-05-25T01:35:00.414870141Z [2024-05-25T01:35:00.414+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:35:00.519849516Z [2024-05-25T01:35:00.519+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:35:00.519885508Z 2024-05-25T01:35:00.519927690Z 2024-05-25T01:35:00.519936187Z 2024-05-25T01:35:00.519942131Z 2024-05-25T01:35:00.519973809Z [2024-05-25T01:35:00.519+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:35:00.520401019Z [2024-05-25T01:35:00.520+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:35:00.520674632Z [2024-05-25T01:35:00.520+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:35:00.521037165Z [2024-05-25T01:35:00.520+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:35:00.522294763Z [2024-05-25T01:35:00.521+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:35:00.522315424Z 2024-05-25T01:35:00.522360064Z 2024-05-25T01:35:00.522367326Z 2024-05-25T01:35:00.522373262Z 2024-05-25T01:35:00.527826668Z [2024-05-25T01:35:00.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:35:00.527900199Z [2024-05-25T01:35:00.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:35:00.528339501Z [2024-05-25T01:35:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:35:00.528634711Z [2024-05-25T01:35:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:35:00.529068422Z [2024-05-25T01:35:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:35:00.529602502Z [2024-05-25T01:35:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:35:00.530019098Z [2024-05-25T01:35:00.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:35:00.530285038Z [2024-05-25T01:35:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:35:00.799884042Z [2024-05-25T01:35:00.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status queued for try_number 1 2024-05-25T01:35:00.799909317Z [2024-05-25T01:35:00.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:34:00+00:00 exited with status queued for try_number 1 2024-05-25T01:35:00.799932781Z [2024-05-25T01:35:00.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:34:00+00:00 exited with status queued for try_number 1 2024-05-25T01:35:00.800004241Z [2024-05-25T01:35:00.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:34:00+00:00 exited with status queued for try_number 1 2024-05-25T01:35:00.812324659Z [2024-05-25T01:35:00.811+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09ee2057-27a7-4660-b755-c3ac8a7937ae 2024-05-25T01:35:00.812376400Z [2024-05-25T01:35:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31bf35b1-96dc-4b55-bbc1-136ca160daec 2024-05-25T01:35:00.812507181Z [2024-05-25T01:35:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed9f6b0f-123f-4008-98df-7670cb435ffe 2024-05-25T01:35:00.812594312Z [2024-05-25T01:35:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to 095304a3-f8b1-4e11-a4ca-d7fcad067e14 2024-05-25T01:35:02.416526263Z [2024-05-25T01:35:02.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:35:02.416991159Z [2024-05-25T01:35:02.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:34:00+00:00, run_id=scheduled__2024-05-25T01:34:00+00:00, run_start_date=2024-05-25 01:35:00.427348+00:00, run_end_date=2024-05-25 01:35:02.416450+00:00, run_duration=1.989102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:34:00+00:00, data_interval_end=2024-05-25 01:35:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:35:02.427603197Z [2024-05-25T01:35:02.427+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:35:00+00:00, run_after=2024-05-25T01:36:00+00:00 2024-05-25T01:35:02.506123506Z [2024-05-25T01:35:02.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:34:00+00:00 exited with status success for try_number 1 2024-05-25T01:35:02.517657219Z [2024-05-25T01:35:02.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:34:00+00:00, map_index=-1, run_start_date=2024-05-25 01:35:01.498260+00:00, run_end_date=2024-05-25 01:35:01.906612+00:00, run_duration=0.408352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=687, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:35:00.523775+00:00, queued_by_job_id=1, pid=10125 2024-05-25T01:35:03.625261919Z [2024-05-25T01:35:03.624+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:35:03.625307844Z 2024-05-25T01:35:03.625318329Z [2024-05-25T01:35:03.624+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:35:03.625982250Z [2024-05-25T01:35:03.625+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:35:03.626007878Z 2024-05-25T01:35:03.632795003Z [2024-05-25T01:35:03.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:35:03.633364047Z [2024-05-25T01:35:03.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:35:03.712197342Z [2024-05-25T01:35:03.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status queued for try_number 1 2024-05-25T01:35:03.712375135Z [2024-05-25T01:35:03.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status success for try_number 1 2024-05-25T01:35:03.720999528Z [2024-05-25T01:35:03.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c4f245f-c344-4106-8c34-c70fd7e97de0 2024-05-25T01:35:03.721545005Z [2024-05-25T01:35:03.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:30:00+00:00, map_index=-1, run_start_date=2024-05-25 01:35:02.921366+00:00, run_end_date=2024-05-25 01:35:03.299286+00:00, run_duration=0.37792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=690, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:35:00.523775+00:00, queued_by_job_id=1, pid=10156 2024-05-25T01:35:04.908138047Z [2024-05-25T01:35:04.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:35:04.908343745Z [2024-05-25T01:35:04.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:34:00+00:00, run_id=scheduled__2024-05-25T01:34:00+00:00, run_start_date=2024-05-25 01:35:00.428458+00:00, run_end_date=2024-05-25 01:35:04.907909+00:00, run_duration=4.479451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:34:00+00:00, data_interval_end=2024-05-25 01:35:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:35:04.922377718Z [2024-05-25T01:35:04.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:35:00+00:00, run_after=2024-05-25T01:36:00+00:00 2024-05-25T01:35:04.931008687Z [2024-05-25T01:35:04.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:35:04.931521449Z [2024-05-25T01:35:04.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:34:00+00:00, run_id=scheduled__2024-05-25T01:34:00+00:00, run_start_date=2024-05-25 01:35:00.429530+00:00, run_end_date=2024-05-25 01:35:04.930919+00:00, run_duration=4.501389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:34:00+00:00, data_interval_end=2024-05-25 01:35:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:35:04.942285144Z [2024-05-25T01:35:04.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:35:00+00:00, run_after=2024-05-25T01:36:00+00:00 2024-05-25T01:35:05.021873982Z [2024-05-25T01:35:05.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:34:00+00:00 exited with status success for try_number 1 2024-05-25T01:35:05.022301572Z [2024-05-25T01:35:05.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:34:00+00:00 exited with status success for try_number 1 2024-05-25T01:35:05.032030911Z [2024-05-25T01:35:05.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:34:00+00:00, map_index=-1, run_start_date=2024-05-25 01:35:02.732335+00:00, run_end_date=2024-05-25 01:35:03.939279+00:00, run_duration=1.206944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=689, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:35:00.523775+00:00, queued_by_job_id=1, pid=10150 2024-05-25T01:35:05.032423046Z [2024-05-25T01:35:05.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:34:00+00:00, map_index=-1, run_start_date=2024-05-25 01:35:02.656020+00:00, run_end_date=2024-05-25 01:35:04.118202+00:00, run_duration=1.462182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=688, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:35:00.523775+00:00, queued_by_job_id=1, pid=10144 2024-05-25T01:35:06.954174828Z [2024-05-25T01:35:06.953+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:35:06.954202503Z 2024-05-25T01:35:06.954445954Z [2024-05-25T01:35:06.954+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:35:06.955160180Z [2024-05-25T01:35:06.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:35:06.955176393Z 2024-05-25T01:35:06.958140297Z [2024-05-25T01:35:06.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:35:06.958454436Z [2024-05-25T01:35:06.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:35:07.014892038Z [2024-05-25T01:35:07.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status queued for try_number 1 2024-05-25T01:35:07.015078600Z [2024-05-25T01:35:07.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status success for try_number 1 2024-05-25T01:35:07.021626489Z [2024-05-25T01:35:07.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f535713-30cb-4e84-9e0d-3e9a5cac0b85 2024-05-25T01:35:07.021949630Z [2024-05-25T01:35:07.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T01:30:00+00:00, map_index=-1, run_start_date=2024-05-25 01:35:05.294261+00:00, run_end_date=2024-05-25 01:35:05.701994+00:00, run_duration=0.407733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=691, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:35:03.626439+00:00, queued_by_job_id=1, pid=10174 2024-05-25T01:35:09.241138107Z [2024-05-25T01:35:09.240+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:35:09.241189214Z 2024-05-25T01:35:09.241603942Z [2024-05-25T01:35:09.241+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:35:09.242254283Z [2024-05-25T01:35:09.242+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:35:09.242270702Z 2024-05-25T01:35:09.244399993Z [2024-05-25T01:35:09.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:35:09.244714303Z [2024-05-25T01:35:09.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:35:09.292674551Z [2024-05-25T01:35:09.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status queued for try_number 1 2024-05-25T01:35:09.292701825Z [2024-05-25T01:35:09.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status success for try_number 1 2024-05-25T01:35:09.301907221Z [2024-05-25T01:35:09.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54eb7901-a494-4852-82b4-23ef4be6a6e1 2024-05-25T01:35:09.302169074Z [2024-05-25T01:35:09.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:30:00+00:00, map_index=0, run_start_date=2024-05-25 01:35:08.609936+00:00, run_end_date=2024-05-25 01:35:08.960527+00:00, run_duration=0.350591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=692, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:35:06.955742+00:00, queued_by_job_id=1, pid=10195 2024-05-25T01:35:12.009870486Z [2024-05-25T01:35:12.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:35:12.010649835Z [2024-05-25T01:35:12.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:30:00+00:00, run_id=scheduled__2024-05-25T01:30:00+00:00, run_start_date=2024-05-25 01:35:00.426113+00:00, run_end_date=2024-05-25 01:35:12.009875+00:00, run_duration=11.583762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:30:00+00:00, data_interval_end=2024-05-25 01:35:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T01:35:12.027696256Z [2024-05-25T01:35:12.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:35:00+00:00, run_after=2024-05-25T01:40:00+00:00 2024-05-25T01:35:12.087141126Z [2024-05-25T01:35:12.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:30:00+00:00 exited with status success for try_number 1 2024-05-25T01:35:12.099296607Z [2024-05-25T01:35:12.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:30:00+00:00, map_index=-1, run_start_date=2024-05-25 01:35:10.825701+00:00, run_end_date=2024-05-25 01:35:11.231120+00:00, run_duration=0.405419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=693, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:35:09.242709+00:00, queued_by_job_id=1, pid=10203 2024-05-25T01:35:29.352244544Z [2024-05-25T01:35:29.350+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T01:36:00.971976373Z [2024-05-25T01:36:00.971+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:36:00.996183523Z [2024-05-25T01:36:00.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:36:00+00:00, run_after=2024-05-25T01:37:00+00:00 2024-05-25T01:36:01.016615989Z [2024-05-25T01:36:01.016+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:36:00+00:00, run_after=2024-05-25T01:37:00+00:00 2024-05-25T01:36:01.025345509Z [2024-05-25T01:36:01.024+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:36:01.137055934Z [2024-05-25T01:36:01.136+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:36:01.137100259Z 2024-05-25T01:36:01.137144251Z 2024-05-25T01:36:01.137154743Z 2024-05-25T01:36:01.137164668Z 2024-05-25T01:36:01.137280517Z [2024-05-25T01:36:01.136+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:36:01.137510946Z [2024-05-25T01:36:01.137+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:36:01.137665229Z [2024-05-25T01:36:01.137+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:36:01.137854992Z [2024-05-25T01:36:01.137+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:36:01.139665958Z [2024-05-25T01:36:01.139+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:36:01.139693860Z 2024-05-25T01:36:01.139704526Z 2024-05-25T01:36:01.139721735Z 2024-05-25T01:36:01.139731428Z 2024-05-25T01:36:01.145719878Z [2024-05-25T01:36:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:36:01.145905047Z [2024-05-25T01:36:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:36:01.146303009Z [2024-05-25T01:36:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:36:01.146456069Z [2024-05-25T01:36:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:36:01.146714844Z [2024-05-25T01:36:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:36:01.146835836Z [2024-05-25T01:36:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:36:01.147107421Z [2024-05-25T01:36:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:36:01.147271431Z [2024-05-25T01:36:01.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:36:01.473780676Z [2024-05-25T01:36:01.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:34:00+00:00 exited with status queued for try_number 1 2024-05-25T01:36:01.473831076Z [2024-05-25T01:36:01.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status queued for try_number 1 2024-05-25T01:36:01.473842143Z [2024-05-25T01:36:01.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status queued for try_number 1 2024-05-25T01:36:01.473854607Z [2024-05-25T01:36:01.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status queued for try_number 1 2024-05-25T01:36:01.490529748Z [2024-05-25T01:36:01.490+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee2b9ef9-44ab-4828-b3fa-6503f1af2db0 2024-05-25T01:36:01.490561903Z [2024-05-25T01:36:01.490+0000] {scheduler_job.py:635} INFO - Setting external_id for to ace68a3e-8bc6-42a1-a31d-c8793cc93c32 2024-05-25T01:36:01.490666672Z [2024-05-25T01:36:01.490+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f99b43e-79aa-47a8-a30d-82a6145153ab 2024-05-25T01:36:01.490755423Z [2024-05-25T01:36:01.490+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93ac9701-5aee-467f-83bf-ca83abfdc736 2024-05-25T01:36:02.931954689Z [2024-05-25T01:36:02.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:36:02.932001233Z [2024-05-25T01:36:02.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:34:00+00:00, run_id=scheduled__2024-05-25T01:34:00+00:00, run_start_date=2024-05-25 01:36:01.037135+00:00, run_end_date=2024-05-25 01:36:02.931627+00:00, run_duration=1.894492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:34:00+00:00, data_interval_end=2024-05-25 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:36:02.939895568Z [2024-05-25T01:36:02.939+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:36:00+00:00, run_after=2024-05-25T01:38:00+00:00 2024-05-25T01:36:02.947298779Z [2024-05-25T01:36:02.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:36:02.947499014Z [2024-05-25T01:36:02.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:35:00+00:00, run_id=scheduled__2024-05-25T01:35:00+00:00, run_start_date=2024-05-25 01:36:01.038556+00:00, run_end_date=2024-05-25 01:36:02.947185+00:00, run_duration=1.908629, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:35:00+00:00, data_interval_end=2024-05-25 01:36:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:36:02.957198372Z [2024-05-25T01:36:02.956+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:36:00+00:00, run_after=2024-05-25T01:37:00+00:00 2024-05-25T01:36:03.014808323Z [2024-05-25T01:36:03.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:34:00+00:00 exited with status success for try_number 1 2024-05-25T01:36:03.014955249Z [2024-05-25T01:36:03.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status success for try_number 1 2024-05-25T01:36:03.025354373Z [2024-05-25T01:36:03.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:35:00+00:00, map_index=-1, run_start_date=2024-05-25 01:36:02.173866+00:00, run_end_date=2024-05-25 01:36:02.662570+00:00, run_duration=0.488704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=695, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:36:01.141905+00:00, queued_by_job_id=1, pid=10214 2024-05-25T01:36:03.025940822Z [2024-05-25T01:36:03.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:34:00+00:00, map_index=-1, run_start_date=2024-05-25 01:36:01.954141+00:00, run_end_date=2024-05-25 01:36:02.489093+00:00, run_duration=0.534952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=694, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:36:01.141905+00:00, queued_by_job_id=1, pid=10213 2024-05-25T01:36:06.278640851Z [2024-05-25T01:36:06.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:36:06.279085316Z [2024-05-25T01:36:06.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:35:00+00:00, run_id=scheduled__2024-05-25T01:35:00+00:00, run_start_date=2024-05-25 01:36:01.039865+00:00, run_end_date=2024-05-25 01:36:06.278550+00:00, run_duration=5.238685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:35:00+00:00, data_interval_end=2024-05-25 01:36:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:36:06.288048662Z [2024-05-25T01:36:06.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:36:00+00:00, run_after=2024-05-25T01:37:00+00:00 2024-05-25T01:36:06.294845385Z [2024-05-25T01:36:06.294+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:36:06.295251072Z [2024-05-25T01:36:06.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:35:00+00:00, run_id=scheduled__2024-05-25T01:35:00+00:00, run_start_date=2024-05-25 01:36:01.041054+00:00, run_end_date=2024-05-25 01:36:06.294734+00:00, run_duration=5.25368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:35:00+00:00, data_interval_end=2024-05-25 01:36:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:36:06.305114599Z [2024-05-25T01:36:06.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:36:00+00:00, run_after=2024-05-25T01:37:00+00:00 2024-05-25T01:36:06.341062483Z [2024-05-25T01:36:06.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status success for try_number 1 2024-05-25T01:36:06.341261286Z [2024-05-25T01:36:06.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status success for try_number 1 2024-05-25T01:36:06.347610419Z [2024-05-25T01:36:06.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:35:00+00:00, map_index=-1, run_start_date=2024-05-25 01:36:03.216882+00:00, run_end_date=2024-05-25 01:36:05.243858+00:00, run_duration=2.026976, state=success, executor_state=success, try_number=1, max_tries=1, job_id=696, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:36:01.141905+00:00, queued_by_job_id=1, pid=10237 2024-05-25T01:36:06.347873731Z [2024-05-25T01:36:06.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:35:00+00:00, map_index=-1, run_start_date=2024-05-25 01:36:03.342225+00:00, run_end_date=2024-05-25 01:36:05.735697+00:00, run_duration=2.393472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=697, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:36:01.141905+00:00, queued_by_job_id=1, pid=10238 2024-05-25T01:37:01.011748379Z [2024-05-25T01:37:01.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:37:00+00:00, run_after=2024-05-25T01:38:00+00:00 2024-05-25T01:37:01.022186059Z [2024-05-25T01:37:01.021+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:37:01.033696791Z [2024-05-25T01:37:01.033+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:37:00+00:00, run_after=2024-05-25T01:38:00+00:00 2024-05-25T01:37:01.112123822Z [2024-05-25T01:37:01.111+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:37:01.112162354Z 2024-05-25T01:37:01.112169805Z 2024-05-25T01:37:01.112175975Z 2024-05-25T01:37:01.112359075Z [2024-05-25T01:37:01.112+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:37:01.112652733Z [2024-05-25T01:37:01.112+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:37:01.112917534Z [2024-05-25T01:37:01.112+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:37:01.114938443Z [2024-05-25T01:37:01.113+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:37:01.114978015Z 2024-05-25T01:37:01.114983214Z 2024-05-25T01:37:01.114993167Z 2024-05-25T01:37:01.119784065Z [2024-05-25T01:37:01.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:37:01.120129829Z [2024-05-25T01:37:01.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:37:01.120660036Z [2024-05-25T01:37:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:37:01.120933697Z [2024-05-25T01:37:01.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:37:01.121546053Z [2024-05-25T01:37:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:37:01.121981662Z [2024-05-25T01:37:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:37:01.442701816Z [2024-05-25T01:37:01.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:36:00+00:00 exited with status queued for try_number 1 2024-05-25T01:37:01.442732534Z [2024-05-25T01:37:01.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:36:00+00:00 exited with status queued for try_number 1 2024-05-25T01:37:01.442737791Z [2024-05-25T01:37:01.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:36:00+00:00 exited with status queued for try_number 1 2024-05-25T01:37:01.449731918Z [2024-05-25T01:37:01.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44f6390e-9e38-46e5-9957-823cf68b9f6c 2024-05-25T01:37:01.449818461Z [2024-05-25T01:37:01.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10621fcd-87ae-4884-97d3-08d2745d05eb 2024-05-25T01:37:01.450017144Z [2024-05-25T01:37:01.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f3f11b4-22fa-4aed-ab4f-57695ec01fb1 2024-05-25T01:37:02.831789647Z [2024-05-25T01:37:02.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:37:02.831962499Z [2024-05-25T01:37:02.831+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:36:00+00:00, run_id=scheduled__2024-05-25T01:36:00+00:00, run_start_date=2024-05-25 01:37:01.043038+00:00, run_end_date=2024-05-25 01:37:02.831632+00:00, run_duration=1.788594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:36:00+00:00, data_interval_end=2024-05-25 01:37:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:37:02.840538154Z [2024-05-25T01:37:02.840+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:37:00+00:00, run_after=2024-05-25T01:38:00+00:00 2024-05-25T01:37:02.910409044Z [2024-05-25T01:37:02.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:36:00+00:00 exited with status success for try_number 1 2024-05-25T01:37:02.922302046Z [2024-05-25T01:37:02.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:36:00+00:00, map_index=-1, run_start_date=2024-05-25 01:37:01.932811+00:00, run_end_date=2024-05-25 01:37:02.396894+00:00, run_duration=0.464083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=698, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:37:01.116005+00:00, queued_by_job_id=1, pid=10270 2024-05-25T01:37:05.071201279Z [2024-05-25T01:37:05.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:37:05.071559046Z [2024-05-25T01:37:05.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:36:00+00:00, run_id=scheduled__2024-05-25T01:36:00+00:00, run_start_date=2024-05-25 01:37:01.044235+00:00, run_end_date=2024-05-25 01:37:05.071079+00:00, run_duration=4.026844, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:36:00+00:00, data_interval_end=2024-05-25 01:37:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:37:05.085131175Z [2024-05-25T01:37:05.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:37:00+00:00, run_after=2024-05-25T01:38:00+00:00 2024-05-25T01:37:05.096817796Z [2024-05-25T01:37:05.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:37:05.097072944Z [2024-05-25T01:37:05.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:36:00+00:00, run_id=scheduled__2024-05-25T01:36:00+00:00, run_start_date=2024-05-25 01:37:01.046017+00:00, run_end_date=2024-05-25 01:37:05.096655+00:00, run_duration=4.050638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:36:00+00:00, data_interval_end=2024-05-25 01:37:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:37:05.111233478Z [2024-05-25T01:37:05.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:37:00+00:00, run_after=2024-05-25T01:38:00+00:00 2024-05-25T01:37:05.165660887Z [2024-05-25T01:37:05.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:36:00+00:00 exited with status success for try_number 1 2024-05-25T01:37:05.166132873Z [2024-05-25T01:37:05.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:36:00+00:00 exited with status success for try_number 1 2024-05-25T01:37:05.178363100Z [2024-05-25T01:37:05.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:36:00+00:00, map_index=-1, run_start_date=2024-05-25 01:37:02.853167+00:00, run_end_date=2024-05-25 01:37:04.040250+00:00, run_duration=1.187083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=699, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:37:01.116005+00:00, queued_by_job_id=1, pid=10288 2024-05-25T01:37:05.178896847Z [2024-05-25T01:37:05.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:36:00+00:00, map_index=-1, run_start_date=2024-05-25 01:37:02.959750+00:00, run_end_date=2024-05-25 01:37:04.504915+00:00, run_duration=1.545165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=700, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:37:01.116005+00:00, queued_by_job_id=1, pid=10289 2024-05-25T01:38:00.989891487Z [2024-05-25T01:38:00.989+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:38:00+00:00, run_after=2024-05-25T01:39:00+00:00 2024-05-25T01:38:01.001032984Z [2024-05-25T01:38:01.000+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:38:01.017544960Z [2024-05-25T01:38:01.016+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:38:01.037426357Z [2024-05-25T01:38:01.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:38:00+00:00, run_after=2024-05-25T01:39:00+00:00 2024-05-25T01:38:01.142959364Z [2024-05-25T01:38:01.142+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:38:01.142993174Z 2024-05-25T01:38:01.143000558Z 2024-05-25T01:38:01.143006352Z 2024-05-25T01:38:01.143033410Z 2024-05-25T01:38:01.143390271Z [2024-05-25T01:38:01.143+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:38:01.143589365Z [2024-05-25T01:38:01.143+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:38:01.143904975Z [2024-05-25T01:38:01.143+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:38:01.144168473Z [2024-05-25T01:38:01.143+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:38:01.145175415Z [2024-05-25T01:38:01.144+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:38:01.145195360Z 2024-05-25T01:38:01.145202632Z 2024-05-25T01:38:01.145252424Z 2024-05-25T01:38:01.145260427Z 2024-05-25T01:38:01.150752876Z [2024-05-25T01:38:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:38:01.150777940Z [2024-05-25T01:38:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:38:01.151143648Z [2024-05-25T01:38:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:38:01.151154522Z [2024-05-25T01:38:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:38:01.151483640Z [2024-05-25T01:38:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:38:01.151714774Z [2024-05-25T01:38:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:38:01.152046222Z [2024-05-25T01:38:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:38:01.152723908Z [2024-05-25T01:38:01.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:38:01.636699177Z [2024-05-25T01:38:01.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:36:00+00:00 exited with status queued for try_number 1 2024-05-25T01:38:01.636977331Z [2024-05-25T01:38:01.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:37:00+00:00 exited with status queued for try_number 1 2024-05-25T01:38:01.637240458Z [2024-05-25T01:38:01.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:37:00+00:00 exited with status queued for try_number 1 2024-05-25T01:38:01.637467543Z [2024-05-25T01:38:01.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:37:00+00:00 exited with status queued for try_number 1 2024-05-25T01:38:01.648102594Z [2024-05-25T01:38:01.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3544ae0f-4ba5-40c2-92ae-176fad83c4b2 2024-05-25T01:38:01.648396394Z [2024-05-25T01:38:01.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f3da8fb-7461-4f03-b7bf-20b26d898358 2024-05-25T01:38:01.648681571Z [2024-05-25T01:38:01.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to da2cfa3a-fd7d-49c0-8212-3266ea25ab4e 2024-05-25T01:38:01.648881360Z [2024-05-25T01:38:01.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26603dbe-39af-41d4-b26e-3bf24a66f12f 2024-05-25T01:38:03.473830639Z [2024-05-25T01:38:03.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:38:03.474003858Z [2024-05-25T01:38:03.473+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:37:00+00:00, run_id=scheduled__2024-05-25T01:37:00+00:00, run_start_date=2024-05-25 01:38:01.050124+00:00, run_end_date=2024-05-25 01:38:03.473688+00:00, run_duration=2.423564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:37:00+00:00, data_interval_end=2024-05-25 01:38:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:38:03.486486276Z [2024-05-25T01:38:03.486+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:38:00+00:00, run_after=2024-05-25T01:39:00+00:00 2024-05-25T01:38:03.493623682Z [2024-05-25T01:38:03.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:38:03.493855058Z [2024-05-25T01:38:03.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:36:00+00:00, run_id=scheduled__2024-05-25T01:36:00+00:00, run_start_date=2024-05-25 01:38:01.048828+00:00, run_end_date=2024-05-25 01:38:03.493534+00:00, run_duration=2.444706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:36:00+00:00, data_interval_end=2024-05-25 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:38:03.501140780Z [2024-05-25T01:38:03.500+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:38:00+00:00, run_after=2024-05-25T01:40:00+00:00 2024-05-25T01:38:03.552532233Z [2024-05-25T01:38:03.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:36:00+00:00 exited with status success for try_number 1 2024-05-25T01:38:03.553753656Z [2024-05-25T01:38:03.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:37:00+00:00 exited with status success for try_number 1 2024-05-25T01:38:03.560471154Z [2024-05-25T01:38:03.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:36:00+00:00, map_index=-1, run_start_date=2024-05-25 01:38:02.143467+00:00, run_end_date=2024-05-25 01:38:02.709310+00:00, run_duration=0.565843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=701, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:38:01.146760+00:00, queued_by_job_id=1, pid=10322 2024-05-25T01:38:03.560607342Z [2024-05-25T01:38:03.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:37:00+00:00, map_index=-1, run_start_date=2024-05-25 01:38:02.350596+00:00, run_end_date=2024-05-25 01:38:02.898112+00:00, run_duration=0.547516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=702, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:38:01.146760+00:00, queued_by_job_id=1, pid=10323 2024-05-25T01:38:05.069726907Z [2024-05-25T01:38:05.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:38:05.069869385Z [2024-05-25T01:38:05.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:37:00+00:00, run_id=scheduled__2024-05-25T01:37:00+00:00, run_start_date=2024-05-25 01:38:01.051159+00:00, run_end_date=2024-05-25 01:38:05.069538+00:00, run_duration=4.018379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:37:00+00:00, data_interval_end=2024-05-25 01:38:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:38:05.080548317Z [2024-05-25T01:38:05.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:38:00+00:00, run_after=2024-05-25T01:39:00+00:00 2024-05-25T01:38:05.142785552Z [2024-05-25T01:38:05.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:37:00+00:00 exited with status success for try_number 1 2024-05-25T01:38:05.151902771Z [2024-05-25T01:38:05.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:37:00+00:00, map_index=-1, run_start_date=2024-05-25 01:38:03.327692+00:00, run_end_date=2024-05-25 01:38:04.795486+00:00, run_duration=1.467794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=704, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:38:01.146760+00:00, queued_by_job_id=1, pid=10346 2024-05-25T01:38:06.208200978Z [2024-05-25T01:38:06.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:38:06.208653679Z [2024-05-25T01:38:06.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:37:00+00:00, run_id=scheduled__2024-05-25T01:37:00+00:00, run_start_date=2024-05-25 01:38:01.052227+00:00, run_end_date=2024-05-25 01:38:06.208032+00:00, run_duration=5.155805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:37:00+00:00, data_interval_end=2024-05-25 01:38:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:38:06.220621476Z [2024-05-25T01:38:06.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:38:00+00:00, run_after=2024-05-25T01:39:00+00:00 2024-05-25T01:38:06.271449900Z [2024-05-25T01:38:06.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:37:00+00:00 exited with status success for try_number 1 2024-05-25T01:38:06.280514744Z [2024-05-25T01:38:06.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:37:00+00:00, map_index=-1, run_start_date=2024-05-25 01:38:03.385793+00:00, run_end_date=2024-05-25 01:38:05.219978+00:00, run_duration=1.834185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=703, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:38:01.146760+00:00, queued_by_job_id=1, pid=10347 2024-05-25T01:39:00.938226446Z [2024-05-25T01:39:00.937+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:39:00+00:00, run_after=2024-05-25T01:40:00+00:00 2024-05-25T01:39:00.953846981Z [2024-05-25T01:39:00.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:39:00+00:00, run_after=2024-05-25T01:40:00+00:00 2024-05-25T01:39:00.962741161Z [2024-05-25T01:39:00.962+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:39:01.031365974Z [2024-05-25T01:39:01.031+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:39:01.031394537Z 2024-05-25T01:39:01.031399013Z 2024-05-25T01:39:01.031402802Z 2024-05-25T01:39:01.031695088Z [2024-05-25T01:39:01.031+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:39:01.031879372Z [2024-05-25T01:39:01.031+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:39:01.032065993Z [2024-05-25T01:39:01.031+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:39:01.032691811Z [2024-05-25T01:39:01.032+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:39:01.032697487Z 2024-05-25T01:39:01.032701536Z 2024-05-25T01:39:01.032705260Z 2024-05-25T01:39:01.036231624Z [2024-05-25T01:39:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:39:01.036442384Z [2024-05-25T01:39:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:39:01.036744573Z [2024-05-25T01:39:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:39:01.036929897Z [2024-05-25T01:39:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:39:01.037320929Z [2024-05-25T01:39:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:39:01.037590719Z [2024-05-25T01:39:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:39:01.275129063Z [2024-05-25T01:39:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:38:00+00:00 exited with status queued for try_number 1 2024-05-25T01:39:01.275471992Z [2024-05-25T01:39:01.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:38:00+00:00 exited with status queued for try_number 1 2024-05-25T01:39:01.275670055Z [2024-05-25T01:39:01.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:38:00+00:00 exited with status queued for try_number 1 2024-05-25T01:39:01.289376178Z [2024-05-25T01:39:01.288+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2563e44-57d0-4e2f-8af3-45034269a0f0 2024-05-25T01:39:01.289764862Z [2024-05-25T01:39:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51f89789-2566-4671-bea9-36ccb42bbb2f 2024-05-25T01:39:01.290141757Z [2024-05-25T01:39:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75f77fe2-6e24-4c88-8ba1-b36b06d9354f 2024-05-25T01:39:02.517849084Z [2024-05-25T01:39:02.517+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:39:02.518360494Z [2024-05-25T01:39:02.518+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:38:00+00:00, run_id=scheduled__2024-05-25T01:38:00+00:00, run_start_date=2024-05-25 01:39:00.976689+00:00, run_end_date=2024-05-25 01:39:02.517758+00:00, run_duration=1.541069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:38:00+00:00, data_interval_end=2024-05-25 01:39:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:39:02.527443497Z [2024-05-25T01:39:02.527+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:39:00+00:00, run_after=2024-05-25T01:40:00+00:00 2024-05-25T01:39:02.575157033Z [2024-05-25T01:39:02.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:38:00+00:00 exited with status success for try_number 1 2024-05-25T01:39:02.581231480Z [2024-05-25T01:39:02.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:38:00+00:00, map_index=-1, run_start_date=2024-05-25 01:39:01.940297+00:00, run_end_date=2024-05-25 01:39:02.352562+00:00, run_duration=0.412265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=705, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:39:01.033571+00:00, queued_by_job_id=1, pid=10379 2024-05-25T01:39:04.889144788Z [2024-05-25T01:39:04.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:39:04.889505723Z [2024-05-25T01:39:04.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:38:00+00:00, run_id=scheduled__2024-05-25T01:38:00+00:00, run_start_date=2024-05-25 01:39:00.978048+00:00, run_end_date=2024-05-25 01:39:04.889039+00:00, run_duration=3.910991, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:38:00+00:00, data_interval_end=2024-05-25 01:39:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:39:04.898795014Z [2024-05-25T01:39:04.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:39:00+00:00, run_after=2024-05-25T01:40:00+00:00 2024-05-25T01:39:04.968946953Z [2024-05-25T01:39:04.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:38:00+00:00 exited with status success for try_number 1 2024-05-25T01:39:04.982227764Z [2024-05-25T01:39:04.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:38:00+00:00, map_index=-1, run_start_date=2024-05-25 01:39:03.168305+00:00, run_end_date=2024-05-25 01:39:04.695709+00:00, run_duration=1.527404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=706, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:39:01.033571+00:00, queued_by_job_id=1, pid=10397 2024-05-25T01:39:06.067818743Z [2024-05-25T01:39:06.066+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:39:06.067860305Z [2024-05-25T01:39:06.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:38:00+00:00, run_id=scheduled__2024-05-25T01:38:00+00:00, run_start_date=2024-05-25 01:39:00.979154+00:00, run_end_date=2024-05-25 01:39:06.066544+00:00, run_duration=5.08739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:38:00+00:00, data_interval_end=2024-05-25 01:39:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:39:06.079609839Z [2024-05-25T01:39:06.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:39:00+00:00, run_after=2024-05-25T01:40:00+00:00 2024-05-25T01:39:06.129365212Z [2024-05-25T01:39:06.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:38:00+00:00 exited with status success for try_number 1 2024-05-25T01:39:06.134986148Z [2024-05-25T01:39:06.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:38:00+00:00, map_index=-1, run_start_date=2024-05-25 01:39:03.184443+00:00, run_end_date=2024-05-25 01:39:05.206829+00:00, run_duration=2.022386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=707, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:39:01.033571+00:00, queued_by_job_id=1, pid=10398 2024-05-25T01:40:00.224182658Z [2024-05-25T01:40:00.223+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:40:00.245799035Z [2024-05-25T01:40:00.245+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:40:00+00:00, run_after=2024-05-25T01:45:00+00:00 2024-05-25T01:40:00.262518027Z [2024-05-25T01:40:00.262+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:40:00+00:00, run_after=2024-05-25T01:41:00+00:00 2024-05-25T01:40:00.276485243Z [2024-05-25T01:40:00.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:40:00+00:00, run_after=2024-05-25T01:41:00+00:00 2024-05-25T01:40:00.285886629Z [2024-05-25T01:40:00.285+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:40:00.389823439Z [2024-05-25T01:40:00.389+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T01:40:00.389863846Z 2024-05-25T01:40:00.389873680Z 2024-05-25T01:40:00.389883324Z 2024-05-25T01:40:00.389891989Z 2024-05-25T01:40:00.389900328Z 2024-05-25T01:40:00.390101651Z [2024-05-25T01:40:00.389+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:40:00.390396423Z [2024-05-25T01:40:00.390+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:40:00.390715425Z [2024-05-25T01:40:00.390+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:40:00.391008665Z [2024-05-25T01:40:00.390+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:40:00.391332174Z [2024-05-25T01:40:00.391+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:40:00.392491348Z [2024-05-25T01:40:00.392+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:40:00.392504444Z 2024-05-25T01:40:00.392511597Z 2024-05-25T01:40:00.392517733Z 2024-05-25T01:40:00.392523679Z 2024-05-25T01:40:00.392529672Z 2024-05-25T01:40:00.403445994Z [2024-05-25T01:40:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:40:00.403757598Z [2024-05-25T01:40:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:40:00.404205741Z [2024-05-25T01:40:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:40:00.404628703Z [2024-05-25T01:40:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:40:00.404986368Z [2024-05-25T01:40:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:40:00.405172357Z [2024-05-25T01:40:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:40:00.405492966Z [2024-05-25T01:40:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:40:00.405695477Z [2024-05-25T01:40:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:40:00.405974705Z [2024-05-25T01:40:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:40:00.406154891Z [2024-05-25T01:40:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:40:01.024140120Z [2024-05-25T01:40:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status queued for try_number 1 2024-05-25T01:40:01.024181083Z [2024-05-25T01:40:01.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:38:00+00:00 exited with status queued for try_number 1 2024-05-25T01:40:01.024191991Z [2024-05-25T01:40:01.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:39:00+00:00 exited with status queued for try_number 1 2024-05-25T01:40:01.024272313Z [2024-05-25T01:40:01.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:39:00+00:00 exited with status queued for try_number 1 2024-05-25T01:40:01.025248603Z [2024-05-25T01:40:01.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:39:00+00:00 exited with status queued for try_number 1 2024-05-25T01:40:01.049391882Z [2024-05-25T01:40:01.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a1df366-7e05-48c1-89b1-ee365ce6ecc4 2024-05-25T01:40:01.051119458Z [2024-05-25T01:40:01.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to d109e635-9783-4bb3-a78b-b221666531e9 2024-05-25T01:40:01.051383438Z [2024-05-25T01:40:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd9150de-0513-45e2-99d9-9b1ce5e41489 2024-05-25T01:40:01.051502684Z [2024-05-25T01:40:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd82e19b-d0a6-43da-80b6-cb1efe884830 2024-05-25T01:40:01.051642068Z [2024-05-25T01:40:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80ab262c-9542-4552-bb8f-7bd2795eb95d 2024-05-25T01:40:02.266789048Z [2024-05-25T01:40:02.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:40:02.279013078Z [2024-05-25T01:40:02.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:38:00+00:00, run_id=scheduled__2024-05-25T01:38:00+00:00, run_start_date=2024-05-25 01:40:00.299908+00:00, run_end_date=2024-05-25 01:40:02.266706+00:00, run_duration=1.966798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:38:00+00:00, data_interval_end=2024-05-25 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:40:02.290018904Z [2024-05-25T01:40:02.289+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:40:00+00:00, run_after=2024-05-25T01:42:00+00:00 2024-05-25T01:40:02.306277266Z [2024-05-25T01:40:02.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:40:02.306504820Z [2024-05-25T01:40:02.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:39:00+00:00, run_id=scheduled__2024-05-25T01:39:00+00:00, run_start_date=2024-05-25 01:40:00.301237+00:00, run_end_date=2024-05-25 01:40:02.306185+00:00, run_duration=2.004948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:39:00+00:00, data_interval_end=2024-05-25 01:40:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:40:02.317313383Z [2024-05-25T01:40:02.316+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:40:00+00:00, run_after=2024-05-25T01:41:00+00:00 2024-05-25T01:40:02.376559902Z [2024-05-25T01:40:02.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:38:00+00:00 exited with status success for try_number 1 2024-05-25T01:40:02.376596396Z [2024-05-25T01:40:02.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:39:00+00:00 exited with status success for try_number 1 2024-05-25T01:40:02.382883107Z [2024-05-25T01:40:02.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:38:00+00:00, map_index=-1, run_start_date=2024-05-25 01:40:01.225727+00:00, run_end_date=2024-05-25 01:40:01.743138+00:00, run_duration=0.517411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=708, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:40:00.394909+00:00, queued_by_job_id=1, pid=10431 2024-05-25T01:40:02.382975918Z [2024-05-25T01:40:02.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:39:00+00:00, map_index=-1, run_start_date=2024-05-25 01:40:01.534662+00:00, run_end_date=2024-05-25 01:40:01.976848+00:00, run_duration=0.442186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=709, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:40:00.394909+00:00, queued_by_job_id=1, pid=10433 2024-05-25T01:40:04.135316095Z [2024-05-25T01:40:04.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:40:04.135952315Z [2024-05-25T01:40:04.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:39:00+00:00, run_id=scheduled__2024-05-25T01:39:00+00:00, run_start_date=2024-05-25 01:40:00.302402+00:00, run_end_date=2024-05-25 01:40:04.135271+00:00, run_duration=3.832869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:39:00+00:00, data_interval_end=2024-05-25 01:40:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:40:04.150327919Z [2024-05-25T01:40:04.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:40:00+00:00, run_after=2024-05-25T01:41:00+00:00 2024-05-25T01:40:04.213373904Z [2024-05-25T01:40:04.212+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:40:04.213404823Z 2024-05-25T01:40:04.213716119Z [2024-05-25T01:40:04.213+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:40:04.214505731Z [2024-05-25T01:40:04.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:40:04.214519939Z 2024-05-25T01:40:04.217417678Z [2024-05-25T01:40:04.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:40:04.217655348Z [2024-05-25T01:40:04.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:40:04.272106620Z [2024-05-25T01:40:04.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status queued for try_number 1 2024-05-25T01:40:04.272817139Z [2024-05-25T01:40:04.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status success for try_number 1 2024-05-25T01:40:04.273107897Z [2024-05-25T01:40:04.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:39:00+00:00 exited with status success for try_number 1 2024-05-25T01:40:04.282199735Z [2024-05-25T01:40:04.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:39:00+00:00, map_index=-1, run_start_date=2024-05-25 01:40:02.554553+00:00, run_end_date=2024-05-25 01:40:03.800494+00:00, run_duration=1.245941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=710, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:40:00.394909+00:00, queued_by_job_id=1, pid=10462 2024-05-25T01:40:04.282736023Z [2024-05-25T01:40:04.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:35:00+00:00, map_index=-1, run_start_date=2024-05-25 01:40:02.691157+00:00, run_end_date=2024-05-25 01:40:03.013717+00:00, run_duration=0.32256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=711, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:40:00.394909+00:00, queued_by_job_id=1, pid=10463 2024-05-25T01:40:04.283158528Z [2024-05-25T01:40:04.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26fbb5bc-c3a9-4d29-8adb-a403d6bb6592 2024-05-25T01:40:05.450213371Z [2024-05-25T01:40:05.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:40:05.450636649Z [2024-05-25T01:40:05.450+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:39:00+00:00, run_id=scheduled__2024-05-25T01:39:00+00:00, run_start_date=2024-05-25 01:40:00.303570+00:00, run_end_date=2024-05-25 01:40:05.450326+00:00, run_duration=5.146756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:39:00+00:00, data_interval_end=2024-05-25 01:40:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:40:05.459458055Z [2024-05-25T01:40:05.459+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:40:00+00:00, run_after=2024-05-25T01:41:00+00:00 2024-05-25T01:40:05.510380867Z [2024-05-25T01:40:05.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:39:00+00:00 exited with status success for try_number 1 2024-05-25T01:40:05.519912048Z [2024-05-25T01:40:05.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:39:00+00:00, map_index=-1, run_start_date=2024-05-25 01:40:02.698974+00:00, run_end_date=2024-05-25 01:40:04.379267+00:00, run_duration=1.680293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=712, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:40:00.394909+00:00, queued_by_job_id=1, pid=10464 2024-05-25T01:40:07.253809860Z [2024-05-25T01:40:07.253+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:40:07.253839903Z 2024-05-25T01:40:07.254134153Z [2024-05-25T01:40:07.253+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:40:07.255213626Z [2024-05-25T01:40:07.254+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:40:07.255230050Z 2024-05-25T01:40:07.258643283Z [2024-05-25T01:40:07.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:40:07.259043226Z [2024-05-25T01:40:07.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:40:07.314227610Z [2024-05-25T01:40:07.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status queued for try_number 1 2024-05-25T01:40:07.314695890Z [2024-05-25T01:40:07.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status success for try_number 1 2024-05-25T01:40:07.326577834Z [2024-05-25T01:40:07.326+0000] {scheduler_job.py:635} INFO - Setting external_id for to 111ea150-1119-4426-be13-7408cfe5c123 2024-05-25T01:40:07.327070766Z [2024-05-25T01:40:07.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T01:35:00+00:00, map_index=-1, run_start_date=2024-05-25 01:40:05.862917+00:00, run_end_date=2024-05-25 01:40:06.226267+00:00, run_duration=0.36335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=713, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:40:04.215003+00:00, queued_by_job_id=1, pid=10487 2024-05-25T01:40:09.318491177Z [2024-05-25T01:40:09.318+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:40:09.318522772Z 2024-05-25T01:40:09.318733341Z [2024-05-25T01:40:09.318+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:40:09.319225908Z [2024-05-25T01:40:09.319+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:40:09.319231038Z 2024-05-25T01:40:09.321261830Z [2024-05-25T01:40:09.321+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:40:09.321501303Z [2024-05-25T01:40:09.321+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:40:09.373811852Z [2024-05-25T01:40:09.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status queued for try_number 1 2024-05-25T01:40:09.374030385Z [2024-05-25T01:40:09.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status success for try_number 1 2024-05-25T01:40:09.383477214Z [2024-05-25T01:40:09.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7622c4eb-108f-4462-ac0d-4ba6f0f40d16 2024-05-25T01:40:09.383944596Z [2024-05-25T01:40:09.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:35:00+00:00, map_index=0, run_start_date=2024-05-25 01:40:08.785621+00:00, run_end_date=2024-05-25 01:40:09.152460+00:00, run_duration=0.366839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=714, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:40:07.255999+00:00, queued_by_job_id=1, pid=10508 2024-05-25T01:40:12.330122909Z [2024-05-25T01:40:12.329+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:40:12.330310976Z [2024-05-25T01:40:12.330+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:35:00+00:00, run_id=scheduled__2024-05-25T01:35:00+00:00, run_start_date=2024-05-25 01:40:00.298471+00:00, run_end_date=2024-05-25 01:40:12.330055+00:00, run_duration=12.031584, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:35:00+00:00, data_interval_end=2024-05-25 01:40:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T01:40:12.338843756Z [2024-05-25T01:40:12.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:40:00+00:00, run_after=2024-05-25T01:45:00+00:00 2024-05-25T01:40:12.378373058Z [2024-05-25T01:40:12.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status success for try_number 1 2024-05-25T01:40:12.392355410Z [2024-05-25T01:40:12.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:35:00+00:00, map_index=-1, run_start_date=2024-05-25 01:40:10.924668+00:00, run_end_date=2024-05-25 01:40:11.359602+00:00, run_duration=0.434934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=715, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:40:09.319607+00:00, queued_by_job_id=1, pid=10516 2024-05-25T01:40:29.442964559Z [2024-05-25T01:40:29.442+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T01:40:38.380047893Z [2024-05-25T01:40:38.379+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:40:38.380102536Z 2024-05-25T01:40:38.380789396Z [2024-05-25T01:40:38.380+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-05-25T01:40:38.382304030Z [2024-05-25T01:40:38.381+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:40:38.382332126Z 2024-05-25T01:40:38.387005930Z [2024-05-25T01:40:38.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240525014037_583623', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:40:38.388409432Z [2024-05-25T01:40:38.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240525014037_583623', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-25T01:40:38.446859192Z [2024-05-25T01:40:38.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240525014037_583623 exited with status queued for try_number 1 2024-05-25T01:40:38.452071478Z [2024-05-25T01:40:38.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96cc24d7-8f29-4a3d-ad13-6723b2a8ac58 2024-05-25T01:40:39.599445416Z [2024-05-25T01:40:39.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:40:39.599739866Z [2024-05-25T01:40:39.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-05-25 01:40:37.968440+00:00, run_id=vdu_down_20240525014037_583623, run_start_date=2024-05-25 01:40:38.322163+00:00, run_end_date=2024-05-25 01:40:39.599255+00:00, run_duration=1.277092, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-25 01:40:37.968440+00:00, data_interval_end=2024-05-25 01:40:37.968440+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-05-25T01:40:39.603618744Z [2024-05-25T01:40:39.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-05-25T01:40:40.739126256Z [2024-05-25T01:40:40.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240525014037_583623 exited with status success for try_number 1 2024-05-25T01:40:40.748060453Z [2024-05-25T01:40:40.747+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240525014037_583623, map_index=-1, run_start_date=2024-05-25 01:40:39.114059+00:00, run_end_date=2024-05-25 01:40:39.514473+00:00, run_duration=0.400414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=716, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:40:38.382889+00:00, queued_by_job_id=1, pid=10518 2024-05-25T01:41:00.738664738Z [2024-05-25T01:41:00.738+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:41:00+00:00, run_after=2024-05-25T01:42:00+00:00 2024-05-25T01:41:00.754164564Z [2024-05-25T01:41:00.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:41:00+00:00, run_after=2024-05-25T01:42:00+00:00 2024-05-25T01:41:00.763727992Z [2024-05-25T01:41:00.763+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:41:00.875781859Z [2024-05-25T01:41:00.875+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:41:00.875846167Z 2024-05-25T01:41:00.875854266Z 2024-05-25T01:41:00.875860660Z 2024-05-25T01:41:00.875878961Z [2024-05-25T01:41:00.875+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:41:00.875948405Z [2024-05-25T01:41:00.875+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:41:00.876188466Z [2024-05-25T01:41:00.875+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:41:00.877065965Z [2024-05-25T01:41:00.876+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:41:00.877086747Z 2024-05-25T01:41:00.877119615Z 2024-05-25T01:41:00.877127172Z 2024-05-25T01:41:00.882186298Z [2024-05-25T01:41:00.881+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:41:00.882354533Z [2024-05-25T01:41:00.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:41:00.882664012Z [2024-05-25T01:41:00.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:41:00.882816305Z [2024-05-25T01:41:00.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:41:00.883113896Z [2024-05-25T01:41:00.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:41:00.883328851Z [2024-05-25T01:41:00.883+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:41:01.138814515Z [2024-05-25T01:41:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status queued for try_number 1 2024-05-25T01:41:01.139469405Z [2024-05-25T01:41:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status queued for try_number 1 2024-05-25T01:41:01.140327803Z [2024-05-25T01:41:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status queued for try_number 1 2024-05-25T01:41:01.152643090Z [2024-05-25T01:41:01.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to df6e03c6-f425-475a-8471-d9ee29cf3600 2024-05-25T01:41:01.152736638Z [2024-05-25T01:41:01.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bd8a67c-a863-4784-bb03-d6901480bb77 2024-05-25T01:41:01.152965381Z [2024-05-25T01:41:01.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to a40ff48b-8b0c-4698-9ad5-cee92fbc2f25 2024-05-25T01:41:03.159310212Z [2024-05-25T01:41:03.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:41:03.159517781Z [2024-05-25T01:41:03.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:40:00+00:00, run_id=scheduled__2024-05-25T01:40:00+00:00, run_start_date=2024-05-25 01:41:00.777881+00:00, run_end_date=2024-05-25 01:41:03.159175+00:00, run_duration=2.381294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:40:00+00:00, data_interval_end=2024-05-25 01:41:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:41:03.169586710Z [2024-05-25T01:41:03.169+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:41:00+00:00, run_after=2024-05-25T01:42:00+00:00 2024-05-25T01:41:03.236582005Z [2024-05-25T01:41:03.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status success for try_number 1 2024-05-25T01:41:03.248062634Z [2024-05-25T01:41:03.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:40:00+00:00, map_index=-1, run_start_date=2024-05-25 01:41:01.654067+00:00, run_end_date=2024-05-25 01:41:02.063291+00:00, run_duration=0.409224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=717, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:41:00.878337+00:00, queued_by_job_id=1, pid=10533 2024-05-25T01:41:05.539857938Z [2024-05-25T01:41:05.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:41:05.540471796Z [2024-05-25T01:41:05.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:40:00+00:00, run_id=scheduled__2024-05-25T01:40:00+00:00, run_start_date=2024-05-25 01:41:00.781087+00:00, run_end_date=2024-05-25 01:41:05.539929+00:00, run_duration=4.758842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:40:00+00:00, data_interval_end=2024-05-25 01:41:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:41:05.556560337Z [2024-05-25T01:41:05.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:41:00+00:00, run_after=2024-05-25T01:42:00+00:00 2024-05-25T01:41:05.566610287Z [2024-05-25T01:41:05.566+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:41:05.566871757Z [2024-05-25T01:41:05.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:40:00+00:00, run_id=scheduled__2024-05-25T01:40:00+00:00, run_start_date=2024-05-25 01:41:00.783688+00:00, run_end_date=2024-05-25 01:41:05.566456+00:00, run_duration=4.782768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:40:00+00:00, data_interval_end=2024-05-25 01:41:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:41:05.580914535Z [2024-05-25T01:41:05.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:41:00+00:00, run_after=2024-05-25T01:42:00+00:00 2024-05-25T01:41:05.623655274Z [2024-05-25T01:41:05.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status success for try_number 1 2024-05-25T01:41:05.623960960Z [2024-05-25T01:41:05.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status success for try_number 1 2024-05-25T01:41:05.632599655Z [2024-05-25T01:41:05.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:40:00+00:00, map_index=-1, run_start_date=2024-05-25 01:41:02.957527+00:00, run_end_date=2024-05-25 01:41:04.556066+00:00, run_duration=1.598539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=719, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:41:00.878337+00:00, queued_by_job_id=1, pid=10552 2024-05-25T01:41:05.632924099Z [2024-05-25T01:41:05.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:40:00+00:00, map_index=-1, run_start_date=2024-05-25 01:41:02.822853+00:00, run_end_date=2024-05-25 01:41:05.011453+00:00, run_duration=2.1886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=718, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:41:00.878337+00:00, queued_by_job_id=1, pid=10551 2024-05-25T01:42:00.130217732Z [2024-05-25T01:42:00.129+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:42:00.140058815Z [2024-05-25T01:42:00.139+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:42:00.158829088Z [2024-05-25T01:42:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:42:00+00:00, run_after=2024-05-25T01:43:00+00:00 2024-05-25T01:42:00.174537632Z [2024-05-25T01:42:00.174+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:42:00+00:00, run_after=2024-05-25T01:43:00+00:00 2024-05-25T01:42:00.282485559Z [2024-05-25T01:42:00.282+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:42:00.282521683Z 2024-05-25T01:42:00.282530360Z 2024-05-25T01:42:00.282537270Z 2024-05-25T01:42:00.282543883Z 2024-05-25T01:42:00.282580946Z [2024-05-25T01:42:00.282+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:42:00.282765398Z [2024-05-25T01:42:00.282+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:42:00.282964998Z [2024-05-25T01:42:00.282+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:42:00.283108485Z [2024-05-25T01:42:00.282+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:42:00.283938333Z [2024-05-25T01:42:00.283+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:42:00.283978040Z 2024-05-25T01:42:00.283999181Z 2024-05-25T01:42:00.284013958Z 2024-05-25T01:42:00.284026100Z 2024-05-25T01:42:00.288839131Z [2024-05-25T01:42:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:42:00.289010113Z [2024-05-25T01:42:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:42:00.289393118Z [2024-05-25T01:42:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:42:00.289635160Z [2024-05-25T01:42:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:42:00.289942347Z [2024-05-25T01:42:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:42:00.290144838Z [2024-05-25T01:42:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:42:00.290513444Z [2024-05-25T01:42:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:42:00.290708814Z [2024-05-25T01:42:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:42:00.846992182Z [2024-05-25T01:42:00.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status queued for try_number 1 2024-05-25T01:42:00.847010171Z [2024-05-25T01:42:00.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:41:00+00:00 exited with status queued for try_number 1 2024-05-25T01:42:00.847243405Z [2024-05-25T01:42:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:41:00+00:00 exited with status queued for try_number 1 2024-05-25T01:42:00.847408411Z [2024-05-25T01:42:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:41:00+00:00 exited with status queued for try_number 1 2024-05-25T01:42:00.862890943Z [2024-05-25T01:42:00.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to acd3eaea-9d74-4b32-9f96-a06697727e5e 2024-05-25T01:42:00.863159602Z [2024-05-25T01:42:00.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f218ede-f367-4863-993b-2d2510c45b66 2024-05-25T01:42:00.863373117Z [2024-05-25T01:42:00.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2189311-8e3c-4a3e-9f2a-247aaf681fc6 2024-05-25T01:42:00.863706934Z [2024-05-25T01:42:00.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd6b8fef-cd3b-4257-b313-193fa761aeee 2024-05-25T01:42:02.122353547Z [2024-05-25T01:42:02.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:42:02.122586256Z [2024-05-25T01:42:02.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:41:00+00:00, run_id=scheduled__2024-05-25T01:41:00+00:00, run_start_date=2024-05-25 01:42:00.189728+00:00, run_end_date=2024-05-25 01:42:02.122258+00:00, run_duration=1.93253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:41:00+00:00, data_interval_end=2024-05-25 01:42:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:42:02.144677530Z [2024-05-25T01:42:02.143+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:42:00+00:00, run_after=2024-05-25T01:43:00+00:00 2024-05-25T01:42:02.153399360Z [2024-05-25T01:42:02.151+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:42:02.153425997Z [2024-05-25T01:42:02.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:40:00+00:00, run_id=scheduled__2024-05-25T01:40:00+00:00, run_start_date=2024-05-25 01:42:00.187695+00:00, run_end_date=2024-05-25 01:42:02.152280+00:00, run_duration=1.964585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:40:00+00:00, data_interval_end=2024-05-25 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:42:02.161362123Z [2024-05-25T01:42:02.161+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:42:00+00:00, run_after=2024-05-25T01:44:00+00:00 2024-05-25T01:42:02.254298055Z [2024-05-25T01:42:02.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status success for try_number 1 2024-05-25T01:42:02.254581350Z [2024-05-25T01:42:02.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:41:00+00:00 exited with status success for try_number 1 2024-05-25T01:42:02.264649964Z [2024-05-25T01:42:02.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:41:00+00:00, map_index=-1, run_start_date=2024-05-25 01:42:01.176779+00:00, run_end_date=2024-05-25 01:42:01.731317+00:00, run_duration=0.554538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=720, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:42:00.285161+00:00, queued_by_job_id=1, pid=10586 2024-05-25T01:42:02.264859384Z [2024-05-25T01:42:02.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:40:00+00:00, map_index=-1, run_start_date=2024-05-25 01:42:01.317723+00:00, run_end_date=2024-05-25 01:42:01.828627+00:00, run_duration=0.510904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=721, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:42:00.285161+00:00, queued_by_job_id=1, pid=10587 2024-05-25T01:42:04.725637214Z [2024-05-25T01:42:04.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:42:04.726177236Z [2024-05-25T01:42:04.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:41:00+00:00, run_id=scheduled__2024-05-25T01:41:00+00:00, run_start_date=2024-05-25 01:42:00.191293+00:00, run_end_date=2024-05-25 01:42:04.725842+00:00, run_duration=4.534549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:41:00+00:00, data_interval_end=2024-05-25 01:42:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:42:04.735043739Z [2024-05-25T01:42:04.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:42:00+00:00, run_after=2024-05-25T01:43:00+00:00 2024-05-25T01:42:04.741693903Z [2024-05-25T01:42:04.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:42:04.741933642Z [2024-05-25T01:42:04.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:41:00+00:00, run_id=scheduled__2024-05-25T01:41:00+00:00, run_start_date=2024-05-25 01:42:00.192441+00:00, run_end_date=2024-05-25 01:42:04.741665+00:00, run_duration=4.549224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:41:00+00:00, data_interval_end=2024-05-25 01:42:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:42:04.751314318Z [2024-05-25T01:42:04.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:42:00+00:00, run_after=2024-05-25T01:43:00+00:00 2024-05-25T01:42:04.805472654Z [2024-05-25T01:42:04.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:41:00+00:00 exited with status success for try_number 1 2024-05-25T01:42:04.805804916Z [2024-05-25T01:42:04.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:41:00+00:00 exited with status success for try_number 1 2024-05-25T01:42:04.813075266Z [2024-05-25T01:42:04.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:41:00+00:00, map_index=-1, run_start_date=2024-05-25 01:42:02.537014+00:00, run_end_date=2024-05-25 01:42:03.730810+00:00, run_duration=1.193796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=722, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:42:00.285161+00:00, queued_by_job_id=1, pid=10610 2024-05-25T01:42:04.813555838Z [2024-05-25T01:42:04.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:41:00+00:00, map_index=-1, run_start_date=2024-05-25 01:42:02.622079+00:00, run_end_date=2024-05-25 01:42:04.114876+00:00, run_duration=1.492797, state=success, executor_state=success, try_number=1, max_tries=1, job_id=723, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:42:00.285161+00:00, queued_by_job_id=1, pid=10611 2024-05-25T01:42:17.572924535Z [2024-05-25T01:42:17.572+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a to 2024-05-25T01:42:00+00:00, run_after=2024-05-25T01:43:00+00:00 2024-05-25T01:42:17.613718333Z [2024-05-25T01:42:17.613+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:42:17.613750238Z 2024-05-25T01:42:17.613908957Z [2024-05-25T01:42:17.613+0000] {scheduler_job.py:425} INFO - DAG vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:42:17.615107040Z [2024-05-25T01:42:17.614+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:42:17.615116998Z 2024-05-25T01:42:17.619176411Z [2024-05-25T01:42:17.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:42:17.619426255Z [2024-05-25T01:42:17.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:42:17.681180156Z [2024-05-25T01:42:17.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:41:00+00:00 exited with status queued for try_number 1 2024-05-25T01:42:17.685921259Z [2024-05-25T01:42:17.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87a0ffb0-6788-4253-adef-915e1bab0687 2024-05-25T01:42:21.448612017Z [2024-05-25T01:42:21.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:42:21.449184579Z [2024-05-25T01:42:21.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a, execution_date=2024-05-25 01:41:00+00:00, run_id=scheduled__2024-05-25T01:41:00+00:00, run_start_date=2024-05-25 01:42:17.584720+00:00, run_end_date=2024-05-25 01:42:21.448470+00:00, run_duration=3.86375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:41:00+00:00, data_interval_end=2024-05-25 01:42:00+00:00, dag_hash=2299bfb446ac7a0b9903f22f36a2448f 2024-05-25T01:42:21.463489307Z [2024-05-25T01:42:21.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a to 2024-05-25T01:42:00+00:00, run_after=2024-05-25T01:43:00+00:00 2024-05-25T01:42:21.514118758Z [2024-05-25T01:42:21.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:41:00+00:00 exited with status success for try_number 1 2024-05-25T01:42:21.522392535Z [2024-05-25T01:42:21.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:41:00+00:00, map_index=-1, run_start_date=2024-05-25 01:42:19.238740+00:00, run_end_date=2024-05-25 01:42:20.499447+00:00, run_duration=1.260707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=724, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:42:17.615831+00:00, queued_by_job_id=1, pid=10642 2024-05-25T01:42:26.625608320Z [2024-05-25T01:42:26.624+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:42:26.660784559Z [2024-05-25T01:42:26.660+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:42:26.660803203Z 2024-05-25T01:42:26.661125361Z [2024-05-25T01:42:26.660+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:42:26.662935590Z [2024-05-25T01:42:26.662+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:42:26.662949597Z 2024-05-25T01:42:26.665176505Z [2024-05-25T01:42:26.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:42:26.665370723Z [2024-05-25T01:42:26.665+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:42:26.722350619Z [2024-05-25T01:42:26.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:41:00+00:00 exited with status queued for try_number 1 2024-05-25T01:42:26.728064014Z [2024-05-25T01:42:26.727+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2da3a3f4-720a-4d85-8158-1eaff0967761 2024-05-25T01:42:30.440972938Z [2024-05-25T01:42:30.440+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:42:30.441472924Z [2024-05-25T01:42:30.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, execution_date=2024-05-25 01:41:00+00:00, run_id=scheduled__2024-05-25T01:41:00+00:00, run_start_date=2024-05-25 01:42:26.634753+00:00, run_end_date=2024-05-25 01:42:30.441021+00:00, run_duration=3.806268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:41:00+00:00, data_interval_end=2024-05-25 01:42:00+00:00, dag_hash=276b44e9b5d5181aa411d11a4f41b623 2024-05-25T01:42:30.450775045Z [2024-05-25T01:42:30.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a to 2024-05-25T01:42:00+00:00, run_after=2024-05-25T01:43:00+00:00 2024-05-25T01:42:30.495802260Z [2024-05-25T01:42:30.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:41:00+00:00 exited with status success for try_number 1 2024-05-25T01:42:30.505654964Z [2024-05-25T01:42:30.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:41:00+00:00, map_index=-1, run_start_date=2024-05-25 01:42:28.324931+00:00, run_end_date=2024-05-25 01:42:29.927299+00:00, run_duration=1.602368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=725, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:42:26.663237+00:00, queued_by_job_id=1, pid=10655 2024-05-25T01:42:34.891856639Z [2024-05-25T01:42:34.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a to 2024-05-25T01:40:00+00:00, run_after=2024-05-25T01:45:00+00:00 2024-05-25T01:42:34.967105199Z [2024-05-25T01:42:34.966+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:42:34.967137853Z 2024-05-25T01:42:34.967348928Z [2024-05-25T01:42:34.967+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:42:34.968492971Z [2024-05-25T01:42:34.968+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:42:34.968533216Z 2024-05-25T01:42:34.972336628Z [2024-05-25T01:42:34.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:42:34.972699588Z [2024-05-25T01:42:34.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:42:35.039940264Z [2024-05-25T01:42:35.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status queued for try_number 1 2024-05-25T01:42:35.045675570Z [2024-05-25T01:42:35.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to c359e650-07bd-48be-bb71-1dba2d72fde9 2024-05-25T01:42:37.334957802Z [2024-05-25T01:42:37.334+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:42:37.334991751Z 2024-05-25T01:42:37.335162928Z [2024-05-25T01:42:37.334+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:42:37.336138184Z [2024-05-25T01:42:37.335+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:42:37.336174561Z 2024-05-25T01:42:37.339415718Z [2024-05-25T01:42:37.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='split_metrics', run_id='scheduled__2024-05-25T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:42:37.339632928Z [2024-05-25T01:42:37.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'split_metrics', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:42:37.402682419Z [2024-05-25T01:42:37.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.split_metrics run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status queued for try_number 1 2024-05-25T01:42:37.403091151Z [2024-05-25T01:42:37.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status success for try_number 1 2024-05-25T01:42:37.409582815Z [2024-05-25T01:42:37.409+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00cabccd-87c5-4ea7-b627-f9af9d3e2696 2024-05-25T01:42:37.410285428Z [2024-05-25T01:42:37.409+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:35:00+00:00, map_index=-1, run_start_date=2024-05-25 01:42:36.589634+00:00, run_end_date=2024-05-25 01:42:36.979146+00:00, run_duration=0.389512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=726, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:42:34.969243+00:00, queued_by_job_id=1, pid=10668 2024-05-25T01:42:39.454029185Z [2024-05-25T01:42:39.453+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:42:39.454062794Z 2024-05-25T01:42:39.454066977Z [2024-05-25T01:42:39.453+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:42:39.454588924Z [2024-05-25T01:42:39.454+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:42:39.454596591Z 2024-05-25T01:42:39.456472811Z [2024-05-25T01:42:39.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:42:39.456599778Z [2024-05-25T01:42:39.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'collect_metrics', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:42:39.510437115Z [2024-05-25T01:42:39.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.collect_metrics run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status queued for try_number 1 2024-05-25T01:42:39.510637126Z [2024-05-25T01:42:39.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.split_metrics run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status success for try_number 1 2024-05-25T01:42:39.516479490Z [2024-05-25T01:42:39.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3caa19d-f47b-41e9-8ef6-348467878145 2024-05-25T01:42:39.516753403Z [2024-05-25T01:42:39.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=split_metrics, run_id=scheduled__2024-05-25T01:35:00+00:00, map_index=-1, run_start_date=2024-05-25 01:42:38.890209+00:00, run_end_date=2024-05-25 01:42:39.261264+00:00, run_duration=0.371055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=727, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:42:37.336633+00:00, queued_by_job_id=1, pid=10681 2024-05-25T01:42:41.777024666Z [2024-05-25T01:42:41.776+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:42:41.777063674Z 2024-05-25T01:42:41.777431664Z [2024-05-25T01:42:41.777+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:42:41.778255717Z [2024-05-25T01:42:41.778+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:42:41.778267815Z 2024-05-25T01:42:41.781247657Z [2024-05-25T01:42:41.780+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:42:41.781496280Z [2024-05-25T01:42:41.781+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'send_prometheus', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:42:41.849068680Z [2024-05-25T01:42:41.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.send_prometheus run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status queued for try_number 1 2024-05-25T01:42:41.849757671Z [2024-05-25T01:42:41.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.collect_metrics run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status success for try_number 1 2024-05-25T01:42:41.858006812Z [2024-05-25T01:42:41.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24f26896-5811-4a1a-b41a-11fe466cc915 2024-05-25T01:42:41.858185402Z [2024-05-25T01:42:41.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:35:00+00:00, map_index=0, run_start_date=2024-05-25 01:42:40.986264+00:00, run_end_date=2024-05-25 01:42:41.351079+00:00, run_duration=0.364815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=728, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:42:39.454875+00:00, queued_by_job_id=1, pid=10689 2024-05-25T01:42:43.825672854Z [2024-05-25T01:42:43.825+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:42:43.826275040Z [2024-05-25T01:42:43.825+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, execution_date=2024-05-25 01:35:00+00:00, run_id=scheduled__2024-05-25T01:35:00+00:00, run_start_date=2024-05-25 01:42:34.907735+00:00, run_end_date=2024-05-25 01:42:43.825689+00:00, run_duration=8.917954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:35:00+00:00, data_interval_end=2024-05-25 01:40:00+00:00, dag_hash=c902e50db05a7b8c98f7a182e4dc78cf 2024-05-25T01:42:43.836529923Z [2024-05-25T01:42:43.836+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a to 2024-05-25T01:40:00+00:00, run_after=2024-05-25T01:45:00+00:00 2024-05-25T01:42:44.999952284Z [2024-05-25T01:42:44.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.send_prometheus run_id=scheduled__2024-05-25T01:35:00+00:00 exited with status success for try_number 1 2024-05-25T01:42:45.018787698Z [2024-05-25T01:42:45.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:35:00+00:00, map_index=-1, run_start_date=2024-05-25 01:42:43.385739+00:00, run_end_date=2024-05-25 01:42:43.788221+00:00, run_duration=0.402482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=729, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:42:41.778754+00:00, queued_by_job_id=1, pid=10697 2024-05-25T01:43:00.711805664Z [2024-05-25T01:43:00.711+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:43:00.733271697Z [2024-05-25T01:43:00.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:43:00+00:00, run_after=2024-05-25T01:44:00+00:00 2024-05-25T01:43:00.743052548Z [2024-05-25T01:43:00.742+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:43:00.758300399Z [2024-05-25T01:43:00.757+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:43:00+00:00, run_after=2024-05-25T01:44:00+00:00 2024-05-25T01:43:00.784842659Z [2024-05-25T01:43:00.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a to 2024-05-25T01:43:00+00:00, run_after=2024-05-25T01:44:00+00:00 2024-05-25T01:43:00.907955220Z [2024-05-25T01:43:00.907+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T01:43:00.908028334Z 2024-05-25T01:43:00.908039422Z 2024-05-25T01:43:00.908048260Z 2024-05-25T01:43:00.908056725Z 2024-05-25T01:43:00.908091427Z 2024-05-25T01:43:00.908117622Z [2024-05-25T01:43:00.907+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:43:00.908149356Z [2024-05-25T01:43:00.907+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:43:00.908208987Z [2024-05-25T01:43:00.908+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:43:00.908364605Z [2024-05-25T01:43:00.908+0000] {scheduler_job.py:425} INFO - DAG vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:43:00.908491635Z [2024-05-25T01:43:00.908+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:43:00.909305504Z [2024-05-25T01:43:00.908+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:43:00.909340728Z 2024-05-25T01:43:00.909353247Z 2024-05-25T01:43:00.909365943Z 2024-05-25T01:43:00.909378211Z 2024-05-25T01:43:00.909403736Z 2024-05-25T01:43:00.914624169Z [2024-05-25T01:43:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:43:00.914761682Z [2024-05-25T01:43:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:43:00.914925760Z [2024-05-25T01:43:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:43:00.915013665Z [2024-05-25T01:43:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:43:00.915273398Z [2024-05-25T01:43:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:43:00.915363768Z [2024-05-25T01:43:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:43:00.915636520Z [2024-05-25T01:43:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:43:00.915701015Z [2024-05-25T01:43:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:43:00.916005262Z [2024-05-25T01:43:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:43:00.916028343Z [2024-05-25T01:43:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:43:01.657604790Z [2024-05-25T01:43:01.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status queued for try_number 1 2024-05-25T01:43:01.657677530Z [2024-05-25T01:43:01.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status queued for try_number 1 2024-05-25T01:43:01.657735738Z [2024-05-25T01:43:01.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status queued for try_number 1 2024-05-25T01:43:01.657809923Z [2024-05-25T01:43:01.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status queued for try_number 1 2024-05-25T01:43:01.657861207Z [2024-05-25T01:43:01.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status queued for try_number 1 2024-05-25T01:43:01.669996920Z [2024-05-25T01:43:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to a246621b-6002-49f0-855d-3ed8f5ff3505 2024-05-25T01:43:01.670106013Z [2024-05-25T01:43:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f8777e5-9add-4772-a135-b7da807a5ba8 2024-05-25T01:43:01.670204988Z [2024-05-25T01:43:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e10f7f9-df59-49e1-863b-f9a80a44bf4f 2024-05-25T01:43:01.670301537Z [2024-05-25T01:43:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 025041ce-1af3-497b-b77b-8af7c6eec6d1 2024-05-25T01:43:01.670391883Z [2024-05-25T01:43:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1e3ab68-2913-48dc-869f-1d27bb024e9d 2024-05-25T01:43:02.995843295Z [2024-05-25T01:43:02.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:43:02.996090420Z [2024-05-25T01:43:02.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:42:00+00:00, run_id=scheduled__2024-05-25T01:42:00+00:00, run_start_date=2024-05-25 01:43:00.800925+00:00, run_end_date=2024-05-25 01:43:02.995797+00:00, run_duration=2.194872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:42:00+00:00, data_interval_end=2024-05-25 01:43:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:43:03.008263068Z [2024-05-25T01:43:03.008+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:43:00+00:00, run_after=2024-05-25T01:44:00+00:00 2024-05-25T01:43:03.099107755Z [2024-05-25T01:43:03.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status success for try_number 1 2024-05-25T01:43:03.106622393Z [2024-05-25T01:43:03.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:42:00+00:00, map_index=-1, run_start_date=2024-05-25 01:43:01.951198+00:00, run_end_date=2024-05-25 01:43:02.534483+00:00, run_duration=0.583285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=730, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:43:00.910533+00:00, queued_by_job_id=1, pid=10708 2024-05-25T01:43:04.021445219Z [2024-05-25T01:43:04.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status failed for try_number 1 2024-05-25T01:43:04.021823750Z [2024-05-25T01:43:04.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status failed for try_number 1 2024-05-25T01:43:04.032611574Z [2024-05-25T01:43:04.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:42:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:43:00.910533+00:00, queued_by_job_id=1, pid=None 2024-05-25T01:43:04.033047203Z [2024-05-25T01:43:04.032+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:43:04.036223759Z [2024-05-25T01:43:04.035+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:43:04.054518179Z [2024-05-25T01:43:04.054+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240525T014200, start_date=, end_date=20240525T014304 2024-05-25T01:43:04.074101572Z [2024-05-25T01:43:04.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:42:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:43:00.910533+00:00, queued_by_job_id=1, pid=None 2024-05-25T01:43:04.074554390Z [2024-05-25T01:43:04.074+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:43:04.077026507Z [2024-05-25T01:43:04.076+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:43:04.091663390Z [2024-05-25T01:43:04.091+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240525T014200, start_date=, end_date=20240525T014304 2024-05-25T01:43:05.182671601Z [2024-05-25T01:43:05.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:43:05.183132393Z [2024-05-25T01:43:05.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:42:00+00:00, run_id=scheduled__2024-05-25T01:42:00+00:00, run_start_date=2024-05-25 01:43:00.804474+00:00, run_end_date=2024-05-25 01:43:05.182558+00:00, run_duration=4.378084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:42:00+00:00, data_interval_end=2024-05-25 01:43:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:43:05.192635993Z [2024-05-25T01:43:05.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:43:00+00:00, run_after=2024-05-25T01:44:00+00:00 2024-05-25T01:43:05.200860475Z [2024-05-25T01:43:05.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:43:05.201278279Z [2024-05-25T01:43:05.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:42:00+00:00, run_id=scheduled__2024-05-25T01:42:00+00:00, run_start_date=2024-05-25 01:43:00.807016+00:00, run_end_date=2024-05-25 01:43:05.200765+00:00, run_duration=4.393749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:42:00+00:00, data_interval_end=2024-05-25 01:43:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:43:05.214931640Z [2024-05-25T01:43:05.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:43:00+00:00, run_after=2024-05-25T01:44:00+00:00 2024-05-25T01:43:05.298263694Z [2024-05-25T01:43:05.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status success for try_number 1 2024-05-25T01:43:05.299200084Z [2024-05-25T01:43:05.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status success for try_number 1 2024-05-25T01:43:05.308826054Z [2024-05-25T01:43:05.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:42:00+00:00, map_index=-1, run_start_date=2024-05-25 01:43:02.950617+00:00, run_end_date=2024-05-25 01:43:04.303711+00:00, run_duration=1.353094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=731, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:43:00.910533+00:00, queued_by_job_id=1, pid=10725 2024-05-25T01:43:05.309326405Z [2024-05-25T01:43:05.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:42:00+00:00, map_index=-1, run_start_date=2024-05-25 01:43:03.285341+00:00, run_end_date=2024-05-25 01:43:05.050827+00:00, run_duration=1.765486, state=success, executor_state=success, try_number=1, max_tries=1, job_id=732, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:43:00.910533+00:00, queued_by_job_id=1, pid=10754 2024-05-25T01:43:14.120546839Z [2024-05-25T01:43:14.120+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-25T01:43:14.120590173Z 2024-05-25T01:43:14.120595125Z 2024-05-25T01:43:14.121148128Z [2024-05-25T01:43:14.120+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:43:14.121582141Z [2024-05-25T01:43:14.121+0000] {scheduler_job.py:425} INFO - DAG vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:43:14.122923127Z [2024-05-25T01:43:14.122+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:43:14.122984718Z 2024-05-25T01:43:14.122991338Z 2024-05-25T01:43:14.128341686Z [2024-05-25T01:43:14.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:42:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:43:14.129229247Z [2024-05-25T01:43:14.128+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:43:14.129825106Z [2024-05-25T01:43:14.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:42:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:43:14.130218015Z [2024-05-25T01:43:14.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:43:14.340167933Z [2024-05-25T01:43:14.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status queued for try_number 2 2024-05-25T01:43:14.340408901Z [2024-05-25T01:43:14.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status queued for try_number 2 2024-05-25T01:43:14.363897410Z [2024-05-25T01:43:14.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8464b24-a869-4590-8dde-805c824505ba 2024-05-25T01:43:14.364513397Z [2024-05-25T01:43:14.364+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c85f249-9c9a-4933-8855-d6f2058280af 2024-05-25T01:43:16.705975829Z [2024-05-25T01:43:16.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status failed for try_number 2 2024-05-25T01:43:16.706398877Z [2024-05-25T01:43:16.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status failed for try_number 2 2024-05-25T01:43:16.721420482Z [2024-05-25T01:43:16.720+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:42:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-25 01:43:04.039528+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:43:14.124704+00:00, queued_by_job_id=1, pid=None 2024-05-25T01:43:16.722311733Z [2024-05-25T01:43:16.721+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:43:16.726038060Z [2024-05-25T01:43:16.725+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:43:16.746489801Z [2024-05-25T01:43:16.745+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240525T014200, start_date=, end_date=20240525T014316 2024-05-25T01:43:16.757891870Z [2024-05-25T01:43:16.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:42:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-25 01:43:04.079784+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:43:14.124704+00:00, queued_by_job_id=1, pid=None 2024-05-25T01:43:16.758366511Z [2024-05-25T01:43:16.758+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:43:16.761438340Z [2024-05-25T01:43:16.761+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:43:16.775931995Z [2024-05-25T01:43:16.775+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240525T014200, start_date=, end_date=20240525T014316 2024-05-25T01:43:17.861454700Z [2024-05-25T01:43:17.860+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T01:43:17.861724089Z [2024-05-25T01:43:17.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a, execution_date=2024-05-25 01:42:00+00:00, run_id=scheduled__2024-05-25T01:42:00+00:00, run_start_date=2024-05-25 01:43:00.803144+00:00, run_end_date=2024-05-25 01:43:17.861159+00:00, run_duration=17.058015, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:42:00+00:00, data_interval_end=2024-05-25 01:43:00+00:00, dag_hash=2299bfb446ac7a0b9903f22f36a2448f 2024-05-25T01:43:17.871816469Z [2024-05-25T01:43:17.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a to 2024-05-25T01:43:00+00:00, run_after=2024-05-25T01:44:00+00:00 2024-05-25T01:43:17.885475007Z [2024-05-25T01:43:17.880+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T01:43:17.885541931Z [2024-05-25T01:43:17.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, execution_date=2024-05-25 01:42:00+00:00, run_id=scheduled__2024-05-25T01:42:00+00:00, run_start_date=2024-05-25 01:43:00.805771+00:00, run_end_date=2024-05-25 01:43:17.880492+00:00, run_duration=17.074721, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:42:00+00:00, data_interval_end=2024-05-25 01:43:00+00:00, dag_hash=276b44e9b5d5181aa411d11a4f41b623 2024-05-25T01:43:17.890240924Z [2024-05-25T01:43:17.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a to 2024-05-25T01:43:00+00:00, run_after=2024-05-25T01:44:00+00:00 2024-05-25T01:44:00.070091140Z [2024-05-25T01:44:00.069+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:44:00+00:00, run_after=2024-05-25T01:45:00+00:00 2024-05-25T01:44:00.081674549Z [2024-05-25T01:44:00.081+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:44:00.089961591Z [2024-05-25T01:44:00.089+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:44:00.102795292Z [2024-05-25T01:44:00.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:44:00+00:00, run_after=2024-05-25T01:45:00+00:00 2024-05-25T01:44:00.110716611Z [2024-05-25T01:44:00.110+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:44:00.137725296Z [2024-05-25T01:44:00.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a to 2024-05-25T01:44:00+00:00, run_after=2024-05-25T01:45:00+00:00 2024-05-25T01:44:00.239250254Z [2024-05-25T01:44:00.238+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-05-25T01:44:00.239285610Z 2024-05-25T01:44:00.239292748Z 2024-05-25T01:44:00.239298467Z 2024-05-25T01:44:00.239304126Z 2024-05-25T01:44:00.239309560Z 2024-05-25T01:44:00.239314814Z 2024-05-25T01:44:00.239838964Z [2024-05-25T01:44:00.239+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:44:00.240175646Z [2024-05-25T01:44:00.239+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:44:00.240565999Z [2024-05-25T01:44:00.240+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:44:00.240974226Z [2024-05-25T01:44:00.240+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:44:00.241369925Z [2024-05-25T01:44:00.241+0000] {scheduler_job.py:425} INFO - DAG vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:44:00.241779848Z [2024-05-25T01:44:00.241+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:44:00.242786983Z [2024-05-25T01:44:00.242+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:44:00.242797561Z 2024-05-25T01:44:00.242802131Z 2024-05-25T01:44:00.242805840Z 2024-05-25T01:44:00.242809796Z 2024-05-25T01:44:00.242813500Z 2024-05-25T01:44:00.242817278Z 2024-05-25T01:44:00.249860883Z [2024-05-25T01:44:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:44:00.250213636Z [2024-05-25T01:44:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:44:00.250968609Z [2024-05-25T01:44:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:44:00.251404189Z [2024-05-25T01:44:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:44:00.251827118Z [2024-05-25T01:44:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:44:00.252127691Z [2024-05-25T01:44:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:44:00.252492003Z [2024-05-25T01:44:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:44:00.252717084Z [2024-05-25T01:44:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:44:00.253232047Z [2024-05-25T01:44:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:44:00.253502019Z [2024-05-25T01:44:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:44:00.253842923Z [2024-05-25T01:44:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:44:00.254045450Z [2024-05-25T01:44:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:44:00.914128200Z [2024-05-25T01:44:00.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status queued for try_number 1 2024-05-25T01:44:00.914159153Z [2024-05-25T01:44:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status queued for try_number 1 2024-05-25T01:44:00.914280392Z [2024-05-25T01:44:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status queued for try_number 1 2024-05-25T01:44:00.914357202Z [2024-05-25T01:44:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status queued for try_number 1 2024-05-25T01:44:00.915491011Z [2024-05-25T01:44:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status queued for try_number 1 2024-05-25T01:44:00.915685726Z [2024-05-25T01:44:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status queued for try_number 1 2024-05-25T01:44:00.929000593Z [2024-05-25T01:44:00.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0873261-d42c-4642-9506-ac6cbc7275a3 2024-05-25T01:44:00.929258903Z [2024-05-25T01:44:00.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83ae85ca-11f8-4d6f-be4b-f47e2333eec5 2024-05-25T01:44:00.929460001Z [2024-05-25T01:44:00.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9186e5a-4130-49b0-b57c-e7e99ce4baa4 2024-05-25T01:44:00.929688750Z [2024-05-25T01:44:00.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to 104fb7e5-3323-4fa7-adf8-b497bbd784c5 2024-05-25T01:44:00.929909498Z [2024-05-25T01:44:00.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab636e15-039c-45bc-ae6a-baddfef6bf40 2024-05-25T01:44:00.933496302Z [2024-05-25T01:44:00.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2868a41c-2283-4174-8529-7e7b41e1f70a 2024-05-25T01:44:03.643909847Z [2024-05-25T01:44:03.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:44:03.644233939Z [2024-05-25T01:44:03.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:42:00+00:00, run_id=scheduled__2024-05-25T01:42:00+00:00, run_start_date=2024-05-25 01:44:00.147907+00:00, run_end_date=2024-05-25 01:44:03.643762+00:00, run_duration=3.495855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:42:00+00:00, data_interval_end=2024-05-25 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:44:03.652174782Z [2024-05-25T01:44:03.651+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:44:00+00:00, run_after=2024-05-25T01:46:00+00:00 2024-05-25T01:44:03.658594325Z [2024-05-25T01:44:03.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:44:03.658979330Z [2024-05-25T01:44:03.658+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:43:00+00:00, run_id=scheduled__2024-05-25T01:43:00+00:00, run_start_date=2024-05-25 01:44:00.149145+00:00, run_end_date=2024-05-25 01:44:03.658477+00:00, run_duration=3.509332, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:43:00+00:00, data_interval_end=2024-05-25 01:44:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:44:03.670740891Z [2024-05-25T01:44:03.670+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:44:00+00:00, run_after=2024-05-25T01:45:00+00:00 2024-05-25T01:44:03.757285309Z [2024-05-25T01:44:03.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:42:00+00:00 exited with status success for try_number 1 2024-05-25T01:44:03.757465446Z [2024-05-25T01:44:03.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status failed for try_number 1 2024-05-25T01:44:03.757700988Z [2024-05-25T01:44:03.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status failed for try_number 1 2024-05-25T01:44:03.757962452Z [2024-05-25T01:44:03.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status success for try_number 1 2024-05-25T01:44:03.770904824Z [2024-05-25T01:44:03.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:43:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:44:00.244526+00:00, queued_by_job_id=1, pid=None 2024-05-25T01:44:03.771496551Z [2024-05-25T01:44:03.771+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:44:03.774083713Z [2024-05-25T01:44:03.773+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:44:03.787675282Z [2024-05-25T01:44:03.787+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240525T014300, start_date=, end_date=20240525T014403 2024-05-25T01:44:03.797872078Z [2024-05-25T01:44:03.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:43:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:44:00.244526+00:00, queued_by_job_id=1, pid=None 2024-05-25T01:44:03.798517603Z [2024-05-25T01:44:03.797+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:44:03.800525104Z [2024-05-25T01:44:03.800+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:44:03.816597418Z [2024-05-25T01:44:03.816+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240525T014300, start_date=, end_date=20240525T014403 2024-05-25T01:44:03.826092057Z [2024-05-25T01:44:03.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:42:00+00:00, map_index=-1, run_start_date=2024-05-25 01:44:01.743229+00:00, run_end_date=2024-05-25 01:44:02.743471+00:00, run_duration=1.000242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=733, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:44:00.244526+00:00, queued_by_job_id=1, pid=10806 2024-05-25T01:44:03.826444936Z [2024-05-25T01:44:03.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:43:00+00:00, map_index=-1, run_start_date=2024-05-25 01:44:02.806239+00:00, run_end_date=2024-05-25 01:44:03.228423+00:00, run_duration=0.422184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=734, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:44:00.244526+00:00, queued_by_job_id=1, pid=10830 2024-05-25T01:44:05.482200047Z [2024-05-25T01:44:05.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:44:05.482504885Z [2024-05-25T01:44:05.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:43:00+00:00, run_id=scheduled__2024-05-25T01:43:00+00:00, run_start_date=2024-05-25 01:44:00.151025+00:00, run_end_date=2024-05-25 01:44:05.481966+00:00, run_duration=5.330941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:43:00+00:00, data_interval_end=2024-05-25 01:44:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:44:05.498547028Z [2024-05-25T01:44:05.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:44:00+00:00, run_after=2024-05-25T01:45:00+00:00 2024-05-25T01:44:05.508066897Z [2024-05-25T01:44:05.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:44:05.508234112Z [2024-05-25T01:44:05.508+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:43:00+00:00, run_id=scheduled__2024-05-25T01:43:00+00:00, run_start_date=2024-05-25 01:44:00.152812+00:00, run_end_date=2024-05-25 01:44:05.507864+00:00, run_duration=5.355052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:43:00+00:00, data_interval_end=2024-05-25 01:44:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:44:05.517657488Z [2024-05-25T01:44:05.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:44:00+00:00, run_after=2024-05-25T01:45:00+00:00 2024-05-25T01:44:05.597278417Z [2024-05-25T01:44:05.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status success for try_number 1 2024-05-25T01:44:05.597381178Z [2024-05-25T01:44:05.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status success for try_number 1 2024-05-25T01:44:05.610514510Z [2024-05-25T01:44:05.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:43:00+00:00, map_index=-1, run_start_date=2024-05-25 01:44:03.572403+00:00, run_end_date=2024-05-25 01:44:05.024606+00:00, run_duration=1.452203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=736, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:44:00.244526+00:00, queued_by_job_id=1, pid=10862 2024-05-25T01:44:05.610947652Z [2024-05-25T01:44:05.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:43:00+00:00, map_index=-1, run_start_date=2024-05-25 01:44:03.213943+00:00, run_end_date=2024-05-25 01:44:05.080557+00:00, run_duration=1.866614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=735, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:44:00.244526+00:00, queued_by_job_id=1, pid=10851 2024-05-25T01:44:14.378941622Z [2024-05-25T01:44:14.378+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-25T01:44:14.378991001Z 2024-05-25T01:44:14.379001436Z 2024-05-25T01:44:14.379218745Z [2024-05-25T01:44:14.378+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:44:14.379524525Z [2024-05-25T01:44:14.379+0000] {scheduler_job.py:425} INFO - DAG vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a has 0/16 running and queued tasks 2024-05-25T01:44:14.380551590Z [2024-05-25T01:44:14.380+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:44:14.380566900Z 2024-05-25T01:44:14.380571900Z 2024-05-25T01:44:14.385064637Z [2024-05-25T01:44:14.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:43:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:44:14.385426690Z [2024-05-25T01:44:14.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:44:14.385873986Z [2024-05-25T01:44:14.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:43:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:44:14.386194204Z [2024-05-25T01:44:14.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:44:14.591401222Z [2024-05-25T01:44:14.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status queued for try_number 2 2024-05-25T01:44:14.591771317Z [2024-05-25T01:44:14.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status queued for try_number 2 2024-05-25T01:44:14.599319145Z [2024-05-25T01:44:14.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to cae6aef4-9bfa-4c0e-ace5-d7800d2c365c 2024-05-25T01:44:14.600080821Z [2024-05-25T01:44:14.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bd5b587-9473-44d7-8aea-092a2b3b1aa2 2024-05-25T01:44:16.196386229Z [2024-05-25T01:44:16.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status failed for try_number 2 2024-05-25T01:44:16.196411341Z [2024-05-25T01:44:16.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:43:00+00:00 exited with status failed for try_number 2 2024-05-25T01:44:16.204003216Z [2024-05-25T01:44:16.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:43:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-25 01:44:03.776884+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:44:14.381520+00:00, queued_by_job_id=1, pid=None 2024-05-25T01:44:16.204476021Z [2024-05-25T01:44:16.204+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:44:16.207164219Z [2024-05-25T01:44:16.206+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:44:16.232323895Z [2024-05-25T01:44:16.231+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240525T014300, start_date=, end_date=20240525T014416 2024-05-25T01:44:16.244778714Z [2024-05-25T01:44:16.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:43:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-25 01:44:03.803271+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:44:14.381520+00:00, queued_by_job_id=1, pid=None 2024-05-25T01:44:16.245739687Z [2024-05-25T01:44:16.244+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:44:16.248840862Z [2024-05-25T01:44:16.248+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T01:44:16.264108747Z [2024-05-25T01:44:16.263+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240525T014300, start_date=, end_date=20240525T014416 2024-05-25T01:44:17.335215057Z [2024-05-25T01:44:17.334+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T01:44:17.335730707Z [2024-05-25T01:44:17.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a, execution_date=2024-05-25 01:43:00+00:00, run_id=scheduled__2024-05-25T01:43:00+00:00, run_start_date=2024-05-25 01:44:00.150142+00:00, run_end_date=2024-05-25 01:44:17.335027+00:00, run_duration=17.184885, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:43:00+00:00, data_interval_end=2024-05-25 01:44:00+00:00, dag_hash=2299bfb446ac7a0b9903f22f36a2448f 2024-05-25T01:44:17.346668524Z [2024-05-25T01:44:17.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a to 2024-05-25T01:44:00+00:00, run_after=2024-05-25T01:45:00+00:00 2024-05-25T01:44:17.355863279Z [2024-05-25T01:44:17.355+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T01:44:17.356170426Z [2024-05-25T01:44:17.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a, execution_date=2024-05-25 01:43:00+00:00, run_id=scheduled__2024-05-25T01:43:00+00:00, run_start_date=2024-05-25 01:44:00.151920+00:00, run_end_date=2024-05-25 01:44:17.355671+00:00, run_duration=17.203751, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:43:00+00:00, data_interval_end=2024-05-25 01:44:00+00:00, dag_hash=276b44e9b5d5181aa411d11a4f41b623 2024-05-25T01:44:17.365660024Z [2024-05-25T01:44:17.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a to 2024-05-25T01:44:00+00:00, run_after=2024-05-25T01:45:00+00:00 2024-05-25T01:44:38.706989727Z [2024-05-25T01:44:38.706+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:44:38.707042633Z 2024-05-25T01:44:38.707345199Z [2024-05-25T01:44:38.706+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-05-25T01:44:38.708444720Z [2024-05-25T01:44:38.708+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:44:38.708458306Z 2024-05-25T01:44:38.712355177Z [2024-05-25T01:44:38.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240525014437_760006', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:44:38.713285966Z [2024-05-25T01:44:38.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240525014437_760006', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-25T01:44:38.785695266Z [2024-05-25T01:44:38.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240525014437_760006 exited with status queued for try_number 1 2024-05-25T01:44:38.792230164Z [2024-05-25T01:44:38.791+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b547731-4b72-4931-83eb-fd33d7c9a13d 2024-05-25T01:44:39.956490192Z [2024-05-25T01:44:39.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:44:39.956524784Z [2024-05-25T01:44:39.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-05-25 01:44:38.016796+00:00, run_id=vdu_down_20240525014437_760006, run_start_date=2024-05-25 01:44:38.654929+00:00, run_end_date=2024-05-25 01:44:39.955137+00:00, run_duration=1.300208, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-25 01:44:38.016796+00:00, data_interval_end=2024-05-25 01:44:38.016796+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-05-25T01:44:39.959170293Z [2024-05-25T01:44:39.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-05-25T01:44:39.987451456Z [2024-05-25T01:44:39.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240525014437_760006 exited with status success for try_number 1 2024-05-25T01:44:39.992245439Z [2024-05-25T01:44:39.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240525014437_760006, map_index=-1, run_start_date=2024-05-25 01:44:39.463854+00:00, run_end_date=2024-05-25 01:44:39.816617+00:00, run_duration=0.352763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=737, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:44:38.709089+00:00, queued_by_job_id=1, pid=10906 2024-05-25T01:45:00.103575304Z [2024-05-25T01:45:00.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:45:00+00:00, run_after=2024-05-25T01:50:00+00:00 2024-05-25T01:45:00.116385136Z [2024-05-25T01:45:00.115+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:45:00+00:00, run_after=2024-05-25T01:46:00+00:00 2024-05-25T01:45:00.122619678Z [2024-05-25T01:45:00.122+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:45:00.133551098Z [2024-05-25T01:45:00.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:45:00+00:00, run_after=2024-05-25T01:46:00+00:00 2024-05-25T01:45:00.248721371Z [2024-05-25T01:45:00.248+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:45:00.248755004Z 2024-05-25T01:45:00.248765353Z 2024-05-25T01:45:00.248771592Z 2024-05-25T01:45:00.248777562Z 2024-05-25T01:45:00.249051973Z [2024-05-25T01:45:00.248+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:45:00.249301286Z [2024-05-25T01:45:00.249+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:45:00.249653671Z [2024-05-25T01:45:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:45:00.250235883Z [2024-05-25T01:45:00.249+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:45:00.251047427Z [2024-05-25T01:45:00.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:45:00.251101338Z 2024-05-25T01:45:00.251109392Z 2024-05-25T01:45:00.251115285Z 2024-05-25T01:45:00.251121206Z 2024-05-25T01:45:00.256841726Z [2024-05-25T01:45:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:45:00.257091213Z [2024-05-25T01:45:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:45:00.257516070Z [2024-05-25T01:45:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:45:00.257603981Z [2024-05-25T01:45:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:45:00.257868116Z [2024-05-25T01:45:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:45:00.258097822Z [2024-05-25T01:45:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:45:00.258432594Z [2024-05-25T01:45:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:45:00.258608113Z [2024-05-25T01:45:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:45:00.573973740Z [2024-05-25T01:45:00.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status queued for try_number 1 2024-05-25T01:45:00.574997460Z [2024-05-25T01:45:00.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:44:00+00:00 exited with status queued for try_number 1 2024-05-25T01:45:00.575440508Z [2024-05-25T01:45:00.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:44:00+00:00 exited with status queued for try_number 1 2024-05-25T01:45:00.576299893Z [2024-05-25T01:45:00.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:44:00+00:00 exited with status queued for try_number 1 2024-05-25T01:45:00.598656717Z [2024-05-25T01:45:00.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to d32cfd42-7c64-4208-8481-6df47f783f7c 2024-05-25T01:45:00.598932567Z [2024-05-25T01:45:00.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to dea3d27a-fcb7-4ab1-aef8-bdcc7541793d 2024-05-25T01:45:00.599262675Z [2024-05-25T01:45:00.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1673afea-b2b4-484e-bdaf-4de1b8000593 2024-05-25T01:45:00.599562602Z [2024-05-25T01:45:00.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to d42c8857-28c3-4d72-a5c4-9dea88a4d931 2024-05-25T01:45:02.018702138Z [2024-05-25T01:45:02.018+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:45:02.018891153Z [2024-05-25T01:45:02.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:44:00+00:00, run_id=scheduled__2024-05-25T01:44:00+00:00, run_start_date=2024-05-25 01:45:00.146693+00:00, run_end_date=2024-05-25 01:45:02.018609+00:00, run_duration=1.871916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:44:00+00:00, data_interval_end=2024-05-25 01:45:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:45:02.030558383Z [2024-05-25T01:45:02.029+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:45:00+00:00, run_after=2024-05-25T01:46:00+00:00 2024-05-25T01:45:02.099759321Z [2024-05-25T01:45:02.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:44:00+00:00 exited with status success for try_number 1 2024-05-25T01:45:02.105903614Z [2024-05-25T01:45:02.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:44:00+00:00, map_index=-1, run_start_date=2024-05-25 01:45:01.404445+00:00, run_end_date=2024-05-25 01:45:01.891900+00:00, run_duration=0.487455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=738, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:45:00.252174+00:00, queued_by_job_id=1, pid=10921 2024-05-25T01:45:04.263640336Z [2024-05-25T01:45:04.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:45:04.263706702Z [2024-05-25T01:45:04.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:44:00+00:00, run_id=scheduled__2024-05-25T01:44:00+00:00, run_start_date=2024-05-25 01:45:00.149686+00:00, run_end_date=2024-05-25 01:45:04.263394+00:00, run_duration=4.113708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:44:00+00:00, data_interval_end=2024-05-25 01:45:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:45:04.273396139Z [2024-05-25T01:45:04.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:45:00+00:00, run_after=2024-05-25T01:46:00+00:00 2024-05-25T01:45:04.301191009Z [2024-05-25T01:45:04.300+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:45:04.301327130Z 2024-05-25T01:45:04.301340617Z [2024-05-25T01:45:04.301+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:45:04.301842777Z [2024-05-25T01:45:04.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:45:04.301861416Z 2024-05-25T01:45:04.304050085Z [2024-05-25T01:45:04.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:45:04.304123651Z [2024-05-25T01:45:04.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:45:04.354869963Z [2024-05-25T01:45:04.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status queued for try_number 1 2024-05-25T01:45:04.354897682Z [2024-05-25T01:45:04.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status success for try_number 1 2024-05-25T01:45:04.354947073Z [2024-05-25T01:45:04.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:44:00+00:00 exited with status success for try_number 1 2024-05-25T01:45:04.360922437Z [2024-05-25T01:45:04.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f0dfee6-1dac-452f-be77-62f04c66815f 2024-05-25T01:45:04.361147564Z [2024-05-25T01:45:04.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:44:00+00:00, map_index=-1, run_start_date=2024-05-25 01:45:02.635891+00:00, run_end_date=2024-05-25 01:45:03.849542+00:00, run_duration=1.213651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=739, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:45:00.252174+00:00, queued_by_job_id=1, pid=10945 2024-05-25T01:45:04.361571626Z [2024-05-25T01:45:04.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:40:00+00:00, map_index=-1, run_start_date=2024-05-25 01:45:02.720766+00:00, run_end_date=2024-05-25 01:45:03.104306+00:00, run_duration=0.38354, state=success, executor_state=success, try_number=1, max_tries=1, job_id=740, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:45:00.252174+00:00, queued_by_job_id=1, pid=10946 2024-05-25T01:45:04.702140820Z [2024-05-25T01:45:04.701+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:45:04.702603571Z [2024-05-25T01:45:04.702+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:44:00+00:00, run_id=scheduled__2024-05-25T01:44:00+00:00, run_start_date=2024-05-25 01:45:00.151780+00:00, run_end_date=2024-05-25 01:45:04.702011+00:00, run_duration=4.550231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:44:00+00:00, data_interval_end=2024-05-25 01:45:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:45:04.712287530Z [2024-05-25T01:45:04.711+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:45:00+00:00, run_after=2024-05-25T01:46:00+00:00 2024-05-25T01:45:04.756604150Z [2024-05-25T01:45:04.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:44:00+00:00 exited with status success for try_number 1 2024-05-25T01:45:04.763482262Z [2024-05-25T01:45:04.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:44:00+00:00, map_index=-1, run_start_date=2024-05-25 01:45:02.815500+00:00, run_end_date=2024-05-25 01:45:04.477309+00:00, run_duration=1.661809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=741, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:45:00.252174+00:00, queued_by_job_id=1, pid=10947 2024-05-25T01:45:06.921741379Z [2024-05-25T01:45:06.921+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:45:06.921768830Z 2024-05-25T01:45:06.922040572Z [2024-05-25T01:45:06.921+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:45:06.922639651Z [2024-05-25T01:45:06.922+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:45:06.922651123Z 2024-05-25T01:45:06.924627166Z [2024-05-25T01:45:06.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:45:06.924827834Z [2024-05-25T01:45:06.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:45:07.020863813Z [2024-05-25T01:45:07.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status queued for try_number 1 2024-05-25T01:45:07.020886264Z [2024-05-25T01:45:07.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status success for try_number 1 2024-05-25T01:45:07.027479359Z [2024-05-25T01:45:07.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7672d910-be82-43ba-9319-206e2c579720 2024-05-25T01:45:07.027503797Z [2024-05-25T01:45:07.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T01:40:00+00:00, map_index=-1, run_start_date=2024-05-25 01:45:05.881274+00:00, run_end_date=2024-05-25 01:45:06.238387+00:00, run_duration=0.357113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=742, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:45:04.302083+00:00, queued_by_job_id=1, pid=10970 2024-05-25T01:45:09.311056791Z [2024-05-25T01:45:09.310+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:45:09.311106222Z 2024-05-25T01:45:09.311532758Z [2024-05-25T01:45:09.311+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:45:09.313130040Z [2024-05-25T01:45:09.312+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:45:09.313304662Z 2024-05-25T01:45:09.318365254Z [2024-05-25T01:45:09.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:45:09.318736394Z [2024-05-25T01:45:09.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:45:09.382749495Z [2024-05-25T01:45:09.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status queued for try_number 1 2024-05-25T01:45:09.382982138Z [2024-05-25T01:45:09.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status success for try_number 1 2024-05-25T01:45:09.390482723Z [2024-05-25T01:45:09.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f7281a2-3e38-45c5-a776-6e8e0575747c 2024-05-25T01:45:09.390775337Z [2024-05-25T01:45:09.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:40:00+00:00, map_index=0, run_start_date=2024-05-25 01:45:08.433105+00:00, run_end_date=2024-05-25 01:45:08.841348+00:00, run_duration=0.408243, state=success, executor_state=success, try_number=1, max_tries=1, job_id=743, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:45:06.923026+00:00, queued_by_job_id=1, pid=10992 2024-05-25T01:45:11.613724930Z [2024-05-25T01:45:11.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:45:11.613825381Z [2024-05-25T01:45:11.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:40:00+00:00, run_id=scheduled__2024-05-25T01:40:00+00:00, run_start_date=2024-05-25 01:45:00.144157+00:00, run_end_date=2024-05-25 01:45:11.613451+00:00, run_duration=11.469294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:40:00+00:00, data_interval_end=2024-05-25 01:45:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T01:45:11.624245271Z [2024-05-25T01:45:11.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:45:00+00:00, run_after=2024-05-25T01:50:00+00:00 2024-05-25T01:45:11.662945642Z [2024-05-25T01:45:11.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:40:00+00:00 exited with status success for try_number 1 2024-05-25T01:45:11.671533151Z [2024-05-25T01:45:11.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:40:00+00:00, map_index=-1, run_start_date=2024-05-25 01:45:10.864275+00:00, run_end_date=2024-05-25 01:45:11.225391+00:00, run_duration=0.361116, state=success, executor_state=success, try_number=1, max_tries=1, job_id=744, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:45:09.313962+00:00, queued_by_job_id=1, pid=11000 2024-05-25T01:45:29.505889494Z [2024-05-25T01:45:29.505+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T01:46:01.061082096Z [2024-05-25T01:46:01.060+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:46:01.071886722Z [2024-05-25T01:46:01.071+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:46:01.089923048Z [2024-05-25T01:46:01.089+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:46:00+00:00, run_after=2024-05-25T01:47:00+00:00 2024-05-25T01:46:01.105196480Z [2024-05-25T01:46:01.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:46:00+00:00, run_after=2024-05-25T01:47:00+00:00 2024-05-25T01:46:01.200037176Z [2024-05-25T01:46:01.199+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:46:01.200074816Z 2024-05-25T01:46:01.200082098Z 2024-05-25T01:46:01.200086643Z 2024-05-25T01:46:01.200091050Z 2024-05-25T01:46:01.200456107Z [2024-05-25T01:46:01.199+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:46:01.200807500Z [2024-05-25T01:46:01.200+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:46:01.201072863Z [2024-05-25T01:46:01.200+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:46:01.201303921Z [2024-05-25T01:46:01.201+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:46:01.202167006Z [2024-05-25T01:46:01.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:46:01.202182809Z 2024-05-25T01:46:01.202188064Z 2024-05-25T01:46:01.202192967Z 2024-05-25T01:46:01.202197528Z 2024-05-25T01:46:01.207209863Z [2024-05-25T01:46:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:46:01.207380660Z [2024-05-25T01:46:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:46:01.207803411Z [2024-05-25T01:46:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:46:01.208023641Z [2024-05-25T01:46:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:46:01.208352529Z [2024-05-25T01:46:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:46:01.208569251Z [2024-05-25T01:46:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:46:01.209121665Z [2024-05-25T01:46:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:46:01.209354102Z [2024-05-25T01:46:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:46:01.790312070Z [2024-05-25T01:46:01.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:44:00+00:00 exited with status queued for try_number 1 2024-05-25T01:46:01.790463840Z [2024-05-25T01:46:01.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status queued for try_number 1 2024-05-25T01:46:01.790606370Z [2024-05-25T01:46:01.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status queued for try_number 1 2024-05-25T01:46:01.790739352Z [2024-05-25T01:46:01.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status queued for try_number 1 2024-05-25T01:46:01.814858248Z [2024-05-25T01:46:01.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4034cf78-972c-4016-9e84-d162b0654e5f 2024-05-25T01:46:01.815071822Z [2024-05-25T01:46:01.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17c3bd83-82df-4d20-8309-f0f3bf9e3187 2024-05-25T01:46:01.815230171Z [2024-05-25T01:46:01.815+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6d62771-0cec-4dfe-8cec-b40db0a5a384 2024-05-25T01:46:01.815391254Z [2024-05-25T01:46:01.815+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdfc9622-de31-446c-b27a-b334b7d622b0 2024-05-25T01:46:02.956435613Z [2024-05-25T01:46:02.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:46:02.957552295Z [2024-05-25T01:46:02.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:44:00+00:00, run_id=scheduled__2024-05-25T01:44:00+00:00, run_start_date=2024-05-25 01:46:01.119624+00:00, run_end_date=2024-05-25 01:46:02.957115+00:00, run_duration=1.837491, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:44:00+00:00, data_interval_end=2024-05-25 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:46:02.971327149Z [2024-05-25T01:46:02.971+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:46:00+00:00, run_after=2024-05-25T01:48:00+00:00 2024-05-25T01:46:04.126823116Z [2024-05-25T01:46:04.126+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:46:04.127172267Z [2024-05-25T01:46:04.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:45:00+00:00, run_id=scheduled__2024-05-25T01:45:00+00:00, run_start_date=2024-05-25 01:46:01.120870+00:00, run_end_date=2024-05-25 01:46:04.126820+00:00, run_duration=3.00595, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:45:00+00:00, data_interval_end=2024-05-25 01:46:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:46:04.136410083Z [2024-05-25T01:46:04.136+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:46:00+00:00, run_after=2024-05-25T01:47:00+00:00 2024-05-25T01:46:04.217368594Z [2024-05-25T01:46:04.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:44:00+00:00 exited with status success for try_number 1 2024-05-25T01:46:04.217418366Z [2024-05-25T01:46:04.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status success for try_number 1 2024-05-25T01:46:04.228874847Z [2024-05-25T01:46:04.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:44:00+00:00, map_index=-1, run_start_date=2024-05-25 01:46:02.128100+00:00, run_end_date=2024-05-25 01:46:02.916816+00:00, run_duration=0.788716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=745, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:46:01.203360+00:00, queued_by_job_id=1, pid=11005 2024-05-25T01:46:04.229097853Z [2024-05-25T01:46:04.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:45:00+00:00, map_index=-1, run_start_date=2024-05-25 01:46:02.740253+00:00, run_end_date=2024-05-25 01:46:03.184390+00:00, run_duration=0.444137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=746, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:46:01.203360+00:00, queued_by_job_id=1, pid=11012 2024-05-25T01:46:04.996188529Z [2024-05-25T01:46:04.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:46:04.996629949Z [2024-05-25T01:46:04.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:45:00+00:00, run_id=scheduled__2024-05-25T01:45:00+00:00, run_start_date=2024-05-25 01:46:01.121939+00:00, run_end_date=2024-05-25 01:46:04.996092+00:00, run_duration=3.874153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:45:00+00:00, data_interval_end=2024-05-25 01:46:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:46:05.006428185Z [2024-05-25T01:46:05.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:46:00+00:00, run_after=2024-05-25T01:47:00+00:00 2024-05-25T01:46:06.114810219Z [2024-05-25T01:46:06.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:46:06.115146745Z [2024-05-25T01:46:06.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:45:00+00:00, run_id=scheduled__2024-05-25T01:45:00+00:00, run_start_date=2024-05-25 01:46:01.122874+00:00, run_end_date=2024-05-25 01:46:06.114683+00:00, run_duration=4.991809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:45:00+00:00, data_interval_end=2024-05-25 01:46:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:46:06.124462418Z [2024-05-25T01:46:06.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:46:00+00:00, run_after=2024-05-25T01:47:00+00:00 2024-05-25T01:46:06.163818121Z [2024-05-25T01:46:06.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status success for try_number 1 2024-05-25T01:46:06.164012101Z [2024-05-25T01:46:06.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status success for try_number 1 2024-05-25T01:46:06.172656682Z [2024-05-25T01:46:06.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:45:00+00:00, map_index=-1, run_start_date=2024-05-25 01:46:03.459512+00:00, run_end_date=2024-05-25 01:46:04.952555+00:00, run_duration=1.493043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=747, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:46:01.203360+00:00, queued_by_job_id=1, pid=11029 2024-05-25T01:46:06.173075264Z [2024-05-25T01:46:06.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:45:00+00:00, map_index=-1, run_start_date=2024-05-25 01:46:03.672273+00:00, run_end_date=2024-05-25 01:46:05.287092+00:00, run_duration=1.614819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=748, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:46:01.203360+00:00, queued_by_job_id=1, pid=11035 2024-05-25T01:47:00.915205198Z [2024-05-25T01:47:00.914+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:47:00.941692560Z [2024-05-25T01:47:00.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:47:00+00:00, run_after=2024-05-25T01:48:00+00:00 2024-05-25T01:47:00.957689289Z [2024-05-25T01:47:00.957+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:47:00+00:00, run_after=2024-05-25T01:48:00+00:00 2024-05-25T01:47:01.056843577Z [2024-05-25T01:47:01.056+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:47:01.056886202Z 2024-05-25T01:47:01.056893228Z 2024-05-25T01:47:01.056899450Z 2024-05-25T01:47:01.057054238Z [2024-05-25T01:47:01.056+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:47:01.057492103Z [2024-05-25T01:47:01.057+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:47:01.057859874Z [2024-05-25T01:47:01.057+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:47:01.058899948Z [2024-05-25T01:47:01.058+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:47:01.058919079Z 2024-05-25T01:47:01.058925954Z 2024-05-25T01:47:01.058931687Z 2024-05-25T01:47:01.063950598Z [2024-05-25T01:47:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:47:01.064289313Z [2024-05-25T01:47:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:47:01.064747752Z [2024-05-25T01:47:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:47:01.065022739Z [2024-05-25T01:47:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:47:01.065659660Z [2024-05-25T01:47:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:47:01.065982301Z [2024-05-25T01:47:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:47:01.333161584Z [2024-05-25T01:47:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:46:00+00:00 exited with status queued for try_number 1 2024-05-25T01:47:01.333183638Z [2024-05-25T01:47:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:46:00+00:00 exited with status queued for try_number 1 2024-05-25T01:47:01.333187498Z [2024-05-25T01:47:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:46:00+00:00 exited with status queued for try_number 1 2024-05-25T01:47:01.341305736Z [2024-05-25T01:47:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8c9ee33-59de-48d1-b7d9-25804be71272 2024-05-25T01:47:01.341328443Z [2024-05-25T01:47:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to abc32d2f-5211-46d3-af01-350a54f9083b 2024-05-25T01:47:01.341331904Z [2024-05-25T01:47:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a707651-8f91-4e30-9a97-c2150e101ae5 2024-05-25T01:47:02.527840212Z [2024-05-25T01:47:02.527+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:47:02.528042972Z [2024-05-25T01:47:02.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:46:00+00:00, run_id=scheduled__2024-05-25T01:46:00+00:00, run_start_date=2024-05-25 01:47:00.973317+00:00, run_end_date=2024-05-25 01:47:02.527757+00:00, run_duration=1.55444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:46:00+00:00, data_interval_end=2024-05-25 01:47:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:47:02.543813134Z [2024-05-25T01:47:02.543+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:47:00+00:00, run_after=2024-05-25T01:48:00+00:00 2024-05-25T01:47:02.623318055Z [2024-05-25T01:47:02.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:46:00+00:00 exited with status success for try_number 1 2024-05-25T01:47:02.634826060Z [2024-05-25T01:47:02.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:46:00+00:00, map_index=-1, run_start_date=2024-05-25 01:47:01.788867+00:00, run_end_date=2024-05-25 01:47:02.193047+00:00, run_duration=0.40418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=749, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:47:01.060144+00:00, queued_by_job_id=1, pid=11067 2024-05-25T01:47:05.349877899Z [2024-05-25T01:47:05.349+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:47:05.350501696Z [2024-05-25T01:47:05.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:46:00+00:00, run_id=scheduled__2024-05-25T01:46:00+00:00, run_start_date=2024-05-25 01:47:00.975906+00:00, run_end_date=2024-05-25 01:47:05.349741+00:00, run_duration=4.373835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:46:00+00:00, data_interval_end=2024-05-25 01:47:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:47:05.365267577Z [2024-05-25T01:47:05.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:47:00+00:00, run_after=2024-05-25T01:48:00+00:00 2024-05-25T01:47:05.435762971Z [2024-05-25T01:47:05.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:46:00+00:00 exited with status success for try_number 1 2024-05-25T01:47:05.445697615Z [2024-05-25T01:47:05.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:46:00+00:00, map_index=-1, run_start_date=2024-05-25 01:47:03.083732+00:00, run_end_date=2024-05-25 01:47:04.890946+00:00, run_duration=1.807214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=751, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:47:01.060144+00:00, queued_by_job_id=1, pid=11086 2024-05-25T01:47:06.510270178Z [2024-05-25T01:47:06.509+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:47:06.510445098Z [2024-05-25T01:47:06.510+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:46:00+00:00, run_id=scheduled__2024-05-25T01:46:00+00:00, run_start_date=2024-05-25 01:47:00.979440+00:00, run_end_date=2024-05-25 01:47:06.510149+00:00, run_duration=5.530709, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:46:00+00:00, data_interval_end=2024-05-25 01:47:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:47:06.521517459Z [2024-05-25T01:47:06.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:47:00+00:00, run_after=2024-05-25T01:48:00+00:00 2024-05-25T01:47:06.556065636Z [2024-05-25T01:47:06.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:46:00+00:00 exited with status success for try_number 1 2024-05-25T01:47:06.561080896Z [2024-05-25T01:47:06.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:46:00+00:00, map_index=-1, run_start_date=2024-05-25 01:47:02.999072+00:00, run_end_date=2024-05-25 01:47:05.608566+00:00, run_duration=2.609494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=750, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:47:01.060144+00:00, queued_by_job_id=1, pid=11085 2024-05-25T01:48:00.764673521Z [2024-05-25T01:48:00.764+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:48:00+00:00, run_after=2024-05-25T01:49:00+00:00 2024-05-25T01:48:00.780837597Z [2024-05-25T01:48:00.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:48:00+00:00, run_after=2024-05-25T01:49:00+00:00 2024-05-25T01:48:00.790256662Z [2024-05-25T01:48:00.789+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:48:00.799275612Z [2024-05-25T01:48:00.798+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:48:00.895813257Z [2024-05-25T01:48:00.895+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:48:00.895843199Z 2024-05-25T01:48:00.895848855Z 2024-05-25T01:48:00.895853417Z 2024-05-25T01:48:00.895857676Z 2024-05-25T01:48:00.896653075Z [2024-05-25T01:48:00.896+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:48:00.897121424Z [2024-05-25T01:48:00.896+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:48:00.897668081Z [2024-05-25T01:48:00.897+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:48:00.898067535Z [2024-05-25T01:48:00.897+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:48:00.900107913Z [2024-05-25T01:48:00.899+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:48:00.900145433Z 2024-05-25T01:48:00.900160771Z 2024-05-25T01:48:00.900172272Z 2024-05-25T01:48:00.900184218Z 2024-05-25T01:48:00.907454948Z [2024-05-25T01:48:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:48:00.907914437Z [2024-05-25T01:48:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:48:00.908520002Z [2024-05-25T01:48:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:48:00.908823375Z [2024-05-25T01:48:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:48:00.909362784Z [2024-05-25T01:48:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:48:00.909698532Z [2024-05-25T01:48:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:48:00.910244298Z [2024-05-25T01:48:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:48:00.910698251Z [2024-05-25T01:48:00.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:48:01.404111236Z [2024-05-25T01:48:01.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:46:00+00:00 exited with status queued for try_number 1 2024-05-25T01:48:01.404251840Z [2024-05-25T01:48:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:47:00+00:00 exited with status queued for try_number 1 2024-05-25T01:48:01.404385298Z [2024-05-25T01:48:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:47:00+00:00 exited with status queued for try_number 1 2024-05-25T01:48:01.404519521Z [2024-05-25T01:48:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:47:00+00:00 exited with status queued for try_number 1 2024-05-25T01:48:01.420302306Z [2024-05-25T01:48:01.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c433fa2-d70c-432a-bb68-5dde17ef43a0 2024-05-25T01:48:01.424647461Z [2024-05-25T01:48:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b6ca594-d486-4c51-ac5a-641e369d3de1 2024-05-25T01:48:01.425687857Z [2024-05-25T01:48:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51608f2d-6f36-414b-be7b-e367dfb530e2 2024-05-25T01:48:01.425787394Z [2024-05-25T01:48:01.425+0000] {scheduler_job.py:635} INFO - Setting external_id for to afef72ea-4cfc-4532-82d9-65516ad85d7b 2024-05-25T01:48:02.740692476Z [2024-05-25T01:48:02.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:48:02.741394126Z [2024-05-25T01:48:02.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:46:00+00:00, run_id=scheduled__2024-05-25T01:46:00+00:00, run_start_date=2024-05-25 01:48:00.813348+00:00, run_end_date=2024-05-25 01:48:02.740672+00:00, run_duration=1.927324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:46:00+00:00, data_interval_end=2024-05-25 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:48:02.769027238Z [2024-05-25T01:48:02.768+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:48:00+00:00, run_after=2024-05-25T01:50:00+00:00 2024-05-25T01:48:02.776165684Z [2024-05-25T01:48:02.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:48:02.776409391Z [2024-05-25T01:48:02.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:47:00+00:00, run_id=scheduled__2024-05-25T01:47:00+00:00, run_start_date=2024-05-25 01:48:00.815003+00:00, run_end_date=2024-05-25 01:48:02.776072+00:00, run_duration=1.961069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:47:00+00:00, data_interval_end=2024-05-25 01:48:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:48:02.786330000Z [2024-05-25T01:48:02.786+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:48:00+00:00, run_after=2024-05-25T01:49:00+00:00 2024-05-25T01:48:02.835440782Z [2024-05-25T01:48:02.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:46:00+00:00 exited with status success for try_number 1 2024-05-25T01:48:02.835488033Z [2024-05-25T01:48:02.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:47:00+00:00 exited with status success for try_number 1 2024-05-25T01:48:02.841887500Z [2024-05-25T01:48:02.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:46:00+00:00, map_index=-1, run_start_date=2024-05-25 01:48:01.843085+00:00, run_end_date=2024-05-25 01:48:02.184285+00:00, run_duration=0.3412, state=success, executor_state=success, try_number=1, max_tries=1, job_id=752, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:48:00.902469+00:00, queued_by_job_id=1, pid=11118 2024-05-25T01:48:02.841995259Z [2024-05-25T01:48:02.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:47:00+00:00, map_index=-1, run_start_date=2024-05-25 01:48:01.860630+00:00, run_end_date=2024-05-25 01:48:02.290997+00:00, run_duration=0.430367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=753, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:48:00.902469+00:00, queued_by_job_id=1, pid=11119 2024-05-25T01:48:04.765745918Z [2024-05-25T01:48:04.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:48:04.766194545Z [2024-05-25T01:48:04.765+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:47:00+00:00, run_id=scheduled__2024-05-25T01:47:00+00:00, run_start_date=2024-05-25 01:48:00.816557+00:00, run_end_date=2024-05-25 01:48:04.765607+00:00, run_duration=3.94905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:47:00+00:00, data_interval_end=2024-05-25 01:48:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:48:04.783363851Z [2024-05-25T01:48:04.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:48:00+00:00, run_after=2024-05-25T01:49:00+00:00 2024-05-25T01:48:05.664481489Z [2024-05-25T01:48:05.664+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:48:05.664554798Z [2024-05-25T01:48:05.664+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:47:00+00:00, run_id=scheduled__2024-05-25T01:47:00+00:00, run_start_date=2024-05-25 01:48:00.818124+00:00, run_end_date=2024-05-25 01:48:05.664312+00:00, run_duration=4.846188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:47:00+00:00, data_interval_end=2024-05-25 01:48:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:48:05.686288875Z [2024-05-25T01:48:05.685+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:48:00+00:00, run_after=2024-05-25T01:49:00+00:00 2024-05-25T01:48:05.726946646Z [2024-05-25T01:48:05.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:47:00+00:00 exited with status success for try_number 1 2024-05-25T01:48:05.727813943Z [2024-05-25T01:48:05.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:47:00+00:00 exited with status success for try_number 1 2024-05-25T01:48:05.739976946Z [2024-05-25T01:48:05.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:47:00+00:00, map_index=-1, run_start_date=2024-05-25 01:48:02.986676+00:00, run_end_date=2024-05-25 01:48:04.706644+00:00, run_duration=1.719968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=755, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:48:00.902469+00:00, queued_by_job_id=1, pid=11143 2024-05-25T01:48:05.740497834Z [2024-05-25T01:48:05.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:47:00+00:00, map_index=-1, run_start_date=2024-05-25 01:48:02.922234+00:00, run_end_date=2024-05-25 01:48:05.092964+00:00, run_duration=2.17073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=754, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:48:00.902469+00:00, queued_by_job_id=1, pid=11142 2024-05-25T01:49:00.726786026Z [2024-05-25T01:49:00.726+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:49:00.754081182Z [2024-05-25T01:49:00.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:49:00+00:00, run_after=2024-05-25T01:50:00+00:00 2024-05-25T01:49:00.770589959Z [2024-05-25T01:49:00.770+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:49:00+00:00, run_after=2024-05-25T01:50:00+00:00 2024-05-25T01:49:00.829034829Z [2024-05-25T01:49:00.828+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:49:00.829100252Z 2024-05-25T01:49:00.829107061Z 2024-05-25T01:49:00.829112159Z 2024-05-25T01:49:00.829116977Z [2024-05-25T01:49:00.828+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:49:00.829163170Z [2024-05-25T01:49:00.828+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:49:00.829179996Z [2024-05-25T01:49:00.829+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:49:00.829709938Z [2024-05-25T01:49:00.829+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:49:00.829753095Z 2024-05-25T01:49:00.829759507Z 2024-05-25T01:49:00.829764576Z 2024-05-25T01:49:00.832753993Z [2024-05-25T01:49:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:49:00.832790298Z [2024-05-25T01:49:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:49:00.833069671Z [2024-05-25T01:49:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:49:00.833148477Z [2024-05-25T01:49:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:49:00.833326564Z [2024-05-25T01:49:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:49:00.833334956Z [2024-05-25T01:49:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:49:01.131592583Z [2024-05-25T01:49:01.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:48:00+00:00 exited with status queued for try_number 1 2024-05-25T01:49:01.131673423Z [2024-05-25T01:49:01.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:48:00+00:00 exited with status queued for try_number 1 2024-05-25T01:49:01.131759025Z [2024-05-25T01:49:01.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:48:00+00:00 exited with status queued for try_number 1 2024-05-25T01:49:01.141978204Z [2024-05-25T01:49:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72d612de-67c2-45af-af08-7bcfdf5a88ed 2024-05-25T01:49:01.142008179Z [2024-05-25T01:49:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed60f4fe-b7fa-44c3-84c4-6836ae383731 2024-05-25T01:49:01.142014194Z [2024-05-25T01:49:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 339ae252-d447-4ea7-97a6-95b441e5b7f0 2024-05-25T01:49:02.316074934Z [2024-05-25T01:49:02.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:49:02.316344008Z [2024-05-25T01:49:02.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:48:00+00:00, run_id=scheduled__2024-05-25T01:48:00+00:00, run_start_date=2024-05-25 01:49:00.780325+00:00, run_end_date=2024-05-25 01:49:02.315982+00:00, run_duration=1.535657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:48:00+00:00, data_interval_end=2024-05-25 01:49:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:49:02.326570561Z [2024-05-25T01:49:02.326+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:49:00+00:00, run_after=2024-05-25T01:50:00+00:00 2024-05-25T01:49:02.437249656Z [2024-05-25T01:49:02.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:48:00+00:00 exited with status success for try_number 1 2024-05-25T01:49:02.445495021Z [2024-05-25T01:49:02.444+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:48:00+00:00, map_index=-1, run_start_date=2024-05-25 01:49:01.722451+00:00, run_end_date=2024-05-25 01:49:02.109635+00:00, run_duration=0.387184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=756, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:49:00.830250+00:00, queued_by_job_id=1, pid=11175 2024-05-25T01:49:05.869129184Z [2024-05-25T01:49:05.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:49:05.869615954Z [2024-05-25T01:49:05.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:48:00+00:00, run_id=scheduled__2024-05-25T01:48:00+00:00, run_start_date=2024-05-25 01:49:00.781494+00:00, run_end_date=2024-05-25 01:49:05.868914+00:00, run_duration=5.08742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:48:00+00:00, data_interval_end=2024-05-25 01:49:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:49:05.880733936Z [2024-05-25T01:49:05.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:49:00+00:00, run_after=2024-05-25T01:50:00+00:00 2024-05-25T01:49:05.889559925Z [2024-05-25T01:49:05.889+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:49:05.889952985Z [2024-05-25T01:49:05.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:48:00+00:00, run_id=scheduled__2024-05-25T01:48:00+00:00, run_start_date=2024-05-25 01:49:00.782469+00:00, run_end_date=2024-05-25 01:49:05.889331+00:00, run_duration=5.106862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:48:00+00:00, data_interval_end=2024-05-25 01:49:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:49:05.906066316Z [2024-05-25T01:49:05.905+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:49:00+00:00, run_after=2024-05-25T01:50:00+00:00 2024-05-25T01:49:05.956500280Z [2024-05-25T01:49:05.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:48:00+00:00 exited with status success for try_number 1 2024-05-25T01:49:05.956568833Z [2024-05-25T01:49:05.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:48:00+00:00 exited with status success for try_number 1 2024-05-25T01:49:05.964617044Z [2024-05-25T01:49:05.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:48:00+00:00, map_index=-1, run_start_date=2024-05-25 01:49:02.805252+00:00, run_end_date=2024-05-25 01:49:04.895498+00:00, run_duration=2.090246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=758, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:49:00.830250+00:00, queued_by_job_id=1, pid=11194 2024-05-25T01:49:05.964903746Z [2024-05-25T01:49:05.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:48:00+00:00, map_index=-1, run_start_date=2024-05-25 01:49:02.665374+00:00, run_end_date=2024-05-25 01:49:05.720210+00:00, run_duration=3.054836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=757, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:49:00.830250+00:00, queued_by_job_id=1, pid=11193 2024-05-25T01:50:00.124960642Z [2024-05-25T01:50:00.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:50:00+00:00, run_after=2024-05-25T01:51:00+00:00 2024-05-25T01:50:00.137342653Z [2024-05-25T01:50:00.134+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:50:00.151718858Z [2024-05-25T01:50:00.150+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:50:00+00:00, run_after=2024-05-25T01:51:00+00:00 2024-05-25T01:50:00.160919690Z [2024-05-25T01:50:00.160+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:50:00.185375677Z [2024-05-25T01:50:00.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:50:00+00:00, run_after=2024-05-25T01:55:00+00:00 2024-05-25T01:50:00.275824451Z [2024-05-25T01:50:00.275+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T01:50:00.275852169Z 2024-05-25T01:50:00.275855957Z 2024-05-25T01:50:00.275859740Z 2024-05-25T01:50:00.275862928Z 2024-05-25T01:50:00.275866156Z 2024-05-25T01:50:00.276083702Z [2024-05-25T01:50:00.275+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:50:00.276256174Z [2024-05-25T01:50:00.276+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:50:00.276393816Z [2024-05-25T01:50:00.276+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:50:00.276408748Z [2024-05-25T01:50:00.276+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:50:00.276540419Z [2024-05-25T01:50:00.276+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:50:00.277131444Z [2024-05-25T01:50:00.276+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:50:00.277138542Z 2024-05-25T01:50:00.277142146Z 2024-05-25T01:50:00.277145345Z 2024-05-25T01:50:00.277148370Z 2024-05-25T01:50:00.277151313Z 2024-05-25T01:50:00.281900482Z [2024-05-25T01:50:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:50:00.282104602Z [2024-05-25T01:50:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:50:00.282386925Z [2024-05-25T01:50:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:50:00.282595261Z [2024-05-25T01:50:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:50:00.282789546Z [2024-05-25T01:50:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:50:00.282908867Z [2024-05-25T01:50:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:50:00.283111099Z [2024-05-25T01:50:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:50:00.283235359Z [2024-05-25T01:50:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:50:00.283499363Z [2024-05-25T01:50:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:50:00.283711230Z [2024-05-25T01:50:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:50:00.967385994Z [2024-05-25T01:50:00.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status queued for try_number 1 2024-05-25T01:50:00.967861776Z [2024-05-25T01:50:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:48:00+00:00 exited with status queued for try_number 1 2024-05-25T01:50:00.968271317Z [2024-05-25T01:50:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:49:00+00:00 exited with status queued for try_number 1 2024-05-25T01:50:00.968489212Z [2024-05-25T01:50:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:49:00+00:00 exited with status queued for try_number 1 2024-05-25T01:50:00.968700984Z [2024-05-25T01:50:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:49:00+00:00 exited with status queued for try_number 1 2024-05-25T01:50:00.984638894Z [2024-05-25T01:50:00.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to d79a9dcb-99ee-4fc7-8845-001cb5bca989 2024-05-25T01:50:00.984948135Z [2024-05-25T01:50:00.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc80499f-3204-46fb-abfe-aa11419c0956 2024-05-25T01:50:00.985366632Z [2024-05-25T01:50:00.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa4a4773-6fa0-494f-9752-b776132956d5 2024-05-25T01:50:00.985824247Z [2024-05-25T01:50:00.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a61cd61-8e4e-458f-8bce-074ce0543a6e 2024-05-25T01:50:00.986209687Z [2024-05-25T01:50:00.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to d343c32a-a809-4f44-8060-b2b6ced50739 2024-05-25T01:50:03.534685046Z [2024-05-25T01:50:03.534+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:50:03.535312458Z [2024-05-25T01:50:03.534+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:48:00+00:00, run_id=scheduled__2024-05-25T01:48:00+00:00, run_start_date=2024-05-25 01:50:00.195171+00:00, run_end_date=2024-05-25 01:50:03.534752+00:00, run_duration=3.339581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:48:00+00:00, data_interval_end=2024-05-25 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:50:03.560694250Z [2024-05-25T01:50:03.560+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:50:00+00:00, run_after=2024-05-25T01:52:00+00:00 2024-05-25T01:50:03.581830166Z [2024-05-25T01:50:03.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:50:03.582044329Z [2024-05-25T01:50:03.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:49:00+00:00, run_id=scheduled__2024-05-25T01:49:00+00:00, run_start_date=2024-05-25 01:50:00.201050+00:00, run_end_date=2024-05-25 01:50:03.581774+00:00, run_duration=3.380724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:49:00+00:00, data_interval_end=2024-05-25 01:50:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:50:03.603061520Z [2024-05-25T01:50:03.602+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:50:00+00:00, run_after=2024-05-25T01:51:00+00:00 2024-05-25T01:50:03.756073681Z [2024-05-25T01:50:03.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:48:00+00:00 exited with status success for try_number 1 2024-05-25T01:50:03.756750247Z [2024-05-25T01:50:03.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:49:00+00:00 exited with status success for try_number 1 2024-05-25T01:50:03.763296420Z [2024-05-25T01:50:03.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:48:00+00:00, map_index=-1, run_start_date=2024-05-25 01:50:01.776266+00:00, run_end_date=2024-05-25 01:50:02.526571+00:00, run_duration=0.750305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=760, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:50:00.278950+00:00, queued_by_job_id=1, pid=11229 2024-05-25T01:50:03.763595838Z [2024-05-25T01:50:03.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:49:00+00:00, map_index=-1, run_start_date=2024-05-25 01:50:01.738109+00:00, run_end_date=2024-05-25 01:50:02.586689+00:00, run_duration=0.84858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=759, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:50:00.278950+00:00, queued_by_job_id=1, pid=11228 2024-05-25T01:50:05.499730433Z [2024-05-25T01:50:05.498+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:50:05.499756132Z 2024-05-25T01:50:05.501515392Z [2024-05-25T01:50:05.499+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:50:05.502378279Z [2024-05-25T01:50:05.502+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:50:05.502389493Z 2024-05-25T01:50:05.505867019Z [2024-05-25T01:50:05.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:50:05.506117024Z [2024-05-25T01:50:05.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:50:05.565440893Z [2024-05-25T01:50:05.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status queued for try_number 1 2024-05-25T01:50:05.566114532Z [2024-05-25T01:50:05.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status success for try_number 1 2024-05-25T01:50:05.573426369Z [2024-05-25T01:50:05.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3aeebaad-a4a8-4028-81b6-b3bc25cd8d58 2024-05-25T01:50:05.573532181Z [2024-05-25T01:50:05.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:45:00+00:00, map_index=-1, run_start_date=2024-05-25 01:50:04.511556+00:00, run_end_date=2024-05-25 01:50:05.040236+00:00, run_duration=0.52868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=763, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:50:00.278950+00:00, queued_by_job_id=1, pid=11265 2024-05-25T01:50:06.218671993Z [2024-05-25T01:50:06.218+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:50:06.218813003Z [2024-05-25T01:50:06.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:49:00+00:00, run_id=scheduled__2024-05-25T01:49:00+00:00, run_start_date=2024-05-25 01:50:00.205886+00:00, run_end_date=2024-05-25 01:50:06.218582+00:00, run_duration=6.012696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:49:00+00:00, data_interval_end=2024-05-25 01:50:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:50:06.228440863Z [2024-05-25T01:50:06.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:50:00+00:00, run_after=2024-05-25T01:51:00+00:00 2024-05-25T01:50:06.236761392Z [2024-05-25T01:50:06.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:50:06.236933955Z [2024-05-25T01:50:06.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:49:00+00:00, run_id=scheduled__2024-05-25T01:49:00+00:00, run_start_date=2024-05-25 01:50:00.208421+00:00, run_end_date=2024-05-25 01:50:06.236679+00:00, run_duration=6.028258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:49:00+00:00, data_interval_end=2024-05-25 01:50:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:50:06.251656375Z [2024-05-25T01:50:06.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:50:00+00:00, run_after=2024-05-25T01:51:00+00:00 2024-05-25T01:50:06.305365985Z [2024-05-25T01:50:06.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:49:00+00:00 exited with status success for try_number 1 2024-05-25T01:50:06.305957024Z [2024-05-25T01:50:06.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:49:00+00:00 exited with status success for try_number 1 2024-05-25T01:50:06.315572293Z [2024-05-25T01:50:06.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:49:00+00:00, map_index=-1, run_start_date=2024-05-25 01:50:04.238076+00:00, run_end_date=2024-05-25 01:50:05.787936+00:00, run_duration=1.54986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=762, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:50:00.278950+00:00, queued_by_job_id=1, pid=11259 2024-05-25T01:50:06.316034942Z [2024-05-25T01:50:06.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:49:00+00:00, map_index=-1, run_start_date=2024-05-25 01:50:04.141845+00:00, run_end_date=2024-05-25 01:50:05.842924+00:00, run_duration=1.701079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=761, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:50:00.278950+00:00, queued_by_job_id=1, pid=11258 2024-05-25T01:50:08.585449756Z [2024-05-25T01:50:08.585+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:50:08.585469267Z 2024-05-25T01:50:08.587227498Z [2024-05-25T01:50:08.585+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:50:08.587892391Z [2024-05-25T01:50:08.587+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:50:08.587901015Z 2024-05-25T01:50:08.590654961Z [2024-05-25T01:50:08.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:50:08.590806001Z [2024-05-25T01:50:08.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:50:08.649096804Z [2024-05-25T01:50:08.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status queued for try_number 1 2024-05-25T01:50:08.649280614Z [2024-05-25T01:50:08.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status success for try_number 1 2024-05-25T01:50:08.656846084Z [2024-05-25T01:50:08.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2bb963f-fad3-40de-bd11-4eeea076dd98 2024-05-25T01:50:08.657055398Z [2024-05-25T01:50:08.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T01:45:00+00:00, map_index=-1, run_start_date=2024-05-25 01:50:07.731843+00:00, run_end_date=2024-05-25 01:50:08.462453+00:00, run_duration=0.73061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=764, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:50:05.502954+00:00, queued_by_job_id=1, pid=11294 2024-05-25T01:50:12.012645100Z [2024-05-25T01:50:12.012+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:50:12.012668420Z 2024-05-25T01:50:12.012851416Z [2024-05-25T01:50:12.012+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:50:12.017540647Z [2024-05-25T01:50:12.017+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:50:12.017577847Z 2024-05-25T01:50:12.020112552Z [2024-05-25T01:50:12.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:50:12.020345342Z [2024-05-25T01:50:12.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:50:12.081060456Z [2024-05-25T01:50:12.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status queued for try_number 1 2024-05-25T01:50:12.081112443Z [2024-05-25T01:50:12.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status success for try_number 1 2024-05-25T01:50:12.087931393Z [2024-05-25T01:50:12.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff6ea538-2133-472a-81e1-bb0f04d38ad9 2024-05-25T01:50:12.088306181Z [2024-05-25T01:50:12.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:45:00+00:00, map_index=0, run_start_date=2024-05-25 01:50:10.632854+00:00, run_end_date=2024-05-25 01:50:10.962372+00:00, run_duration=0.329518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=765, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:50:08.588313+00:00, queued_by_job_id=1, pid=11305 2024-05-25T01:50:15.565833632Z [2024-05-25T01:50:15.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:50:15.566654101Z [2024-05-25T01:50:15.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:45:00+00:00, run_id=scheduled__2024-05-25T01:45:00+00:00, run_start_date=2024-05-25 01:50:00.193311+00:00, run_end_date=2024-05-25 01:50:15.565736+00:00, run_duration=15.372425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:45:00+00:00, data_interval_end=2024-05-25 01:50:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T01:50:15.581436135Z [2024-05-25T01:50:15.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:50:00+00:00, run_after=2024-05-25T01:55:00+00:00 2024-05-25T01:50:15.627614175Z [2024-05-25T01:50:15.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:45:00+00:00 exited with status success for try_number 1 2024-05-25T01:50:15.633942477Z [2024-05-25T01:50:15.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:45:00+00:00, map_index=-1, run_start_date=2024-05-25 01:50:14.233901+00:00, run_end_date=2024-05-25 01:50:14.626861+00:00, run_duration=0.39296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=766, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:50:12.017937+00:00, queued_by_job_id=1, pid=11313 2024-05-25T01:50:29.573522918Z [2024-05-25T01:50:29.572+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T01:51:00.460592341Z [2024-05-25T01:51:00.460+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:51:00+00:00, run_after=2024-05-25T01:52:00+00:00 2024-05-25T01:51:00.468667290Z [2024-05-25T01:51:00.467+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:51:00.481453513Z [2024-05-25T01:51:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:51:00+00:00, run_after=2024-05-25T01:52:00+00:00 2024-05-25T01:51:00.562845961Z [2024-05-25T01:51:00.562+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:51:00.562872073Z 2024-05-25T01:51:00.562875723Z 2024-05-25T01:51:00.562878850Z 2024-05-25T01:51:00.563119745Z [2024-05-25T01:51:00.562+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:51:00.563389148Z [2024-05-25T01:51:00.563+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:51:00.563725709Z [2024-05-25T01:51:00.563+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:51:00.565257407Z [2024-05-25T01:51:00.564+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:51:00.565266544Z 2024-05-25T01:51:00.565269766Z 2024-05-25T01:51:00.565272776Z 2024-05-25T01:51:00.571234645Z [2024-05-25T01:51:00.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:51:00.571438838Z [2024-05-25T01:51:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:51:00.571792971Z [2024-05-25T01:51:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:51:00.571955243Z [2024-05-25T01:51:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:51:00.572352004Z [2024-05-25T01:51:00.572+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:51:00.572533846Z [2024-05-25T01:51:00.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:51:00.917337310Z [2024-05-25T01:51:00.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status queued for try_number 1 2024-05-25T01:51:00.917495206Z [2024-05-25T01:51:00.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status queued for try_number 1 2024-05-25T01:51:00.917621201Z [2024-05-25T01:51:00.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status queued for try_number 1 2024-05-25T01:51:00.925508916Z [2024-05-25T01:51:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec59da92-493c-49b7-80a5-66f00eef64bf 2024-05-25T01:51:00.925660201Z [2024-05-25T01:51:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5365fd2d-4c0f-4d4b-b557-a999bc99d72e 2024-05-25T01:51:00.925838842Z [2024-05-25T01:51:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d93999e-6f0d-4cd2-b339-26c74809303b 2024-05-25T01:51:02.099665098Z [2024-05-25T01:51:02.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:51:02.099872981Z [2024-05-25T01:51:02.099+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:50:00+00:00, run_id=scheduled__2024-05-25T01:50:00+00:00, run_start_date=2024-05-25 01:51:00.496694+00:00, run_end_date=2024-05-25 01:51:02.099546+00:00, run_duration=1.602852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:50:00+00:00, data_interval_end=2024-05-25 01:51:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:51:02.108380965Z [2024-05-25T01:51:02.108+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:51:00+00:00, run_after=2024-05-25T01:52:00+00:00 2024-05-25T01:51:02.152254603Z [2024-05-25T01:51:02.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status success for try_number 1 2024-05-25T01:51:02.162033115Z [2024-05-25T01:51:02.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:50:00+00:00, map_index=-1, run_start_date=2024-05-25 01:51:01.484289+00:00, run_end_date=2024-05-25 01:51:01.822917+00:00, run_duration=0.338628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=767, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:51:00.566547+00:00, queued_by_job_id=1, pid=11322 2024-05-25T01:51:04.529334981Z [2024-05-25T01:51:04.528+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:51:04.529738349Z [2024-05-25T01:51:04.529+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:50:00+00:00, run_id=scheduled__2024-05-25T01:50:00+00:00, run_start_date=2024-05-25 01:51:00.498031+00:00, run_end_date=2024-05-25 01:51:04.529190+00:00, run_duration=4.031159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:50:00+00:00, data_interval_end=2024-05-25 01:51:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:51:04.547728111Z [2024-05-25T01:51:04.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:51:00+00:00, run_after=2024-05-25T01:52:00+00:00 2024-05-25T01:51:04.554854997Z [2024-05-25T01:51:04.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:51:04.555176284Z [2024-05-25T01:51:04.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:50:00+00:00, run_id=scheduled__2024-05-25T01:50:00+00:00, run_start_date=2024-05-25 01:51:00.499081+00:00, run_end_date=2024-05-25 01:51:04.554748+00:00, run_duration=4.055667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:50:00+00:00, data_interval_end=2024-05-25 01:51:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:51:04.564008130Z [2024-05-25T01:51:04.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:51:00+00:00, run_after=2024-05-25T01:52:00+00:00 2024-05-25T01:51:04.602141886Z [2024-05-25T01:51:04.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status success for try_number 1 2024-05-25T01:51:04.602336221Z [2024-05-25T01:51:04.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status success for try_number 1 2024-05-25T01:51:04.616584928Z [2024-05-25T01:51:04.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:50:00+00:00, map_index=-1, run_start_date=2024-05-25 01:51:02.560647+00:00, run_end_date=2024-05-25 01:51:04.211027+00:00, run_duration=1.65038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=768, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:51:00.566547+00:00, queued_by_job_id=1, pid=11340 2024-05-25T01:51:04.617014713Z [2024-05-25T01:51:04.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:50:00+00:00, map_index=-1, run_start_date=2024-05-25 01:51:02.615819+00:00, run_end_date=2024-05-25 01:51:04.047915+00:00, run_duration=1.432096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=769, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:51:00.566547+00:00, queued_by_job_id=1, pid=11341 2024-05-25T01:52:00.482726827Z [2024-05-25T01:52:00.481+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:52:00+00:00, run_after=2024-05-25T01:53:00+00:00 2024-05-25T01:52:00.493910694Z [2024-05-25T01:52:00.493+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:52:00.508723279Z [2024-05-25T01:52:00.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:52:00+00:00, run_after=2024-05-25T01:53:00+00:00 2024-05-25T01:52:00.516810920Z [2024-05-25T01:52:00.516+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:52:00.658169653Z [2024-05-25T01:52:00.657+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:52:00.658200664Z 2024-05-25T01:52:00.658216853Z 2024-05-25T01:52:00.658243433Z 2024-05-25T01:52:00.658248870Z 2024-05-25T01:52:00.658385956Z [2024-05-25T01:52:00.658+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:52:00.658617111Z [2024-05-25T01:52:00.658+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:52:00.658873800Z [2024-05-25T01:52:00.658+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:52:00.659122818Z [2024-05-25T01:52:00.658+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:52:00.660235456Z [2024-05-25T01:52:00.659+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:52:00.660251412Z 2024-05-25T01:52:00.660257352Z 2024-05-25T01:52:00.660262671Z 2024-05-25T01:52:00.660268248Z 2024-05-25T01:52:00.666365960Z [2024-05-25T01:52:00.665+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:52:00.666597609Z [2024-05-25T01:52:00.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:52:00.667024582Z [2024-05-25T01:52:00.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:52:00.667258399Z [2024-05-25T01:52:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:52:00.667660087Z [2024-05-25T01:52:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:52:00.667930440Z [2024-05-25T01:52:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:52:00.668311204Z [2024-05-25T01:52:00.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:52:00.668535455Z [2024-05-25T01:52:00.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:52:00.953358060Z [2024-05-25T01:52:00.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status queued for try_number 1 2024-05-25T01:52:00.953391062Z [2024-05-25T01:52:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:51:00+00:00 exited with status queued for try_number 1 2024-05-25T01:52:00.953457443Z [2024-05-25T01:52:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:51:00+00:00 exited with status queued for try_number 1 2024-05-25T01:52:00.953506319Z [2024-05-25T01:52:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:51:00+00:00 exited with status queued for try_number 1 2024-05-25T01:52:00.962687484Z [2024-05-25T01:52:00.962+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32a90b74-fc6e-47b9-96c8-f89e20a76c98 2024-05-25T01:52:00.962756737Z [2024-05-25T01:52:00.962+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7c09928-0239-4466-9638-c81a927acc0c 2024-05-25T01:52:00.962927712Z [2024-05-25T01:52:00.962+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd12aad3-c517-4ba2-819f-e6c66fe6e807 2024-05-25T01:52:00.963030365Z [2024-05-25T01:52:00.962+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9aa62d1-1494-4348-aaa3-a5f9077a7b9f 2024-05-25T01:52:02.305653626Z [2024-05-25T01:52:02.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:52:02.306483900Z [2024-05-25T01:52:02.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:50:00+00:00, run_id=scheduled__2024-05-25T01:50:00+00:00, run_start_date=2024-05-25 01:52:00.551097+00:00, run_end_date=2024-05-25 01:52:02.306038+00:00, run_duration=1.754941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:50:00+00:00, data_interval_end=2024-05-25 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:52:02.323913174Z [2024-05-25T01:52:02.323+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:52:00+00:00, run_after=2024-05-25T01:54:00+00:00 2024-05-25T01:52:02.332033764Z [2024-05-25T01:52:02.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:52:02.337725099Z [2024-05-25T01:52:02.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:51:00+00:00, run_id=scheduled__2024-05-25T01:51:00+00:00, run_start_date=2024-05-25 01:52:00.553304+00:00, run_end_date=2024-05-25 01:52:02.332119+00:00, run_duration=1.778815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:51:00+00:00, data_interval_end=2024-05-25 01:52:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:52:02.358638272Z [2024-05-25T01:52:02.358+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:52:00+00:00, run_after=2024-05-25T01:53:00+00:00 2024-05-25T01:52:02.432250796Z [2024-05-25T01:52:02.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status success for try_number 1 2024-05-25T01:52:02.432811472Z [2024-05-25T01:52:02.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:51:00+00:00 exited with status success for try_number 1 2024-05-25T01:52:02.440796059Z [2024-05-25T01:52:02.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:50:00+00:00, map_index=-1, run_start_date=2024-05-25 01:52:01.466003+00:00, run_end_date=2024-05-25 01:52:01.832730+00:00, run_duration=0.366727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=770, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:52:00.661678+00:00, queued_by_job_id=1, pid=11374 2024-05-25T01:52:02.441108914Z [2024-05-25T01:52:02.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:51:00+00:00, map_index=-1, run_start_date=2024-05-25 01:52:01.632211+00:00, run_end_date=2024-05-25 01:52:02.012221+00:00, run_duration=0.38001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=771, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:52:00.661678+00:00, queued_by_job_id=1, pid=11375 2024-05-25T01:52:04.490904803Z [2024-05-25T01:52:04.490+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:52:04.491387156Z [2024-05-25T01:52:04.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:51:00+00:00, run_id=scheduled__2024-05-25T01:51:00+00:00, run_start_date=2024-05-25 01:52:00.554889+00:00, run_end_date=2024-05-25 01:52:04.491043+00:00, run_duration=3.936154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:51:00+00:00, data_interval_end=2024-05-25 01:52:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:52:04.507867952Z [2024-05-25T01:52:04.507+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:52:00+00:00, run_after=2024-05-25T01:53:00+00:00 2024-05-25T01:52:05.271564151Z [2024-05-25T01:52:05.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:52:05.272595520Z [2024-05-25T01:52:05.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:51:00+00:00, run_id=scheduled__2024-05-25T01:51:00+00:00, run_start_date=2024-05-25 01:52:00.556468+00:00, run_end_date=2024-05-25 01:52:05.271861+00:00, run_duration=4.715393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:51:00+00:00, data_interval_end=2024-05-25 01:52:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:52:05.289330042Z [2024-05-25T01:52:05.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:52:00+00:00, run_after=2024-05-25T01:53:00+00:00 2024-05-25T01:52:05.330148838Z [2024-05-25T01:52:05.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:51:00+00:00 exited with status success for try_number 1 2024-05-25T01:52:05.330527821Z [2024-05-25T01:52:05.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:51:00+00:00 exited with status success for try_number 1 2024-05-25T01:52:05.339565555Z [2024-05-25T01:52:05.338+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:51:00+00:00, map_index=-1, run_start_date=2024-05-25 01:52:03.045563+00:00, run_end_date=2024-05-25 01:52:04.363045+00:00, run_duration=1.317482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=773, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:52:00.661678+00:00, queued_by_job_id=1, pid=11399 2024-05-25T01:52:05.339829155Z [2024-05-25T01:52:05.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:51:00+00:00, map_index=-1, run_start_date=2024-05-25 01:52:02.877925+00:00, run_end_date=2024-05-25 01:52:04.605780+00:00, run_duration=1.727855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=772, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:52:00.661678+00:00, queued_by_job_id=1, pid=11398 2024-05-25T01:53:00.308011226Z [2024-05-25T01:53:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:53:00+00:00, run_after=2024-05-25T01:54:00+00:00 2024-05-25T01:53:00.318466943Z [2024-05-25T01:53:00.318+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:53:00+00:00, run_after=2024-05-25T01:54:00+00:00 2024-05-25T01:53:00.323959534Z [2024-05-25T01:53:00.323+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:53:00.378061580Z [2024-05-25T01:53:00.377+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:53:00.378087668Z 2024-05-25T01:53:00.378091276Z 2024-05-25T01:53:00.378094207Z 2024-05-25T01:53:00.378456922Z [2024-05-25T01:53:00.378+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:53:00.378964917Z [2024-05-25T01:53:00.378+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:53:00.379303190Z [2024-05-25T01:53:00.379+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:53:00.380035992Z [2024-05-25T01:53:00.379+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:53:00.380049572Z 2024-05-25T01:53:00.380054174Z 2024-05-25T01:53:00.380059033Z 2024-05-25T01:53:00.384248483Z [2024-05-25T01:53:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:53:00.384671728Z [2024-05-25T01:53:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:53:00.385647205Z [2024-05-25T01:53:00.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:53:00.385792736Z [2024-05-25T01:53:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:53:00.386075515Z [2024-05-25T01:53:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:53:00.386163891Z [2024-05-25T01:53:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:53:00.640914806Z [2024-05-25T01:53:00.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:52:00+00:00 exited with status queued for try_number 1 2024-05-25T01:53:00.641005288Z [2024-05-25T01:53:00.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:52:00+00:00 exited with status queued for try_number 1 2024-05-25T01:53:00.641072690Z [2024-05-25T01:53:00.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:52:00+00:00 exited with status queued for try_number 1 2024-05-25T01:53:00.889597137Z [2024-05-25T01:53:00.889+0000] {scheduler_job.py:635} INFO - Setting external_id for to b148c80d-babf-4882-886e-b47917a7ebb3 2024-05-25T01:53:00.889676421Z [2024-05-25T01:53:00.889+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2817f76-3490-4b86-ba02-acb6603e08da 2024-05-25T01:53:00.889765948Z [2024-05-25T01:53:00.889+0000] {scheduler_job.py:635} INFO - Setting external_id for to b47e5a9d-84da-4b9b-9353-a97dadfc904d 2024-05-25T01:53:02.036612592Z [2024-05-25T01:53:02.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:53:02.037322574Z [2024-05-25T01:53:02.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:52:00+00:00, run_id=scheduled__2024-05-25T01:52:00+00:00, run_start_date=2024-05-25 01:53:00.332716+00:00, run_end_date=2024-05-25 01:53:02.036516+00:00, run_duration=1.7038, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:52:00+00:00, data_interval_end=2024-05-25 01:53:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:53:02.048926569Z [2024-05-25T01:53:02.048+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:53:00+00:00, run_after=2024-05-25T01:54:00+00:00 2024-05-25T01:53:02.112353892Z [2024-05-25T01:53:02.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:52:00+00:00 exited with status success for try_number 1 2024-05-25T01:53:02.119418297Z [2024-05-25T01:53:02.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:52:00+00:00, map_index=-1, run_start_date=2024-05-25 01:53:01.323403+00:00, run_end_date=2024-05-25 01:53:01.736650+00:00, run_duration=0.413247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=774, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:53:00.381038+00:00, queued_by_job_id=1, pid=11430 2024-05-25T01:53:05.391968121Z [2024-05-25T01:53:05.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:53:05.392682565Z [2024-05-25T01:53:05.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:52:00+00:00, run_id=scheduled__2024-05-25T01:52:00+00:00, run_start_date=2024-05-25 01:53:00.333907+00:00, run_end_date=2024-05-25 01:53:05.391853+00:00, run_duration=5.057946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:52:00+00:00, data_interval_end=2024-05-25 01:53:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:53:05.409862308Z [2024-05-25T01:53:05.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:53:00+00:00, run_after=2024-05-25T01:54:00+00:00 2024-05-25T01:53:05.421920843Z [2024-05-25T01:53:05.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:53:05.422251998Z [2024-05-25T01:53:05.421+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:52:00+00:00, run_id=scheduled__2024-05-25T01:52:00+00:00, run_start_date=2024-05-25 01:53:00.334892+00:00, run_end_date=2024-05-25 01:53:05.421718+00:00, run_duration=5.086826, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:52:00+00:00, data_interval_end=2024-05-25 01:53:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:53:05.438104991Z [2024-05-25T01:53:05.437+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:53:00+00:00, run_after=2024-05-25T01:54:00+00:00 2024-05-25T01:53:05.509141887Z [2024-05-25T01:53:05.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:52:00+00:00 exited with status success for try_number 1 2024-05-25T01:53:05.509410809Z [2024-05-25T01:53:05.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:52:00+00:00 exited with status success for try_number 1 2024-05-25T01:53:05.518524724Z [2024-05-25T01:53:05.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:52:00+00:00, map_index=-1, run_start_date=2024-05-25 01:53:02.717167+00:00, run_end_date=2024-05-25 01:53:04.409158+00:00, run_duration=1.691991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=776, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:53:00.381038+00:00, queued_by_job_id=1, pid=11449 2024-05-25T01:53:05.518547384Z [2024-05-25T01:53:05.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:52:00+00:00, map_index=-1, run_start_date=2024-05-25 01:53:02.570058+00:00, run_end_date=2024-05-25 01:53:05.167231+00:00, run_duration=2.597173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=775, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:53:00.381038+00:00, queued_by_job_id=1, pid=11448 2024-05-25T01:54:01.067823872Z [2024-05-25T01:54:01.066+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:54:01.089511190Z [2024-05-25T01:54:01.089+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:54:00+00:00, run_after=2024-05-25T01:55:00+00:00 2024-05-25T01:54:01.097570148Z [2024-05-25T01:54:01.097+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:54:01.108590511Z [2024-05-25T01:54:01.108+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:54:00+00:00, run_after=2024-05-25T01:55:00+00:00 2024-05-25T01:54:01.185788730Z [2024-05-25T01:54:01.185+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:54:01.185810668Z 2024-05-25T01:54:01.185819280Z 2024-05-25T01:54:01.185822894Z 2024-05-25T01:54:01.185826065Z 2024-05-25T01:54:01.185875159Z [2024-05-25T01:54:01.185+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:54:01.186114110Z [2024-05-25T01:54:01.185+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:54:01.186263255Z [2024-05-25T01:54:01.186+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:54:01.186420459Z [2024-05-25T01:54:01.186+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:54:01.187333985Z [2024-05-25T01:54:01.187+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:54:01.187344049Z 2024-05-25T01:54:01.187347409Z 2024-05-25T01:54:01.187350501Z 2024-05-25T01:54:01.187353396Z 2024-05-25T01:54:01.191696286Z [2024-05-25T01:54:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:54:01.191711588Z [2024-05-25T01:54:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:54:01.191933942Z [2024-05-25T01:54:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:54:01.191991719Z [2024-05-25T01:54:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:54:01.192231476Z [2024-05-25T01:54:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:54:01.192255171Z [2024-05-25T01:54:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:54:01.192589241Z [2024-05-25T01:54:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:54:01.192652770Z [2024-05-25T01:54:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:54:01.493330428Z [2024-05-25T01:54:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:52:00+00:00 exited with status queued for try_number 1 2024-05-25T01:54:01.493471995Z [2024-05-25T01:54:01.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:53:00+00:00 exited with status queued for try_number 1 2024-05-25T01:54:01.493579676Z [2024-05-25T01:54:01.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:53:00+00:00 exited with status queued for try_number 1 2024-05-25T01:54:01.493680461Z [2024-05-25T01:54:01.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:53:00+00:00 exited with status queued for try_number 1 2024-05-25T01:54:01.503130700Z [2024-05-25T01:54:01.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8786eb46-bdad-428e-96a6-adb3f416bdc7 2024-05-25T01:54:01.503263085Z [2024-05-25T01:54:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31798c8f-9829-4eb5-9862-5d31933b2cb8 2024-05-25T01:54:01.503426936Z [2024-05-25T01:54:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6cdd609-cc4e-4432-954a-46e950796f5f 2024-05-25T01:54:01.503565374Z [2024-05-25T01:54:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd95887c-0ebe-4dc5-99e4-292755d04347 2024-05-25T01:54:03.038121045Z [2024-05-25T01:54:03.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:54:03.038704574Z [2024-05-25T01:54:03.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:52:00+00:00, run_id=scheduled__2024-05-25T01:52:00+00:00, run_start_date=2024-05-25 01:54:01.118213+00:00, run_end_date=2024-05-25 01:54:03.037972+00:00, run_duration=1.919759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:52:00+00:00, data_interval_end=2024-05-25 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:54:03.046012105Z [2024-05-25T01:54:03.045+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:54:00+00:00, run_after=2024-05-25T01:56:00+00:00 2024-05-25T01:54:03.052345634Z [2024-05-25T01:54:03.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:54:03.052899085Z [2024-05-25T01:54:03.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:53:00+00:00, run_id=scheduled__2024-05-25T01:53:00+00:00, run_start_date=2024-05-25 01:54:01.119261+00:00, run_end_date=2024-05-25 01:54:03.052198+00:00, run_duration=1.932937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:53:00+00:00, data_interval_end=2024-05-25 01:54:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:54:03.067475016Z [2024-05-25T01:54:03.067+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:54:00+00:00, run_after=2024-05-25T01:55:00+00:00 2024-05-25T01:54:03.145520570Z [2024-05-25T01:54:03.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:52:00+00:00 exited with status success for try_number 1 2024-05-25T01:54:03.145547899Z [2024-05-25T01:54:03.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:53:00+00:00 exited with status success for try_number 1 2024-05-25T01:54:03.162849929Z [2024-05-25T01:54:03.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:52:00+00:00, map_index=-1, run_start_date=2024-05-25 01:54:02.034432+00:00, run_end_date=2024-05-25 01:54:02.457995+00:00, run_duration=0.423563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=777, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:54:01.188778+00:00, queued_by_job_id=1, pid=11482 2024-05-25T01:54:03.163222283Z [2024-05-25T01:54:03.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:53:00+00:00, map_index=-1, run_start_date=2024-05-25 01:54:02.408189+00:00, run_end_date=2024-05-25 01:54:02.840409+00:00, run_duration=0.43222, state=success, executor_state=success, try_number=1, max_tries=1, job_id=778, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:54:01.188778+00:00, queued_by_job_id=1, pid=11488 2024-05-25T01:54:05.324824103Z [2024-05-25T01:54:05.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:54:05.325138521Z [2024-05-25T01:54:05.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:53:00+00:00, run_id=scheduled__2024-05-25T01:53:00+00:00, run_start_date=2024-05-25 01:54:01.120252+00:00, run_end_date=2024-05-25 01:54:05.324721+00:00, run_duration=4.204469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:53:00+00:00, data_interval_end=2024-05-25 01:54:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:54:05.334142592Z [2024-05-25T01:54:05.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:54:00+00:00, run_after=2024-05-25T01:55:00+00:00 2024-05-25T01:54:05.341326884Z [2024-05-25T01:54:05.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:54:05.341657020Z [2024-05-25T01:54:05.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:53:00+00:00, run_id=scheduled__2024-05-25T01:53:00+00:00, run_start_date=2024-05-25 01:54:01.121373+00:00, run_end_date=2024-05-25 01:54:05.341258+00:00, run_duration=4.219885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:53:00+00:00, data_interval_end=2024-05-25 01:54:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:54:05.350619047Z [2024-05-25T01:54:05.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:54:00+00:00, run_after=2024-05-25T01:55:00+00:00 2024-05-25T01:54:05.390717209Z [2024-05-25T01:54:05.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:53:00+00:00 exited with status success for try_number 1 2024-05-25T01:54:05.390933727Z [2024-05-25T01:54:05.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:53:00+00:00 exited with status success for try_number 1 2024-05-25T01:54:05.399308076Z [2024-05-25T01:54:05.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:53:00+00:00, map_index=-1, run_start_date=2024-05-25 01:54:03.408488+00:00, run_end_date=2024-05-25 01:54:04.641378+00:00, run_duration=1.23289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=780, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:54:01.188778+00:00, queued_by_job_id=1, pid=11507 2024-05-25T01:54:05.399592201Z [2024-05-25T01:54:05.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:53:00+00:00, map_index=-1, run_start_date=2024-05-25 01:54:03.386923+00:00, run_end_date=2024-05-25 01:54:05.140165+00:00, run_duration=1.753242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=779, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:54:01.188778+00:00, queued_by_job_id=1, pid=11506 2024-05-25T01:55:01.072599374Z [2024-05-25T01:55:01.072+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:55:00+00:00, run_after=2024-05-25T01:56:00+00:00 2024-05-25T01:55:01.090238679Z [2024-05-25T01:55:01.089+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:55:00+00:00, run_after=2024-05-25T02:00:00+00:00 2024-05-25T01:55:01.109031309Z [2024-05-25T01:55:01.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:55:00+00:00, run_after=2024-05-25T01:56:00+00:00 2024-05-25T01:55:01.116840332Z [2024-05-25T01:55:01.116+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:55:01.203568996Z [2024-05-25T01:55:01.203+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:55:01.203595041Z 2024-05-25T01:55:01.203599701Z 2024-05-25T01:55:01.203603861Z 2024-05-25T01:55:01.203607803Z 2024-05-25T01:55:01.203722753Z [2024-05-25T01:55:01.203+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:55:01.204005459Z [2024-05-25T01:55:01.203+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:55:01.204788199Z [2024-05-25T01:55:01.204+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:55:01.204986145Z [2024-05-25T01:55:01.204+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:55:01.205750881Z [2024-05-25T01:55:01.205+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:55:01.205763931Z 2024-05-25T01:55:01.205769520Z 2024-05-25T01:55:01.205774654Z 2024-05-25T01:55:01.205779601Z 2024-05-25T01:55:01.209504135Z [2024-05-25T01:55:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T01:55:01.209917050Z [2024-05-25T01:55:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:55:01.210887801Z [2024-05-25T01:55:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:55:01.211173960Z [2024-05-25T01:55:01.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:55:01.211426890Z [2024-05-25T01:55:01.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:55:01.211545839Z [2024-05-25T01:55:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:55:01.211809683Z [2024-05-25T01:55:01.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:55:01.211935538Z [2024-05-25T01:55:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:55:01.734338075Z [2024-05-25T01:55:01.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status queued for try_number 1 2024-05-25T01:55:01.734449046Z [2024-05-25T01:55:01.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:54:00+00:00 exited with status queued for try_number 1 2024-05-25T01:55:01.734505428Z [2024-05-25T01:55:01.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:54:00+00:00 exited with status queued for try_number 1 2024-05-25T01:55:01.734577304Z [2024-05-25T01:55:01.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:54:00+00:00 exited with status queued for try_number 1 2024-05-25T01:55:01.753352926Z [2024-05-25T01:55:01.752+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc140e54-776f-4179-b671-52923963e10e 2024-05-25T01:55:01.753470223Z [2024-05-25T01:55:01.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6eae1f5-457f-4ddb-883b-8d66102f954f 2024-05-25T01:55:01.753567009Z [2024-05-25T01:55:01.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to e24e5b33-4141-4d33-bab7-1eb7ba018aa7 2024-05-25T01:55:01.753671493Z [2024-05-25T01:55:01.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09715636-2afc-49b3-a502-68428a46d700 2024-05-25T01:55:04.120828760Z [2024-05-25T01:55:04.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:55:04.122701525Z [2024-05-25T01:55:04.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:54:00+00:00, run_id=scheduled__2024-05-25T01:54:00+00:00, run_start_date=2024-05-25 01:55:01.131169+00:00, run_end_date=2024-05-25 01:55:04.122139+00:00, run_duration=2.99097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:54:00+00:00, data_interval_end=2024-05-25 01:55:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:55:04.183884105Z [2024-05-25T01:55:04.182+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:55:00+00:00, run_after=2024-05-25T01:56:00+00:00 2024-05-25T01:55:04.330959101Z [2024-05-25T01:55:04.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:54:00+00:00 exited with status success for try_number 1 2024-05-25T01:55:04.343983167Z [2024-05-25T01:55:04.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:54:00+00:00, map_index=-1, run_start_date=2024-05-25 01:55:02.385860+00:00, run_end_date=2024-05-25 01:55:02.940263+00:00, run_duration=0.554403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=781, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:55:01.206573+00:00, queued_by_job_id=1, pid=11539 2024-05-25T01:55:05.445204454Z [2024-05-25T01:55:05.444+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:55:05.445243945Z 2024-05-25T01:55:05.445248386Z [2024-05-25T01:55:05.445+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:55:05.445924402Z [2024-05-25T01:55:05.445+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:55:05.445937761Z 2024-05-25T01:55:05.448267393Z [2024-05-25T01:55:05.448+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T01:55:05.448352030Z [2024-05-25T01:55:05.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:55:05.510105689Z [2024-05-25T01:55:05.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status queued for try_number 1 2024-05-25T01:55:05.510307781Z [2024-05-25T01:55:05.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status success for try_number 1 2024-05-25T01:55:05.519362439Z [2024-05-25T01:55:05.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fbd21e3-622d-435c-8ddd-0efa5c5476f7 2024-05-25T01:55:05.519784456Z [2024-05-25T01:55:05.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:50:00+00:00, map_index=-1, run_start_date=2024-05-25 01:55:04.536147+00:00, run_end_date=2024-05-25 01:55:05.037459+00:00, run_duration=0.501312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=784, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:55:01.206573+00:00, queued_by_job_id=1, pid=11570 2024-05-25T01:55:06.548002290Z [2024-05-25T01:55:06.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:55:06.548441173Z [2024-05-25T01:55:06.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:54:00+00:00, run_id=scheduled__2024-05-25T01:54:00+00:00, run_start_date=2024-05-25 01:55:01.132580+00:00, run_end_date=2024-05-25 01:55:06.548132+00:00, run_duration=5.415552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:54:00+00:00, data_interval_end=2024-05-25 01:55:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:55:06.556850332Z [2024-05-25T01:55:06.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:55:00+00:00, run_after=2024-05-25T01:56:00+00:00 2024-05-25T01:55:06.638273331Z [2024-05-25T01:55:06.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:54:00+00:00 exited with status success for try_number 1 2024-05-25T01:55:06.648114544Z [2024-05-25T01:55:06.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:54:00+00:00, map_index=-1, run_start_date=2024-05-25 01:55:04.444559+00:00, run_end_date=2024-05-25 01:55:05.936942+00:00, run_duration=1.492383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=783, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:55:01.206573+00:00, queued_by_job_id=1, pid=11567 2024-05-25T01:55:07.846088690Z [2024-05-25T01:55:07.845+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:55:07.846293391Z [2024-05-25T01:55:07.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:54:00+00:00, run_id=scheduled__2024-05-25T01:54:00+00:00, run_start_date=2024-05-25 01:55:01.133624+00:00, run_end_date=2024-05-25 01:55:07.846051+00:00, run_duration=6.712427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:54:00+00:00, data_interval_end=2024-05-25 01:55:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:55:07.857938390Z [2024-05-25T01:55:07.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:55:00+00:00, run_after=2024-05-25T01:56:00+00:00 2024-05-25T01:55:07.928789434Z [2024-05-25T01:55:07.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:54:00+00:00 exited with status success for try_number 1 2024-05-25T01:55:07.942771631Z [2024-05-25T01:55:07.942+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:54:00+00:00, map_index=-1, run_start_date=2024-05-25 01:55:03.800326+00:00, run_end_date=2024-05-25 01:55:07.387832+00:00, run_duration=3.587506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=782, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:55:01.206573+00:00, queued_by_job_id=1, pid=11553 2024-05-25T01:55:09.236248579Z [2024-05-25T01:55:09.235+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:55:09.236276886Z 2024-05-25T01:55:09.236410835Z [2024-05-25T01:55:09.236+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:55:09.236953003Z [2024-05-25T01:55:09.236+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:55:09.236965847Z 2024-05-25T01:55:09.238994772Z [2024-05-25T01:55:09.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T01:55:09.239093170Z [2024-05-25T01:55:09.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:55:09.322660086Z [2024-05-25T01:55:09.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status queued for try_number 1 2024-05-25T01:55:09.322730445Z [2024-05-25T01:55:09.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status success for try_number 1 2024-05-25T01:55:09.329394864Z [2024-05-25T01:55:09.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbed53e6-f67f-42a8-8745-4bff1ace6a8e 2024-05-25T01:55:09.329603527Z [2024-05-25T01:55:09.329+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T01:50:00+00:00, map_index=-1, run_start_date=2024-05-25 01:55:07.345702+00:00, run_end_date=2024-05-25 01:55:08.139005+00:00, run_duration=0.793303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=785, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:55:05.446183+00:00, queued_by_job_id=1, pid=11598 2024-05-25T01:55:11.553874646Z [2024-05-25T01:55:11.553+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T01:55:11.553954001Z 2024-05-25T01:55:11.554437127Z [2024-05-25T01:55:11.554+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:55:11.555977164Z [2024-05-25T01:55:11.555+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:55:11.556002704Z 2024-05-25T01:55:11.561714356Z [2024-05-25T01:55:11.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:55:11.562415382Z [2024-05-25T01:55:11.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:55:11.628095826Z [2024-05-25T01:55:11.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status queued for try_number 1 2024-05-25T01:55:11.628535261Z [2024-05-25T01:55:11.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status success for try_number 1 2024-05-25T01:55:11.637660621Z [2024-05-25T01:55:11.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bce79a3-3edb-456d-8cf7-17575ac95024 2024-05-25T01:55:11.637951556Z [2024-05-25T01:55:11.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:50:00+00:00, map_index=0, run_start_date=2024-05-25 01:55:10.941822+00:00, run_end_date=2024-05-25 01:55:11.261782+00:00, run_duration=0.31996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=786, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:55:09.237228+00:00, queued_by_job_id=1, pid=11609 2024-05-25T01:55:14.347195937Z [2024-05-25T01:55:14.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:55:14.347622012Z [2024-05-25T01:55:14.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:50:00+00:00, run_id=scheduled__2024-05-25T01:50:00+00:00, run_start_date=2024-05-25 01:55:01.129724+00:00, run_end_date=2024-05-25 01:55:14.347075+00:00, run_duration=13.217351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:50:00+00:00, data_interval_end=2024-05-25 01:55:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T01:55:14.355140952Z [2024-05-25T01:55:14.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:55:00+00:00, run_after=2024-05-25T02:00:00+00:00 2024-05-25T01:55:14.397903112Z [2024-05-25T01:55:14.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:50:00+00:00 exited with status success for try_number 1 2024-05-25T01:55:14.406901844Z [2024-05-25T01:55:14.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:50:00+00:00, map_index=-1, run_start_date=2024-05-25 01:55:13.251201+00:00, run_end_date=2024-05-25 01:55:13.659552+00:00, run_duration=0.408351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=787, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:55:11.556778+00:00, queued_by_job_id=1, pid=11617 2024-05-25T01:55:29.599606369Z [2024-05-25T01:55:29.598+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T01:56:00.100583254Z [2024-05-25T01:56:00.100+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:56:00+00:00, run_after=2024-05-25T01:57:00+00:00 2024-05-25T01:56:00.108068382Z [2024-05-25T01:56:00.107+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:56:00.113777696Z [2024-05-25T01:56:00.113+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:56:00.125986659Z [2024-05-25T01:56:00.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:56:00+00:00, run_after=2024-05-25T01:57:00+00:00 2024-05-25T01:56:00.193533035Z [2024-05-25T01:56:00.192+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:56:00.193576414Z 2024-05-25T01:56:00.193586788Z 2024-05-25T01:56:00.193595354Z 2024-05-25T01:56:00.193604061Z 2024-05-25T01:56:00.194054724Z [2024-05-25T01:56:00.193+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:56:00.194548146Z [2024-05-25T01:56:00.194+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:56:00.194856205Z [2024-05-25T01:56:00.194+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:56:00.195320857Z [2024-05-25T01:56:00.195+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:56:00.196777056Z [2024-05-25T01:56:00.196+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:56:00.196807521Z 2024-05-25T01:56:00.196818931Z 2024-05-25T01:56:00.196828157Z 2024-05-25T01:56:00.196837165Z 2024-05-25T01:56:00.205719793Z [2024-05-25T01:56:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:56:00.205952195Z [2024-05-25T01:56:00.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:56:00.206487156Z [2024-05-25T01:56:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:56:00.206816588Z [2024-05-25T01:56:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:56:00.207316678Z [2024-05-25T01:56:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:56:00.207518495Z [2024-05-25T01:56:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:56:00.207996766Z [2024-05-25T01:56:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:56:00.208317544Z [2024-05-25T01:56:00.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:56:00.616993843Z [2024-05-25T01:56:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:54:00+00:00 exited with status queued for try_number 1 2024-05-25T01:56:00.617146006Z [2024-05-25T01:56:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status queued for try_number 1 2024-05-25T01:56:00.617308028Z [2024-05-25T01:56:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status queued for try_number 1 2024-05-25T01:56:00.617414449Z [2024-05-25T01:56:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status queued for try_number 1 2024-05-25T01:56:00.625474325Z [2024-05-25T01:56:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99844316-e572-495c-a0e7-e22d56d635be 2024-05-25T01:56:00.625751483Z [2024-05-25T01:56:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8ff066d-9457-45a0-975b-9d3a597c0ad2 2024-05-25T01:56:00.625952051Z [2024-05-25T01:56:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9a1f90f-93c8-4354-94ab-55067cfe4dd6 2024-05-25T01:56:00.626161961Z [2024-05-25T01:56:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdd5d95f-88a2-44f6-aae0-ce307a5deca0 2024-05-25T01:56:01.791894973Z [2024-05-25T01:56:01.791+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:56:01.794416431Z [2024-05-25T01:56:01.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:54:00+00:00, run_id=scheduled__2024-05-25T01:54:00+00:00, run_start_date=2024-05-25 01:56:00.135859+00:00, run_end_date=2024-05-25 01:56:01.791798+00:00, run_duration=1.655939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:54:00+00:00, data_interval_end=2024-05-25 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:56:01.805058213Z [2024-05-25T01:56:01.804+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:56:00+00:00, run_after=2024-05-25T01:58:00+00:00 2024-05-25T01:56:01.955557950Z [2024-05-25T01:56:01.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:54:00+00:00 exited with status success for try_number 1 2024-05-25T01:56:01.964938399Z [2024-05-25T01:56:01.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:54:00+00:00, map_index=-1, run_start_date=2024-05-25 01:56:01.050672+00:00, run_end_date=2024-05-25 01:56:01.691097+00:00, run_duration=0.640425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=788, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:56:00.199841+00:00, queued_by_job_id=1, pid=11627 2024-05-25T01:56:03.030367636Z [2024-05-25T01:56:03.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:56:03.030514836Z [2024-05-25T01:56:03.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:55:00+00:00, run_id=scheduled__2024-05-25T01:55:00+00:00, run_start_date=2024-05-25 01:56:00.137079+00:00, run_end_date=2024-05-25 01:56:03.030208+00:00, run_duration=2.893129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:55:00+00:00, data_interval_end=2024-05-25 01:56:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:56:03.042253169Z [2024-05-25T01:56:03.041+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:56:00+00:00, run_after=2024-05-25T01:57:00+00:00 2024-05-25T01:56:03.104757384Z [2024-05-25T01:56:03.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status success for try_number 1 2024-05-25T01:56:03.114113347Z [2024-05-25T01:56:03.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:55:00+00:00, map_index=-1, run_start_date=2024-05-25 01:56:01.265121+00:00, run_end_date=2024-05-25 01:56:01.908051+00:00, run_duration=0.64293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=789, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:56:00.199841+00:00, queued_by_job_id=1, pid=11628 2024-05-25T01:56:05.249878555Z [2024-05-25T01:56:05.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:56:05.250469963Z [2024-05-25T01:56:05.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:55:00+00:00, run_id=scheduled__2024-05-25T01:55:00+00:00, run_start_date=2024-05-25 01:56:00.138085+00:00, run_end_date=2024-05-25 01:56:05.249775+00:00, run_duration=5.11169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:55:00+00:00, data_interval_end=2024-05-25 01:56:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:56:05.264026683Z [2024-05-25T01:56:05.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:56:00+00:00, run_after=2024-05-25T01:57:00+00:00 2024-05-25T01:56:05.271055026Z [2024-05-25T01:56:05.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:56:05.271168152Z [2024-05-25T01:56:05.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:55:00+00:00, run_id=scheduled__2024-05-25T01:55:00+00:00, run_start_date=2024-05-25 01:56:00.138962+00:00, run_end_date=2024-05-25 01:56:05.270868+00:00, run_duration=5.131906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:55:00+00:00, data_interval_end=2024-05-25 01:56:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:56:05.279781113Z [2024-05-25T01:56:05.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:56:00+00:00, run_after=2024-05-25T01:57:00+00:00 2024-05-25T01:56:05.319353712Z [2024-05-25T01:56:05.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status success for try_number 1 2024-05-25T01:56:05.319849989Z [2024-05-25T01:56:05.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status success for try_number 1 2024-05-25T01:56:05.336817500Z [2024-05-25T01:56:05.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:55:00+00:00, map_index=-1, run_start_date=2024-05-25 01:56:02.548402+00:00, run_end_date=2024-05-25 01:56:05.115236+00:00, run_duration=2.566834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=791, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:56:00.199841+00:00, queued_by_job_id=1, pid=11652 2024-05-25T01:56:05.337465955Z [2024-05-25T01:56:05.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:55:00+00:00, map_index=-1, run_start_date=2024-05-25 01:56:02.511607+00:00, run_end_date=2024-05-25 01:56:04.439363+00:00, run_duration=1.927756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=790, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:56:00.199841+00:00, queued_by_job_id=1, pid=11651 2024-05-25T01:57:00.063711835Z [2024-05-25T01:57:00.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:57:00+00:00, run_after=2024-05-25T01:58:00+00:00 2024-05-25T01:57:00.078269655Z [2024-05-25T01:57:00.077+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:57:00+00:00, run_after=2024-05-25T01:58:00+00:00 2024-05-25T01:57:00.085125718Z [2024-05-25T01:57:00.084+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:57:00.145377301Z [2024-05-25T01:57:00.144+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:57:00.145415423Z 2024-05-25T01:57:00.145425286Z 2024-05-25T01:57:00.145547912Z 2024-05-25T01:57:00.145560588Z [2024-05-25T01:57:00.145+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:57:00.145590069Z [2024-05-25T01:57:00.145+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:57:00.145671853Z [2024-05-25T01:57:00.145+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:57:00.146324382Z [2024-05-25T01:57:00.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:57:00.146420042Z 2024-05-25T01:57:00.146430099Z 2024-05-25T01:57:00.146438808Z 2024-05-25T01:57:00.149325543Z [2024-05-25T01:57:00.148+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:57:00.149397095Z [2024-05-25T01:57:00.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:57:00.149664940Z [2024-05-25T01:57:00.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:57:00.149724863Z [2024-05-25T01:57:00.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:57:00.150032215Z [2024-05-25T01:57:00.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:57:00.150097185Z [2024-05-25T01:57:00.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:57:00.351030025Z [2024-05-25T01:57:00.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:56:00+00:00 exited with status queued for try_number 1 2024-05-25T01:57:00.351251234Z [2024-05-25T01:57:00.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:56:00+00:00 exited with status queued for try_number 1 2024-05-25T01:57:00.351440414Z [2024-05-25T01:57:00.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:56:00+00:00 exited with status queued for try_number 1 2024-05-25T01:57:00.370345451Z [2024-05-25T01:57:00.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f511393-e5c1-4e4b-ab28-0fc455a678a6 2024-05-25T01:57:00.370605665Z [2024-05-25T01:57:00.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9296e9a-b2c5-4f8a-a05e-279265996fd4 2024-05-25T01:57:00.370822989Z [2024-05-25T01:57:00.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c12232a-40e7-4534-a8f4-ba2887aa8676 2024-05-25T01:57:01.569649905Z [2024-05-25T01:57:01.568+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:57:01.570011169Z [2024-05-25T01:57:01.569+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:56:00+00:00, run_id=scheduled__2024-05-25T01:56:00+00:00, run_start_date=2024-05-25 01:57:00.098125+00:00, run_end_date=2024-05-25 01:57:01.569541+00:00, run_duration=1.471416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:56:00+00:00, data_interval_end=2024-05-25 01:57:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:57:01.581922320Z [2024-05-25T01:57:01.581+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:57:00+00:00, run_after=2024-05-25T01:58:00+00:00 2024-05-25T01:57:01.651993758Z [2024-05-25T01:57:01.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:56:00+00:00 exited with status success for try_number 1 2024-05-25T01:57:01.659220702Z [2024-05-25T01:57:01.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:56:00+00:00, map_index=-1, run_start_date=2024-05-25 01:57:00.918772+00:00, run_end_date=2024-05-25 01:57:01.297491+00:00, run_duration=0.378719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=792, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:57:00.146883+00:00, queued_by_job_id=1, pid=11684 2024-05-25T01:57:03.810464702Z [2024-05-25T01:57:03.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:57:03.811117447Z [2024-05-25T01:57:03.810+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:56:00+00:00, run_id=scheduled__2024-05-25T01:56:00+00:00, run_start_date=2024-05-25 01:57:00.099247+00:00, run_end_date=2024-05-25 01:57:03.810231+00:00, run_duration=3.710984, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:56:00+00:00, data_interval_end=2024-05-25 01:57:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:57:03.832761326Z [2024-05-25T01:57:03.832+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:57:00+00:00, run_after=2024-05-25T01:58:00+00:00 2024-05-25T01:57:03.862559792Z [2024-05-25T01:57:03.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:57:03.862913909Z [2024-05-25T01:57:03.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:56:00+00:00, run_id=scheduled__2024-05-25T01:56:00+00:00, run_start_date=2024-05-25 01:57:00.100276+00:00, run_end_date=2024-05-25 01:57:03.862529+00:00, run_duration=3.762253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:56:00+00:00, data_interval_end=2024-05-25 01:57:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:57:03.882952065Z [2024-05-25T01:57:03.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:57:00+00:00, run_after=2024-05-25T01:58:00+00:00 2024-05-25T01:57:03.934698125Z [2024-05-25T01:57:03.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:56:00+00:00 exited with status success for try_number 1 2024-05-25T01:57:03.934739240Z [2024-05-25T01:57:03.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:56:00+00:00 exited with status success for try_number 1 2024-05-25T01:57:03.956128100Z [2024-05-25T01:57:03.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:56:00+00:00, map_index=-1, run_start_date=2024-05-25 01:57:02.027672+00:00, run_end_date=2024-05-25 01:57:03.244361+00:00, run_duration=1.216689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=793, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:57:00.146883+00:00, queued_by_job_id=1, pid=11702 2024-05-25T01:57:03.956554809Z [2024-05-25T01:57:03.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:56:00+00:00, map_index=-1, run_start_date=2024-05-25 01:57:02.068401+00:00, run_end_date=2024-05-25 01:57:03.592391+00:00, run_duration=1.52399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=794, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:57:00.146883+00:00, queued_by_job_id=1, pid=11703 2024-05-25T01:58:01.021483081Z [2024-05-25T01:58:01.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:58:00+00:00, run_after=2024-05-25T01:59:00+00:00 2024-05-25T01:58:01.032937451Z [2024-05-25T01:58:01.032+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:58:01.055400987Z [2024-05-25T01:58:01.054+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:58:00+00:00, run_after=2024-05-25T01:59:00+00:00 2024-05-25T01:58:01.069797082Z [2024-05-25T01:58:01.064+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:58:01.138200010Z [2024-05-25T01:58:01.137+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T01:58:01.138226556Z 2024-05-25T01:58:01.138232158Z 2024-05-25T01:58:01.138235969Z 2024-05-25T01:58:01.138239611Z 2024-05-25T01:58:01.138464160Z [2024-05-25T01:58:01.138+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T01:58:01.138776071Z [2024-05-25T01:58:01.138+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:58:01.139345175Z [2024-05-25T01:58:01.139+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:58:01.139624352Z [2024-05-25T01:58:01.139+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:58:01.140640493Z [2024-05-25T01:58:01.140+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:58:01.140673332Z 2024-05-25T01:58:01.140677850Z 2024-05-25T01:58:01.140681566Z 2024-05-25T01:58:01.140685403Z 2024-05-25T01:58:01.145301297Z [2024-05-25T01:58:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:58:01.145499733Z [2024-05-25T01:58:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:58:01.145803425Z [2024-05-25T01:58:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:58:01.145977250Z [2024-05-25T01:58:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:58:01.146262953Z [2024-05-25T01:58:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:58:01.146419083Z [2024-05-25T01:58:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:58:01.146682595Z [2024-05-25T01:58:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:58:01.146842202Z [2024-05-25T01:58:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:58:01.527859373Z [2024-05-25T01:58:01.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:56:00+00:00 exited with status queued for try_number 1 2024-05-25T01:58:01.527924625Z [2024-05-25T01:58:01.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:57:00+00:00 exited with status queued for try_number 1 2024-05-25T01:58:01.528067693Z [2024-05-25T01:58:01.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:57:00+00:00 exited with status queued for try_number 1 2024-05-25T01:58:01.528161990Z [2024-05-25T01:58:01.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:57:00+00:00 exited with status queued for try_number 1 2024-05-25T01:58:01.543080027Z [2024-05-25T01:58:01.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to a93055b1-b42f-4f9e-8cb5-9394cbe013c1 2024-05-25T01:58:01.543429438Z [2024-05-25T01:58:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f5f946b-0d05-4a96-901d-7fb9ed480596 2024-05-25T01:58:01.543652028Z [2024-05-25T01:58:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to 549461c5-bf9d-4ddf-a578-d6f1b7989595 2024-05-25T01:58:01.544441226Z [2024-05-25T01:58:01.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83f931d2-4f85-4636-a199-ecae8014c88b 2024-05-25T01:58:02.778960567Z [2024-05-25T01:58:02.778+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:58:02.779665603Z [2024-05-25T01:58:02.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:56:00+00:00, run_id=scheduled__2024-05-25T01:56:00+00:00, run_start_date=2024-05-25 01:58:01.075533+00:00, run_end_date=2024-05-25 01:58:02.779086+00:00, run_duration=1.703553, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:56:00+00:00, data_interval_end=2024-05-25 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T01:58:02.791639602Z [2024-05-25T01:58:02.791+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T01:58:00+00:00, run_after=2024-05-25T02:00:00+00:00 2024-05-25T01:58:02.803345999Z [2024-05-25T01:58:02.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:58:02.803827984Z [2024-05-25T01:58:02.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:57:00+00:00, run_id=scheduled__2024-05-25T01:57:00+00:00, run_start_date=2024-05-25 01:58:01.076954+00:00, run_end_date=2024-05-25 01:58:02.803255+00:00, run_duration=1.726301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:57:00+00:00, data_interval_end=2024-05-25 01:58:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:58:02.813646538Z [2024-05-25T01:58:02.813+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:58:00+00:00, run_after=2024-05-25T01:59:00+00:00 2024-05-25T01:58:02.865711285Z [2024-05-25T01:58:02.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:56:00+00:00 exited with status success for try_number 1 2024-05-25T01:58:02.866203194Z [2024-05-25T01:58:02.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:57:00+00:00 exited with status success for try_number 1 2024-05-25T01:58:02.875531599Z [2024-05-25T01:58:02.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:56:00+00:00, map_index=-1, run_start_date=2024-05-25 01:58:02.123312+00:00, run_end_date=2024-05-25 01:58:02.559297+00:00, run_duration=0.435985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=796, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:58:01.142281+00:00, queued_by_job_id=1, pid=11737 2024-05-25T01:58:02.876039687Z [2024-05-25T01:58:02.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:57:00+00:00, map_index=-1, run_start_date=2024-05-25 01:58:02.098375+00:00, run_end_date=2024-05-25 01:58:02.650649+00:00, run_duration=0.552274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=795, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:58:01.142281+00:00, queued_by_job_id=1, pid=11736 2024-05-25T01:58:05.021338793Z [2024-05-25T01:58:05.020+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:58:05.022085624Z [2024-05-25T01:58:05.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:57:00+00:00, run_id=scheduled__2024-05-25T01:57:00+00:00, run_start_date=2024-05-25 01:58:01.077993+00:00, run_end_date=2024-05-25 01:58:05.021115+00:00, run_duration=3.943122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:57:00+00:00, data_interval_end=2024-05-25 01:58:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:58:05.034387829Z [2024-05-25T01:58:05.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:58:00+00:00, run_after=2024-05-25T01:59:00+00:00 2024-05-25T01:58:05.101775946Z [2024-05-25T01:58:05.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:57:00+00:00 exited with status success for try_number 1 2024-05-25T01:58:05.106911467Z [2024-05-25T01:58:05.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:57:00+00:00, map_index=-1, run_start_date=2024-05-25 01:58:03.298645+00:00, run_end_date=2024-05-25 01:58:04.669169+00:00, run_duration=1.370524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=798, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:58:01.142281+00:00, queued_by_job_id=1, pid=11760 2024-05-25T01:58:06.175825413Z [2024-05-25T01:58:06.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:58:06.176425437Z [2024-05-25T01:58:06.176+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:57:00+00:00, run_id=scheduled__2024-05-25T01:57:00+00:00, run_start_date=2024-05-25 01:58:01.079000+00:00, run_end_date=2024-05-25 01:58:06.175678+00:00, run_duration=5.096678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:57:00+00:00, data_interval_end=2024-05-25 01:58:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:58:06.189409104Z [2024-05-25T01:58:06.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:58:00+00:00, run_after=2024-05-25T01:59:00+00:00 2024-05-25T01:58:06.241280198Z [2024-05-25T01:58:06.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:57:00+00:00 exited with status success for try_number 1 2024-05-25T01:58:06.249822998Z [2024-05-25T01:58:06.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:57:00+00:00, map_index=-1, run_start_date=2024-05-25 01:58:03.320267+00:00, run_end_date=2024-05-25 01:58:05.184102+00:00, run_duration=1.863835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=797, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:58:01.142281+00:00, queued_by_job_id=1, pid=11761 2024-05-25T01:59:00.398856924Z [2024-05-25T01:59:00.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:59:00+00:00, run_after=2024-05-25T02:00:00+00:00 2024-05-25T01:59:00.415139445Z [2024-05-25T01:59:00.414+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:59:00+00:00, run_after=2024-05-25T02:00:00+00:00 2024-05-25T01:59:00.423864829Z [2024-05-25T01:59:00.423+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T01:59:00.510835276Z [2024-05-25T01:59:00.510+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T01:59:00.510862534Z 2024-05-25T01:59:00.510866169Z 2024-05-25T01:59:00.510869427Z 2024-05-25T01:59:00.511008044Z [2024-05-25T01:59:00.510+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:59:00.511199920Z [2024-05-25T01:59:00.511+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T01:59:00.511354186Z [2024-05-25T01:59:00.511+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T01:59:00.512025336Z [2024-05-25T01:59:00.511+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T01:59:00.512036937Z 2024-05-25T01:59:00.512040878Z 2024-05-25T01:59:00.512068366Z 2024-05-25T01:59:00.516826540Z [2024-05-25T01:59:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:59:00.516994376Z [2024-05-25T01:59:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:59:00.517325319Z [2024-05-25T01:59:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:59:00.517504774Z [2024-05-25T01:59:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:59:00.517768030Z [2024-05-25T01:59:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T01:59:00.517914038Z [2024-05-25T01:59:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:59:00.761347540Z [2024-05-25T01:59:00.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:58:00+00:00 exited with status queued for try_number 1 2024-05-25T01:59:00.761542733Z [2024-05-25T01:59:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:58:00+00:00 exited with status queued for try_number 1 2024-05-25T01:59:00.761779780Z [2024-05-25T01:59:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:58:00+00:00 exited with status queued for try_number 1 2024-05-25T01:59:00.768453229Z [2024-05-25T01:59:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49ab3095-2258-4181-8ff0-d5ab40f95f56 2024-05-25T01:59:00.768687430Z [2024-05-25T01:59:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb7985b4-3113-4447-8a16-c3d8cf1a72b7 2024-05-25T01:59:00.769006825Z [2024-05-25T01:59:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ba5acac-905f-4d64-88bd-7f8076f0693a 2024-05-25T01:59:01.892336211Z [2024-05-25T01:59:01.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:59:01.892651641Z [2024-05-25T01:59:01.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:58:00+00:00, run_id=scheduled__2024-05-25T01:58:00+00:00, run_start_date=2024-05-25 01:59:00.441023+00:00, run_end_date=2024-05-25 01:59:01.892311+00:00, run_duration=1.451288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:58:00+00:00, data_interval_end=2024-05-25 01:59:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T01:59:01.901749123Z [2024-05-25T01:59:01.901+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T01:59:00+00:00, run_after=2024-05-25T02:00:00+00:00 2024-05-25T01:59:01.958394061Z [2024-05-25T01:59:01.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:58:00+00:00 exited with status success for try_number 1 2024-05-25T01:59:01.970097325Z [2024-05-25T01:59:01.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:58:00+00:00, map_index=-1, run_start_date=2024-05-25 01:59:01.347718+00:00, run_end_date=2024-05-25 01:59:01.793936+00:00, run_duration=0.446218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=799, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:59:00.512770+00:00, queued_by_job_id=1, pid=11794 2024-05-25T01:59:04.770500251Z [2024-05-25T01:59:04.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:59:04.770903618Z [2024-05-25T01:59:04.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:58:00+00:00, run_id=scheduled__2024-05-25T01:58:00+00:00, run_start_date=2024-05-25 01:59:00.442815+00:00, run_end_date=2024-05-25 01:59:04.770293+00:00, run_duration=4.327478, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:58:00+00:00, data_interval_end=2024-05-25 01:59:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T01:59:04.782599276Z [2024-05-25T01:59:04.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:59:00+00:00, run_after=2024-05-25T02:00:00+00:00 2024-05-25T01:59:04.839706298Z [2024-05-25T01:59:04.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:58:00+00:00 exited with status success for try_number 1 2024-05-25T01:59:04.848753195Z [2024-05-25T01:59:04.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:58:00+00:00, map_index=-1, run_start_date=2024-05-25 01:59:02.496318+00:00, run_end_date=2024-05-25 01:59:03.823053+00:00, run_duration=1.326735, state=success, executor_state=success, try_number=1, max_tries=1, job_id=801, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:59:00.512770+00:00, queued_by_job_id=1, pid=11813 2024-05-25T01:59:05.900048463Z [2024-05-25T01:59:05.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T01:59:05.900560600Z [2024-05-25T01:59:05.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:58:00+00:00, run_id=scheduled__2024-05-25T01:58:00+00:00, run_start_date=2024-05-25 01:59:00.444279+00:00, run_end_date=2024-05-25 01:59:05.899883+00:00, run_duration=5.455604, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:58:00+00:00, data_interval_end=2024-05-25 01:59:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T01:59:05.911607421Z [2024-05-25T01:59:05.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T01:59:00+00:00, run_after=2024-05-25T02:00:00+00:00 2024-05-25T01:59:05.966228927Z [2024-05-25T01:59:05.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:58:00+00:00 exited with status success for try_number 1 2024-05-25T01:59:05.974966680Z [2024-05-25T01:59:05.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:58:00+00:00, map_index=-1, run_start_date=2024-05-25 01:59:02.478206+00:00, run_end_date=2024-05-25 01:59:04.820634+00:00, run_duration=2.342428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=800, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 01:59:00.512770+00:00, queued_by_job_id=1, pid=11812 2024-05-25T02:00:00.867788066Z [2024-05-25T02:00:00.867+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:00:00+00:00, run_after=2024-05-25T02:01:00+00:00 2024-05-25T02:00:00.881043017Z [2024-05-25T02:00:00.880+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:00:00.898468502Z [2024-05-25T02:00:00.897+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:00:00.922586510Z [2024-05-25T02:00:00.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:00:00+00:00, run_after=2024-05-25T02:05:00+00:00 2024-05-25T02:00:00.941428699Z [2024-05-25T02:00:00.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:00:00+00:00, run_after=2024-05-25T02:01:00+00:00 2024-05-25T02:00:01.060142957Z [2024-05-25T02:00:01.059+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T02:00:01.060175522Z 2024-05-25T02:00:01.060182054Z 2024-05-25T02:00:01.060193144Z 2024-05-25T02:00:01.060198929Z 2024-05-25T02:00:01.060251552Z 2024-05-25T02:00:01.060572997Z [2024-05-25T02:00:01.060+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:00:01.061192543Z [2024-05-25T02:00:01.060+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:00:01.061479812Z [2024-05-25T02:00:01.061+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:00:01.061708073Z [2024-05-25T02:00:01.061+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:00:01.061945022Z [2024-05-25T02:00:01.061+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:00:01.063009620Z [2024-05-25T02:00:01.062+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:00:01.063019184Z 2024-05-25T02:00:01.063023198Z 2024-05-25T02:00:01.063026510Z 2024-05-25T02:00:01.063030027Z 2024-05-25T02:00:01.063033157Z 2024-05-25T02:00:01.069726289Z [2024-05-25T02:00:01.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T02:00:01.069800185Z [2024-05-25T02:00:01.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:00:01.070181892Z [2024-05-25T02:00:01.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:00:01.070360763Z [2024-05-25T02:00:01.070+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:00:01.070666946Z [2024-05-25T02:00:01.070+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:00:01.070789674Z [2024-05-25T02:00:01.070+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:00:01.071168720Z [2024-05-25T02:00:01.070+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:00:01.071372807Z [2024-05-25T02:00:01.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:00:01.071752911Z [2024-05-25T02:00:01.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:00:01.071916485Z [2024-05-25T02:00:01.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:00:01.578764070Z [2024-05-25T02:00:01.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status queued for try_number 1 2024-05-25T02:00:01.578898276Z [2024-05-25T02:00:01.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:58:00+00:00 exited with status queued for try_number 1 2024-05-25T02:00:01.579019742Z [2024-05-25T02:00:01.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:59:00+00:00 exited with status queued for try_number 1 2024-05-25T02:00:01.579138694Z [2024-05-25T02:00:01.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:59:00+00:00 exited with status queued for try_number 1 2024-05-25T02:00:01.579211696Z [2024-05-25T02:00:01.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:59:00+00:00 exited with status queued for try_number 1 2024-05-25T02:00:01.587850072Z [2024-05-25T02:00:01.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7af13175-0d82-469c-a311-c20a5b680f3f 2024-05-25T02:00:01.588006284Z [2024-05-25T02:00:01.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to cee472dd-39c1-4807-b742-84f79cb77465 2024-05-25T02:00:01.588171551Z [2024-05-25T02:00:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0a63bfe-1391-4917-b7cf-141a4ff4502b 2024-05-25T02:00:01.588329806Z [2024-05-25T02:00:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae61086a-8187-49c1-b805-d95aaca280d9 2024-05-25T02:00:01.588474127Z [2024-05-25T02:00:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2232aeb9-7c70-4405-8913-8e598cc92095 2024-05-25T02:00:02.868311946Z [2024-05-25T02:00:02.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:00:02.868675185Z [2024-05-25T02:00:02.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 01:58:00+00:00, run_id=scheduled__2024-05-25T01:58:00+00:00, run_start_date=2024-05-25 02:00:00.957118+00:00, run_end_date=2024-05-25 02:00:02.868331+00:00, run_duration=1.911213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:58:00+00:00, data_interval_end=2024-05-25 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:00:02.878735613Z [2024-05-25T02:00:02.878+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:00:00+00:00, run_after=2024-05-25T02:02:00+00:00 2024-05-25T02:00:02.899370431Z [2024-05-25T02:00:02.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:00:02.899686791Z [2024-05-25T02:00:02.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 01:59:00+00:00, run_id=scheduled__2024-05-25T01:59:00+00:00, run_start_date=2024-05-25 02:00:00.958427+00:00, run_end_date=2024-05-25 02:00:02.899395+00:00, run_duration=1.940968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:59:00+00:00, data_interval_end=2024-05-25 02:00:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:00:02.915676479Z [2024-05-25T02:00:02.915+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:00:00+00:00, run_after=2024-05-25T02:01:00+00:00 2024-05-25T02:00:02.979131452Z [2024-05-25T02:00:02.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T01:58:00+00:00 exited with status success for try_number 1 2024-05-25T02:00:02.979202440Z [2024-05-25T02:00:02.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:59:00+00:00 exited with status success for try_number 1 2024-05-25T02:00:02.985828058Z [2024-05-25T02:00:02.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:59:00+00:00, map_index=-1, run_start_date=2024-05-25 02:00:02.083273+00:00, run_end_date=2024-05-25 02:00:02.598659+00:00, run_duration=0.515386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=803, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:00:01.064884+00:00, queued_by_job_id=1, pid=11848 2024-05-25T02:00:02.986028409Z [2024-05-25T02:00:02.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T01:58:00+00:00, map_index=-1, run_start_date=2024-05-25 02:00:01.873329+00:00, run_end_date=2024-05-25 02:00:02.250325+00:00, run_duration=0.376996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=802, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:00:01.064884+00:00, queued_by_job_id=1, pid=11842 2024-05-25T02:00:04.683277351Z [2024-05-25T02:00:04.682+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:00:04.683309773Z 2024-05-25T02:00:04.683332991Z [2024-05-25T02:00:04.683+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:00:04.684231196Z [2024-05-25T02:00:04.683+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:00:04.684246329Z 2024-05-25T02:00:04.687442239Z [2024-05-25T02:00:04.687+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T02:00:04.687857536Z [2024-05-25T02:00:04.687+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:00:04.774236739Z [2024-05-25T02:00:04.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status queued for try_number 1 2024-05-25T02:00:04.774478472Z [2024-05-25T02:00:04.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status success for try_number 1 2024-05-25T02:00:04.782300389Z [2024-05-25T02:00:04.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to af4e0448-a008-425b-9bc0-bbf9e654f1b7 2024-05-25T02:00:04.782433028Z [2024-05-25T02:00:04.782+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T01:55:00+00:00, map_index=-1, run_start_date=2024-05-25 02:00:03.346829+00:00, run_end_date=2024-05-25 02:00:03.855278+00:00, run_duration=0.508449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=804, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:00:01.064884+00:00, queued_by_job_id=1, pid=11867 2024-05-25T02:00:05.974525168Z [2024-05-25T02:00:05.973+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:00:05.974761786Z [2024-05-25T02:00:05.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:59:00+00:00, run_id=scheduled__2024-05-25T01:59:00+00:00, run_start_date=2024-05-25 02:00:00.959585+00:00, run_end_date=2024-05-25 02:00:05.974406+00:00, run_duration=5.014821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:59:00+00:00, data_interval_end=2024-05-25 02:00:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:00:05.983086068Z [2024-05-25T02:00:05.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:00:00+00:00, run_after=2024-05-25T02:01:00+00:00 2024-05-25T02:00:05.989278651Z [2024-05-25T02:00:05.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:00:05.989500916Z [2024-05-25T02:00:05.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:59:00+00:00, run_id=scheduled__2024-05-25T01:59:00+00:00, run_start_date=2024-05-25 02:00:00.960787+00:00, run_end_date=2024-05-25 02:00:05.989195+00:00, run_duration=5.028408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:59:00+00:00, data_interval_end=2024-05-25 02:00:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:00:06.006408600Z [2024-05-25T02:00:06.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:00:00+00:00, run_after=2024-05-25T02:01:00+00:00 2024-05-25T02:00:06.117544874Z [2024-05-25T02:00:06.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:59:00+00:00 exited with status success for try_number 1 2024-05-25T02:00:06.118950578Z [2024-05-25T02:00:06.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T01:59:00+00:00 exited with status success for try_number 1 2024-05-25T02:00:06.125065384Z [2024-05-25T02:00:06.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:59:00+00:00, map_index=-1, run_start_date=2024-05-25 02:00:03.714924+00:00, run_end_date=2024-05-25 02:00:05.236023+00:00, run_duration=1.521099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=805, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:00:01.064884+00:00, queued_by_job_id=1, pid=11883 2024-05-25T02:00:06.125461503Z [2024-05-25T02:00:06.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T01:59:00+00:00, map_index=-1, run_start_date=2024-05-25 02:00:03.846347+00:00, run_end_date=2024-05-25 02:00:05.606778+00:00, run_duration=1.760431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=806, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:00:01.064884+00:00, queued_by_job_id=1, pid=11884 2024-05-25T02:00:07.254711092Z [2024-05-25T02:00:07.254+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:00:07.254742340Z 2024-05-25T02:00:07.255608353Z [2024-05-25T02:00:07.254+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:00:07.256784030Z [2024-05-25T02:00:07.256+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:00:07.256801533Z 2024-05-25T02:00:07.260366782Z [2024-05-25T02:00:07.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T02:00:07.260847169Z [2024-05-25T02:00:07.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:00:07.388967548Z [2024-05-25T02:00:07.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status queued for try_number 1 2024-05-25T02:00:07.389287621Z [2024-05-25T02:00:07.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status success for try_number 1 2024-05-25T02:00:07.394508924Z [2024-05-25T02:00:07.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to c59101d1-a4ee-4a2a-9e5f-9563b08d9386 2024-05-25T02:00:07.394876521Z [2024-05-25T02:00:07.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T01:55:00+00:00, map_index=-1, run_start_date=2024-05-25 02:00:06.426309+00:00, run_end_date=2024-05-25 02:00:06.784548+00:00, run_duration=0.358239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=807, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:00:04.684696+00:00, queued_by_job_id=1, pid=11912 2024-05-25T02:00:09.368472085Z [2024-05-25T02:00:09.367+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:00:09.368528908Z 2024-05-25T02:00:09.369106357Z [2024-05-25T02:00:09.368+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:00:09.370739132Z [2024-05-25T02:00:09.370+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:00:09.370802024Z 2024-05-25T02:00:09.377732522Z [2024-05-25T02:00:09.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:00:09.378607262Z [2024-05-25T02:00:09.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:00:09.425270091Z [2024-05-25T02:00:09.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status queued for try_number 1 2024-05-25T02:00:09.433579764Z [2024-05-25T02:00:09.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78b812c4-a612-46a0-91b3-cd85864eead0 2024-05-25T02:00:09.516602514Z [2024-05-25T02:00:09.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status success for try_number 1 2024-05-25T02:00:09.524041488Z [2024-05-25T02:00:09.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T01:55:00+00:00, map_index=0, run_start_date=2024-05-25 02:00:08.954877+00:00, run_end_date=2024-05-25 02:00:09.326127+00:00, run_duration=0.37125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=808, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:00:07.257568+00:00, queued_by_job_id=1, pid=11923 2024-05-25T02:00:11.671909573Z [2024-05-25T02:00:11.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:00:11.672595043Z [2024-05-25T02:00:11.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 01:55:00+00:00, run_id=scheduled__2024-05-25T01:55:00+00:00, run_start_date=2024-05-25 02:00:00.955675+00:00, run_end_date=2024-05-25 02:00:11.671945+00:00, run_duration=10.71627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 01:55:00+00:00, data_interval_end=2024-05-25 02:00:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T02:00:11.682170657Z [2024-05-25T02:00:11.681+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:00:00+00:00, run_after=2024-05-25T02:05:00+00:00 2024-05-25T02:00:11.726499567Z [2024-05-25T02:00:11.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T01:55:00+00:00 exited with status success for try_number 1 2024-05-25T02:00:11.734455110Z [2024-05-25T02:00:11.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T01:55:00+00:00, map_index=-1, run_start_date=2024-05-25 02:00:10.954454+00:00, run_end_date=2024-05-25 02:00:11.265571+00:00, run_duration=0.311117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=809, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:00:09.371884+00:00, queued_by_job_id=1, pid=11931 2024-05-25T02:00:29.667522996Z [2024-05-25T02:00:29.666+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T02:01:00.414461435Z [2024-05-25T02:01:00.413+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:01:00.429759874Z [2024-05-25T02:01:00.429+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:01:00+00:00, run_after=2024-05-25T02:02:00+00:00 2024-05-25T02:01:00.447323545Z [2024-05-25T02:01:00.446+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:01:00+00:00, run_after=2024-05-25T02:02:00+00:00 2024-05-25T02:01:00.524046255Z [2024-05-25T02:01:00.523+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:01:00.524204012Z 2024-05-25T02:01:00.524218605Z 2024-05-25T02:01:00.524227964Z 2024-05-25T02:01:00.524236523Z [2024-05-25T02:01:00.523+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:01:00.524319056Z [2024-05-25T02:01:00.523+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:01:00.524351859Z [2024-05-25T02:01:00.524+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:01:00.524953560Z [2024-05-25T02:01:00.524+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:01:00.524988377Z 2024-05-25T02:01:00.524992895Z 2024-05-25T02:01:00.524996155Z 2024-05-25T02:01:00.528996683Z [2024-05-25T02:01:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:01:00.529050618Z [2024-05-25T02:01:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:01:00.529363652Z [2024-05-25T02:01:00.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:01:00.529378778Z [2024-05-25T02:01:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:01:00.529640267Z [2024-05-25T02:01:00.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:01:00.529675469Z [2024-05-25T02:01:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:01:00.833452177Z [2024-05-25T02:01:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status queued for try_number 1 2024-05-25T02:01:00.833566340Z [2024-05-25T02:01:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status queued for try_number 1 2024-05-25T02:01:00.833583835Z [2024-05-25T02:01:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status queued for try_number 1 2024-05-25T02:01:00.843114264Z [2024-05-25T02:01:00.842+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb4ec367-0343-432f-8a0e-92c197a5e9d5 2024-05-25T02:01:00.843241482Z [2024-05-25T02:01:00.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c52775d-27b7-42ca-ae82-880435c508c6 2024-05-25T02:01:00.843406682Z [2024-05-25T02:01:00.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f383bf3-4b63-4265-bc32-87d8749f3881 2024-05-25T02:01:02.065638116Z [2024-05-25T02:01:02.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status success for try_number 1 2024-05-25T02:01:02.071409307Z [2024-05-25T02:01:02.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:00:00+00:00, map_index=-1, run_start_date=2024-05-25 02:01:01.386644+00:00, run_end_date=2024-05-25 02:01:01.870357+00:00, run_duration=0.483713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=810, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:01:00.525720+00:00, queued_by_job_id=1, pid=11940 2024-05-25T02:01:03.120551398Z [2024-05-25T02:01:03.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:01:03.121183961Z [2024-05-25T02:01:03.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:00:00+00:00, run_id=scheduled__2024-05-25T02:00:00+00:00, run_start_date=2024-05-25 02:01:00.461909+00:00, run_end_date=2024-05-25 02:01:03.120731+00:00, run_duration=2.658822, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:00:00+00:00, data_interval_end=2024-05-25 02:01:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:01:03.131158548Z [2024-05-25T02:01:03.130+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:01:00+00:00, run_after=2024-05-25T02:02:00+00:00 2024-05-25T02:01:04.261551686Z [2024-05-25T02:01:04.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:01:04.261623173Z [2024-05-25T02:01:04.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:00:00+00:00, run_id=scheduled__2024-05-25T02:00:00+00:00, run_start_date=2024-05-25 02:01:00.463435+00:00, run_end_date=2024-05-25 02:01:04.259707+00:00, run_duration=3.796272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:00:00+00:00, data_interval_end=2024-05-25 02:01:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:01:04.276713963Z [2024-05-25T02:01:04.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:01:00+00:00, run_after=2024-05-25T02:02:00+00:00 2024-05-25T02:01:04.320899843Z [2024-05-25T02:01:04.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status success for try_number 1 2024-05-25T02:01:04.328304459Z [2024-05-25T02:01:04.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:00:00+00:00, map_index=-1, run_start_date=2024-05-25 02:01:02.530966+00:00, run_end_date=2024-05-25 02:01:04.139287+00:00, run_duration=1.608321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=811, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:01:00.525720+00:00, queued_by_job_id=1, pid=11955 2024-05-25T02:01:05.500881747Z [2024-05-25T02:01:05.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:01:05.501427365Z [2024-05-25T02:01:05.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:00:00+00:00, run_id=scheduled__2024-05-25T02:00:00+00:00, run_start_date=2024-05-25 02:01:00.464638+00:00, run_end_date=2024-05-25 02:01:05.501062+00:00, run_duration=5.036424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:00:00+00:00, data_interval_end=2024-05-25 02:01:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:01:05.510740341Z [2024-05-25T02:01:05.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:01:00+00:00, run_after=2024-05-25T02:02:00+00:00 2024-05-25T02:01:05.562806595Z [2024-05-25T02:01:05.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status success for try_number 1 2024-05-25T02:01:05.570310678Z [2024-05-25T02:01:05.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:00:00+00:00, map_index=-1, run_start_date=2024-05-25 02:01:02.806421+00:00, run_end_date=2024-05-25 02:01:04.914154+00:00, run_duration=2.107733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=812, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:01:00.525720+00:00, queued_by_job_id=1, pid=11959 2024-05-25T02:02:00.322425720Z [2024-05-25T02:02:00.321+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:02:00.333498329Z [2024-05-25T02:02:00.333+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:02:00.350441119Z [2024-05-25T02:02:00.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:02:00+00:00, run_after=2024-05-25T02:03:00+00:00 2024-05-25T02:02:00.366765642Z [2024-05-25T02:02:00.366+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:02:00+00:00, run_after=2024-05-25T02:03:00+00:00 2024-05-25T02:02:00.475889418Z [2024-05-25T02:02:00.475+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:02:00.475912468Z 2024-05-25T02:02:00.475917240Z 2024-05-25T02:02:00.475920548Z 2024-05-25T02:02:00.475923702Z 2024-05-25T02:02:00.476097852Z [2024-05-25T02:02:00.475+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:02:00.476299346Z [2024-05-25T02:02:00.476+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:02:00.476485521Z [2024-05-25T02:02:00.476+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:02:00.476672866Z [2024-05-25T02:02:00.476+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:02:00.477513343Z [2024-05-25T02:02:00.477+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:02:00.477525946Z 2024-05-25T02:02:00.477530745Z 2024-05-25T02:02:00.477534863Z 2024-05-25T02:02:00.477539042Z 2024-05-25T02:02:00.482791590Z [2024-05-25T02:02:00.482+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:02:00.483079566Z [2024-05-25T02:02:00.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:02:00.483519716Z [2024-05-25T02:02:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:02:00.483832666Z [2024-05-25T02:02:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:02:00.484224525Z [2024-05-25T02:02:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:02:00.484476960Z [2024-05-25T02:02:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:02:00.484890404Z [2024-05-25T02:02:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:02:00.485220263Z [2024-05-25T02:02:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:02:00.810886645Z [2024-05-25T02:02:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status queued for try_number 1 2024-05-25T02:02:00.811175183Z [2024-05-25T02:02:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:01:00+00:00 exited with status queued for try_number 1 2024-05-25T02:02:00.811396853Z [2024-05-25T02:02:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:01:00+00:00 exited with status queued for try_number 1 2024-05-25T02:02:00.811630114Z [2024-05-25T02:02:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:01:00+00:00 exited with status queued for try_number 1 2024-05-25T02:02:00.821138016Z [2024-05-25T02:02:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 422fdd51-ad4e-488a-9963-ba3955c43015 2024-05-25T02:02:00.821397997Z [2024-05-25T02:02:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 258062a1-89e8-4c3e-b566-7a1d864cd296 2024-05-25T02:02:00.821606993Z [2024-05-25T02:02:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6373236c-3c64-4912-a8e7-d68cd4ec3ab5 2024-05-25T02:02:00.821817472Z [2024-05-25T02:02:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04a1950d-8135-49a0-af99-ed8faeb83b10 2024-05-25T02:02:01.967881199Z [2024-05-25T02:02:01.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:02:01.968227562Z [2024-05-25T02:02:01.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:00:00+00:00, run_id=scheduled__2024-05-25T02:00:00+00:00, run_start_date=2024-05-25 02:02:00.381098+00:00, run_end_date=2024-05-25 02:02:01.967878+00:00, run_duration=1.58678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:00:00+00:00, data_interval_end=2024-05-25 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:02:01.975384946Z [2024-05-25T02:02:01.975+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:02:00+00:00, run_after=2024-05-25T02:04:00+00:00 2024-05-25T02:02:01.982006565Z [2024-05-25T02:02:01.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:02:01.982314700Z [2024-05-25T02:02:01.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:01:00+00:00, run_id=scheduled__2024-05-25T02:01:00+00:00, run_start_date=2024-05-25 02:02:00.383032+00:00, run_end_date=2024-05-25 02:02:01.982020+00:00, run_duration=1.598988, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:01:00+00:00, data_interval_end=2024-05-25 02:02:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:02:01.994839230Z [2024-05-25T02:02:01.994+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:02:00+00:00, run_after=2024-05-25T02:03:00+00:00 2024-05-25T02:02:02.104794733Z [2024-05-25T02:02:02.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:01:00+00:00 exited with status success for try_number 1 2024-05-25T02:02:02.112304154Z [2024-05-25T02:02:02.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:01:00+00:00, map_index=-1, run_start_date=2024-05-25 02:02:01.497773+00:00, run_end_date=2024-05-25 02:02:01.930529+00:00, run_duration=0.432756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=814, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:02:00.478681+00:00, queued_by_job_id=1, pid=11994 2024-05-25T02:02:03.210458994Z [2024-05-25T02:02:03.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status success for try_number 1 2024-05-25T02:02:03.216221926Z [2024-05-25T02:02:03.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:00:00+00:00, map_index=-1, run_start_date=2024-05-25 02:02:01.425062+00:00, run_end_date=2024-05-25 02:02:01.896944+00:00, run_duration=0.471882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=813, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:02:00.478681+00:00, queued_by_job_id=1, pid=11993 2024-05-25T02:02:04.267144384Z [2024-05-25T02:02:04.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:02:04.267320327Z [2024-05-25T02:02:04.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:01:00+00:00, run_id=scheduled__2024-05-25T02:01:00+00:00, run_start_date=2024-05-25 02:02:00.384691+00:00, run_end_date=2024-05-25 02:02:04.267057+00:00, run_duration=3.882366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:01:00+00:00, data_interval_end=2024-05-25 02:02:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:02:04.276255930Z [2024-05-25T02:02:04.275+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:02:00+00:00, run_after=2024-05-25T02:03:00+00:00 2024-05-25T02:02:04.328702481Z [2024-05-25T02:02:04.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:01:00+00:00 exited with status success for try_number 1 2024-05-25T02:02:04.336868705Z [2024-05-25T02:02:04.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:01:00+00:00, map_index=-1, run_start_date=2024-05-25 02:02:02.621702+00:00, run_end_date=2024-05-25 02:02:04.034544+00:00, run_duration=1.412842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=815, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:02:00.478681+00:00, queued_by_job_id=1, pid=12017 2024-05-25T02:02:05.373783876Z [2024-05-25T02:02:05.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:02:05.373822776Z [2024-05-25T02:02:05.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:01:00+00:00, run_id=scheduled__2024-05-25T02:01:00+00:00, run_start_date=2024-05-25 02:02:00.386216+00:00, run_end_date=2024-05-25 02:02:05.373122+00:00, run_duration=4.986906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:01:00+00:00, data_interval_end=2024-05-25 02:02:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:02:05.382936346Z [2024-05-25T02:02:05.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:02:00+00:00, run_after=2024-05-25T02:03:00+00:00 2024-05-25T02:02:05.423797990Z [2024-05-25T02:02:05.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:01:00+00:00 exited with status success for try_number 1 2024-05-25T02:02:05.431443949Z [2024-05-25T02:02:05.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:01:00+00:00, map_index=-1, run_start_date=2024-05-25 02:02:02.628151+00:00, run_end_date=2024-05-25 02:02:04.831205+00:00, run_duration=2.203054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=816, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:02:00.478681+00:00, queued_by_job_id=1, pid=12018 2024-05-25T02:03:00.070974133Z [2024-05-25T02:03:00.070+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:03:00.094294505Z [2024-05-25T02:03:00.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:03:00+00:00, run_after=2024-05-25T02:04:00+00:00 2024-05-25T02:03:00.111086491Z [2024-05-25T02:03:00.110+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:03:00+00:00, run_after=2024-05-25T02:04:00+00:00 2024-05-25T02:03:00.206280953Z [2024-05-25T02:03:00.205+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:03:00.206315581Z 2024-05-25T02:03:00.206321606Z 2024-05-25T02:03:00.206327174Z 2024-05-25T02:03:00.206794113Z [2024-05-25T02:03:00.206+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:03:00.207280630Z [2024-05-25T02:03:00.207+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:03:00.207756239Z [2024-05-25T02:03:00.207+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:03:00.209020161Z [2024-05-25T02:03:00.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:03:00.209041316Z 2024-05-25T02:03:00.209048633Z 2024-05-25T02:03:00.209055255Z 2024-05-25T02:03:00.214374917Z [2024-05-25T02:03:00.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:03:00.215024082Z [2024-05-25T02:03:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:03:00.215821757Z [2024-05-25T02:03:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:03:00.216209585Z [2024-05-25T02:03:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:03:00.216670982Z [2024-05-25T02:03:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:03:00.217027268Z [2024-05-25T02:03:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:03:00.446569245Z [2024-05-25T02:03:00.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:02:00+00:00 exited with status queued for try_number 1 2024-05-25T02:03:00.446654514Z [2024-05-25T02:03:00.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:02:00+00:00 exited with status queued for try_number 1 2024-05-25T02:03:00.446676852Z [2024-05-25T02:03:00.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:02:00+00:00 exited with status queued for try_number 1 2024-05-25T02:03:00.458916300Z [2024-05-25T02:03:00.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08cb6839-ac0a-41b7-99c9-da1221cc10cd 2024-05-25T02:03:00.459119575Z [2024-05-25T02:03:00.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to c83e35fe-d978-4e89-b751-67126b5ca301 2024-05-25T02:03:00.459359895Z [2024-05-25T02:03:00.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7771a0ac-66ff-4c4d-bdb8-cac07e4768b6 2024-05-25T02:03:01.643157950Z [2024-05-25T02:03:01.642+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:03:01.643921615Z [2024-05-25T02:03:01.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:02:00+00:00, run_id=scheduled__2024-05-25T02:02:00+00:00, run_start_date=2024-05-25 02:03:00.124240+00:00, run_end_date=2024-05-25 02:03:01.643353+00:00, run_duration=1.519113, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:02:00+00:00, data_interval_end=2024-05-25 02:03:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:03:01.656633265Z [2024-05-25T02:03:01.656+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:03:00+00:00, run_after=2024-05-25T02:04:00+00:00 2024-05-25T02:03:01.702639247Z [2024-05-25T02:03:01.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:02:00+00:00 exited with status success for try_number 1 2024-05-25T02:03:01.708175294Z [2024-05-25T02:03:01.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:02:00+00:00, map_index=-1, run_start_date=2024-05-25 02:03:00.933897+00:00, run_end_date=2024-05-25 02:03:01.335173+00:00, run_duration=0.401276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=817, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:03:00.210605+00:00, queued_by_job_id=1, pid=12050 2024-05-25T02:03:05.037623661Z [2024-05-25T02:03:05.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:03:05.039215142Z [2024-05-25T02:03:05.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:02:00+00:00, run_id=scheduled__2024-05-25T02:02:00+00:00, run_start_date=2024-05-25 02:03:00.125779+00:00, run_end_date=2024-05-25 02:03:05.038387+00:00, run_duration=4.912608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:02:00+00:00, data_interval_end=2024-05-25 02:03:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:03:05.055937385Z [2024-05-25T02:03:05.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:03:00+00:00, run_after=2024-05-25T02:04:00+00:00 2024-05-25T02:03:05.064834985Z [2024-05-25T02:03:05.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:03:05.065025650Z [2024-05-25T02:03:05.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:02:00+00:00, run_id=scheduled__2024-05-25T02:02:00+00:00, run_start_date=2024-05-25 02:03:00.127086+00:00, run_end_date=2024-05-25 02:03:05.064634+00:00, run_duration=4.937548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:02:00+00:00, data_interval_end=2024-05-25 02:03:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:03:05.074722136Z [2024-05-25T02:03:05.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:03:00+00:00, run_after=2024-05-25T02:04:00+00:00 2024-05-25T02:03:05.116000274Z [2024-05-25T02:03:05.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:02:00+00:00 exited with status success for try_number 1 2024-05-25T02:03:05.116082239Z [2024-05-25T02:03:05.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:02:00+00:00 exited with status success for try_number 1 2024-05-25T02:03:05.123407100Z [2024-05-25T02:03:05.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:02:00+00:00, map_index=-1, run_start_date=2024-05-25 02:03:01.954786+00:00, run_end_date=2024-05-25 02:03:04.445871+00:00, run_duration=2.491085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=818, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:03:00.210605+00:00, queued_by_job_id=1, pid=12068 2024-05-25T02:03:05.123487937Z [2024-05-25T02:03:05.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:02:00+00:00, map_index=-1, run_start_date=2024-05-25 02:03:01.973922+00:00, run_end_date=2024-05-25 02:03:04.617374+00:00, run_duration=2.643452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=819, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:03:00.210605+00:00, queued_by_job_id=1, pid=12069 2024-05-25T02:04:00.710184235Z [2024-05-25T02:04:00.709+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:04:00.719693643Z [2024-05-25T02:04:00.719+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:04:00.736302641Z [2024-05-25T02:04:00.735+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:04:00+00:00, run_after=2024-05-25T02:05:00+00:00 2024-05-25T02:04:00.750893214Z [2024-05-25T02:04:00.750+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:04:00+00:00, run_after=2024-05-25T02:05:00+00:00 2024-05-25T02:04:00.847330158Z [2024-05-25T02:04:00.846+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:04:00.847382092Z 2024-05-25T02:04:00.847395674Z 2024-05-25T02:04:00.847402305Z 2024-05-25T02:04:00.847408902Z 2024-05-25T02:04:00.847922526Z [2024-05-25T02:04:00.847+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:04:00.848262944Z [2024-05-25T02:04:00.848+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:04:00.848577851Z [2024-05-25T02:04:00.848+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:04:00.848919308Z [2024-05-25T02:04:00.848+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:04:00.850071892Z [2024-05-25T02:04:00.849+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:04:00.850093616Z 2024-05-25T02:04:00.850105579Z 2024-05-25T02:04:00.850111282Z 2024-05-25T02:04:00.850116575Z 2024-05-25T02:04:00.855985529Z [2024-05-25T02:04:00.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:04:00.856268605Z [2024-05-25T02:04:00.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:04:00.856643763Z [2024-05-25T02:04:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:04:00.856886622Z [2024-05-25T02:04:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:04:00.857252690Z [2024-05-25T02:04:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:04:00.857489977Z [2024-05-25T02:04:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:04:00.857867382Z [2024-05-25T02:04:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:04:00.858177912Z [2024-05-25T02:04:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:04:01.316169788Z [2024-05-25T02:04:01.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:02:00+00:00 exited with status queued for try_number 1 2024-05-25T02:04:01.316395444Z [2024-05-25T02:04:01.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:03:00+00:00 exited with status queued for try_number 1 2024-05-25T02:04:01.316567959Z [2024-05-25T02:04:01.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:03:00+00:00 exited with status queued for try_number 1 2024-05-25T02:04:01.316724732Z [2024-05-25T02:04:01.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:03:00+00:00 exited with status queued for try_number 1 2024-05-25T02:04:01.340283581Z [2024-05-25T02:04:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c5effea-77d9-47cc-98e9-a9205691a55a 2024-05-25T02:04:01.340317238Z [2024-05-25T02:04:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ff3a04e-0d1c-4546-8cda-a9f5f678a1a1 2024-05-25T02:04:01.340340377Z [2024-05-25T02:04:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf8e4485-a5ef-462c-8150-b48e148c2a63 2024-05-25T02:04:01.340344083Z [2024-05-25T02:04:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d490242-6d09-4822-b3c9-b8b009b25a93 2024-05-25T02:04:02.634965708Z [2024-05-25T02:04:02.634+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:04:02.635354812Z [2024-05-25T02:04:02.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:02:00+00:00, run_id=scheduled__2024-05-25T02:02:00+00:00, run_start_date=2024-05-25 02:04:00.763781+00:00, run_end_date=2024-05-25 02:04:02.634811+00:00, run_duration=1.87103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:02:00+00:00, data_interval_end=2024-05-25 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:04:02.642567472Z [2024-05-25T02:04:02.642+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:04:00+00:00, run_after=2024-05-25T02:06:00+00:00 2024-05-25T02:04:02.648615181Z [2024-05-25T02:04:02.648+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:04:02.648836677Z [2024-05-25T02:04:02.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:03:00+00:00, run_id=scheduled__2024-05-25T02:03:00+00:00, run_start_date=2024-05-25 02:04:00.765607+00:00, run_end_date=2024-05-25 02:04:02.648541+00:00, run_duration=1.882934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:03:00+00:00, data_interval_end=2024-05-25 02:04:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:04:02.658549808Z [2024-05-25T02:04:02.658+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:04:00+00:00, run_after=2024-05-25T02:05:00+00:00 2024-05-25T02:04:02.740959472Z [2024-05-25T02:04:02.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:02:00+00:00 exited with status success for try_number 1 2024-05-25T02:04:02.741166667Z [2024-05-25T02:04:02.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:03:00+00:00 exited with status success for try_number 1 2024-05-25T02:04:02.753180114Z [2024-05-25T02:04:02.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:02:00+00:00, map_index=-1, run_start_date=2024-05-25 02:04:01.658095+00:00, run_end_date=2024-05-25 02:04:02.033747+00:00, run_duration=0.375652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=820, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:04:00.851965+00:00, queued_by_job_id=1, pid=12103 2024-05-25T02:04:02.753688754Z [2024-05-25T02:04:02.753+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:03:00+00:00, map_index=-1, run_start_date=2024-05-25 02:04:01.855814+00:00, run_end_date=2024-05-25 02:04:02.412401+00:00, run_duration=0.556587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=821, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:04:00.851965+00:00, queued_by_job_id=1, pid=12104 2024-05-25T02:04:04.947752883Z [2024-05-25T02:04:04.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:04:04.948284468Z [2024-05-25T02:04:04.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:03:00+00:00, run_id=scheduled__2024-05-25T02:03:00+00:00, run_start_date=2024-05-25 02:04:00.766806+00:00, run_end_date=2024-05-25 02:04:04.947463+00:00, run_duration=4.180657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:03:00+00:00, data_interval_end=2024-05-25 02:04:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:04:04.970560319Z [2024-05-25T02:04:04.969+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:04:00+00:00, run_after=2024-05-25T02:05:00+00:00 2024-05-25T02:04:05.030808804Z [2024-05-25T02:04:05.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:03:00+00:00 exited with status success for try_number 1 2024-05-25T02:04:05.039087824Z [2024-05-25T02:04:05.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:03:00+00:00, map_index=-1, run_start_date=2024-05-25 02:04:02.941362+00:00, run_end_date=2024-05-25 02:04:04.582993+00:00, run_duration=1.641631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=822, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:04:00.851965+00:00, queued_by_job_id=1, pid=12127 2024-05-25T02:04:06.097717676Z [2024-05-25T02:04:06.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:04:06.097946768Z [2024-05-25T02:04:06.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:03:00+00:00, run_id=scheduled__2024-05-25T02:03:00+00:00, run_start_date=2024-05-25 02:04:00.767980+00:00, run_end_date=2024-05-25 02:04:06.097641+00:00, run_duration=5.329661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:03:00+00:00, data_interval_end=2024-05-25 02:04:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:04:06.108806533Z [2024-05-25T02:04:06.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:04:00+00:00, run_after=2024-05-25T02:05:00+00:00 2024-05-25T02:04:06.149084069Z [2024-05-25T02:04:06.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:03:00+00:00 exited with status success for try_number 1 2024-05-25T02:04:06.155737162Z [2024-05-25T02:04:06.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:03:00+00:00, map_index=-1, run_start_date=2024-05-25 02:04:03.069994+00:00, run_end_date=2024-05-25 02:04:05.200794+00:00, run_duration=2.1308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=823, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:04:00.851965+00:00, queued_by_job_id=1, pid=12128 2024-05-25T02:05:00.726194499Z [2024-05-25T02:05:00.725+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:05:00.743052151Z [2024-05-25T02:05:00.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:05:00+00:00, run_after=2024-05-25T02:06:00+00:00 2024-05-25T02:05:00.759430705Z [2024-05-25T02:05:00.759+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:05:00+00:00, run_after=2024-05-25T02:06:00+00:00 2024-05-25T02:05:00.778532333Z [2024-05-25T02:05:00.778+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:05:00+00:00, run_after=2024-05-25T02:10:00+00:00 2024-05-25T02:05:00.900726122Z [2024-05-25T02:05:00.900+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:05:00.900759909Z 2024-05-25T02:05:00.900772300Z 2024-05-25T02:05:00.900778365Z 2024-05-25T02:05:00.900784218Z 2024-05-25T02:05:00.901786231Z [2024-05-25T02:05:00.900+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:05:00.902106198Z [2024-05-25T02:05:00.901+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:05:00.902496874Z [2024-05-25T02:05:00.902+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:05:00.902519588Z [2024-05-25T02:05:00.902+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:05:00.904048220Z [2024-05-25T02:05:00.903+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:05:00.904070691Z 2024-05-25T02:05:00.904079506Z 2024-05-25T02:05:00.904087188Z 2024-05-25T02:05:00.904095187Z 2024-05-25T02:05:00.912653849Z [2024-05-25T02:05:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T02:05:00.912893978Z [2024-05-25T02:05:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:05:00.913706129Z [2024-05-25T02:05:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:05:00.913733802Z [2024-05-25T02:05:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:05:00.913997136Z [2024-05-25T02:05:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:05:00.914124817Z [2024-05-25T02:05:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:05:00.914532816Z [2024-05-25T02:05:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:05:00.914724787Z [2024-05-25T02:05:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:05:01.312057229Z [2024-05-25T02:05:01.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status queued for try_number 1 2024-05-25T02:05:01.312143165Z [2024-05-25T02:05:01.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:04:00+00:00 exited with status queued for try_number 1 2024-05-25T02:05:01.313617974Z [2024-05-25T02:05:01.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:04:00+00:00 exited with status queued for try_number 1 2024-05-25T02:05:01.313833912Z [2024-05-25T02:05:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:04:00+00:00 exited with status queued for try_number 1 2024-05-25T02:05:01.334545809Z [2024-05-25T02:05:01.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9345f02b-f110-4514-b38e-a321344abdf8 2024-05-25T02:05:01.334598625Z [2024-05-25T02:05:01.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to afbaba83-fdaf-4fb2-ac59-d306bd71e7fb 2024-05-25T02:05:01.341285960Z [2024-05-25T02:05:01.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to 414af4e8-a890-474b-acdb-af7ac5f96d8d 2024-05-25T02:05:01.341306062Z [2024-05-25T02:05:01.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc3e8269-fb9c-428d-a80a-5e84401d4f30 2024-05-25T02:05:03.652024675Z [2024-05-25T02:05:03.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:05:03.652550961Z [2024-05-25T02:05:03.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:04:00+00:00, run_id=scheduled__2024-05-25T02:04:00+00:00, run_start_date=2024-05-25 02:05:00.794161+00:00, run_end_date=2024-05-25 02:05:03.652141+00:00, run_duration=2.85798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:04:00+00:00, data_interval_end=2024-05-25 02:05:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:05:03.661774452Z [2024-05-25T02:05:03.661+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:05:00+00:00, run_after=2024-05-25T02:06:00+00:00 2024-05-25T02:05:03.716043039Z [2024-05-25T02:05:03.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:04:00+00:00 exited with status success for try_number 1 2024-05-25T02:05:03.727328819Z [2024-05-25T02:05:03.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:04:00+00:00, map_index=-1, run_start_date=2024-05-25 02:05:02.229051+00:00, run_end_date=2024-05-25 02:05:03.286739+00:00, run_duration=1.057688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=824, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:05:00.906365+00:00, queued_by_job_id=1, pid=12162 2024-05-25T02:05:04.843406998Z [2024-05-25T02:05:04.843+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:05:04.843451823Z 2024-05-25T02:05:04.843567150Z [2024-05-25T02:05:04.843+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:05:04.844186045Z [2024-05-25T02:05:04.843+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:05:04.844210613Z 2024-05-25T02:05:04.846785181Z [2024-05-25T02:05:04.846+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T02:05:04.846984523Z [2024-05-25T02:05:04.846+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:05:04.916625740Z [2024-05-25T02:05:04.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status queued for try_number 1 2024-05-25T02:05:04.917816114Z [2024-05-25T02:05:04.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status success for try_number 1 2024-05-25T02:05:04.928327564Z [2024-05-25T02:05:04.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2767032a-0787-4d53-89c5-ecb7f869958d 2024-05-25T02:05:04.929183018Z [2024-05-25T02:05:04.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T02:00:00+00:00, map_index=-1, run_start_date=2024-05-25 02:05:04.039947+00:00, run_end_date=2024-05-25 02:05:04.467818+00:00, run_duration=0.427871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=827, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:05:00.906365+00:00, queued_by_job_id=1, pid=12197 2024-05-25T02:05:04.977157610Z [2024-05-25T02:05:04.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:05:04.977493797Z [2024-05-25T02:05:04.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:04:00+00:00, run_id=scheduled__2024-05-25T02:04:00+00:00, run_start_date=2024-05-25 02:05:00.795354+00:00, run_end_date=2024-05-25 02:05:04.977138+00:00, run_duration=4.181784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:04:00+00:00, data_interval_end=2024-05-25 02:05:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:05:04.986409109Z [2024-05-25T02:05:04.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:05:00+00:00, run_after=2024-05-25T02:06:00+00:00 2024-05-25T02:05:05.036176271Z [2024-05-25T02:05:05.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:04:00+00:00 exited with status success for try_number 1 2024-05-25T02:05:05.041527591Z [2024-05-25T02:05:05.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:04:00+00:00, map_index=-1, run_start_date=2024-05-25 02:05:03.251766+00:00, run_end_date=2024-05-25 02:05:04.787777+00:00, run_duration=1.536011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=825, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:05:00.906365+00:00, queued_by_job_id=1, pid=12175 2024-05-25T02:05:06.107468540Z [2024-05-25T02:05:06.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:05:06.107511977Z [2024-05-25T02:05:06.104+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:04:00+00:00, run_id=scheduled__2024-05-25T02:04:00+00:00, run_start_date=2024-05-25 02:05:00.796722+00:00, run_end_date=2024-05-25 02:05:06.104674+00:00, run_duration=5.307952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:04:00+00:00, data_interval_end=2024-05-25 02:05:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:05:06.116718636Z [2024-05-25T02:05:06.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:05:00+00:00, run_after=2024-05-25T02:06:00+00:00 2024-05-25T02:05:06.176297812Z [2024-05-25T02:05:06.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:04:00+00:00 exited with status success for try_number 1 2024-05-25T02:05:06.182802602Z [2024-05-25T02:05:06.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:04:00+00:00, map_index=-1, run_start_date=2024-05-25 02:05:03.583099+00:00, run_end_date=2024-05-25 02:05:05.908868+00:00, run_duration=2.325769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=826, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:05:00.906365+00:00, queued_by_job_id=1, pid=12186 2024-05-25T02:05:07.264016976Z [2024-05-25T02:05:07.263+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:05:07.264044946Z 2024-05-25T02:05:07.264055380Z [2024-05-25T02:05:07.263+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:05:07.264674867Z [2024-05-25T02:05:07.264+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:05:07.264685324Z 2024-05-25T02:05:07.267751259Z [2024-05-25T02:05:07.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T02:05:07.267893644Z [2024-05-25T02:05:07.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:05:07.330194324Z [2024-05-25T02:05:07.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status queued for try_number 1 2024-05-25T02:05:07.330623820Z [2024-05-25T02:05:07.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status success for try_number 1 2024-05-25T02:05:07.340508063Z [2024-05-25T02:05:07.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37cf379c-baed-48ca-b01d-00f810092857 2024-05-25T02:05:07.341499295Z [2024-05-25T02:05:07.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T02:00:00+00:00, map_index=-1, run_start_date=2024-05-25 02:05:06.482674+00:00, run_end_date=2024-05-25 02:05:06.864691+00:00, run_duration=0.382017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=828, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:05:04.844604+00:00, queued_by_job_id=1, pid=12220 2024-05-25T02:05:09.959564264Z [2024-05-25T02:05:09.959+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:05:09.959593084Z 2024-05-25T02:05:09.959731407Z [2024-05-25T02:05:09.959+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:05:09.960480173Z [2024-05-25T02:05:09.960+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:05:09.960490397Z 2024-05-25T02:05:09.962584512Z [2024-05-25T02:05:09.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:05:09.962719800Z [2024-05-25T02:05:09.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:05:10.025980507Z [2024-05-25T02:05:10.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status queued for try_number 1 2024-05-25T02:05:10.028930966Z [2024-05-25T02:05:10.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status success for try_number 1 2024-05-25T02:05:10.036273378Z [2024-05-25T02:05:10.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to be61e045-ff0e-499c-9a56-f1398d17becf 2024-05-25T02:05:10.036705619Z [2024-05-25T02:05:10.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T02:00:00+00:00, map_index=0, run_start_date=2024-05-25 02:05:08.970327+00:00, run_end_date=2024-05-25 02:05:09.351922+00:00, run_duration=0.381595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=829, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:05:07.265048+00:00, queued_by_job_id=1, pid=12231 2024-05-25T02:05:13.150269715Z [2024-05-25T02:05:13.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:05:13.150631076Z [2024-05-25T02:05:13.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:00:00+00:00, run_id=scheduled__2024-05-25T02:00:00+00:00, run_start_date=2024-05-25 02:05:00.792598+00:00, run_end_date=2024-05-25 02:05:13.150146+00:00, run_duration=12.357548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:00:00+00:00, data_interval_end=2024-05-25 02:05:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T02:05:13.156309643Z [2024-05-25T02:05:13.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:05:00+00:00, run_after=2024-05-25T02:10:00+00:00 2024-05-25T02:05:13.184834566Z [2024-05-25T02:05:13.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:00:00+00:00 exited with status success for try_number 1 2024-05-25T02:05:13.193310018Z [2024-05-25T02:05:13.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T02:00:00+00:00, map_index=-1, run_start_date=2024-05-25 02:05:11.662804+00:00, run_end_date=2024-05-25 02:05:12.049132+00:00, run_duration=0.386328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=830, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:05:09.960804+00:00, queued_by_job_id=1, pid=12239 2024-05-25T02:05:29.745158624Z [2024-05-25T02:05:29.744+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T02:06:00.772023977Z [2024-05-25T02:06:00.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:06:00+00:00, run_after=2024-05-25T02:07:00+00:00 2024-05-25T02:06:00.783543243Z [2024-05-25T02:06:00.782+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:06:00.814165905Z [2024-05-25T02:06:00.813+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:06:00+00:00, run_after=2024-05-25T02:07:00+00:00 2024-05-25T02:06:00.825470218Z [2024-05-25T02:06:00.825+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:06:00.934159358Z [2024-05-25T02:06:00.933+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:06:00.934274009Z 2024-05-25T02:06:00.934285207Z 2024-05-25T02:06:00.934293888Z 2024-05-25T02:06:00.934302674Z 2024-05-25T02:06:00.934348873Z [2024-05-25T02:06:00.933+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:06:00.934561934Z [2024-05-25T02:06:00.934+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:06:00.934735713Z [2024-05-25T02:06:00.934+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:06:00.934964007Z [2024-05-25T02:06:00.934+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:06:00.935799058Z [2024-05-25T02:06:00.935+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:06:00.935813372Z 2024-05-25T02:06:00.935822059Z 2024-05-25T02:06:00.935830655Z 2024-05-25T02:06:00.935839316Z 2024-05-25T02:06:00.939964050Z [2024-05-25T02:06:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:06:00.940384580Z [2024-05-25T02:06:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:06:00.940765792Z [2024-05-25T02:06:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:06:00.940990610Z [2024-05-25T02:06:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:06:00.941308701Z [2024-05-25T02:06:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:06:00.941485367Z [2024-05-25T02:06:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:06:00.941815965Z [2024-05-25T02:06:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:06:00.941998127Z [2024-05-25T02:06:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:06:01.417219362Z [2024-05-25T02:06:01.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:04:00+00:00 exited with status queued for try_number 1 2024-05-25T02:06:01.417560190Z [2024-05-25T02:06:01.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status queued for try_number 1 2024-05-25T02:06:01.417742475Z [2024-05-25T02:06:01.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status queued for try_number 1 2024-05-25T02:06:01.417903654Z [2024-05-25T02:06:01.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status queued for try_number 1 2024-05-25T02:06:01.435329528Z [2024-05-25T02:06:01.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to e805cbb7-af63-4f2e-8ff0-0a4980feae85 2024-05-25T02:06:01.435444605Z [2024-05-25T02:06:01.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to d15c2399-5ae4-4567-a029-77e1a035440a 2024-05-25T02:06:01.437087992Z [2024-05-25T02:06:01.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a13d3c4-9b9e-45db-8154-fa7715314f69 2024-05-25T02:06:01.437389079Z [2024-05-25T02:06:01.437+0000] {scheduler_job.py:635} INFO - Setting external_id for to 544e991d-6753-466f-957c-f10add915388 2024-05-25T02:06:02.434528460Z [2024-05-25T02:06:02.434+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:06:02.434920359Z [2024-05-25T02:06:02.434+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:04:00+00:00, run_id=scheduled__2024-05-25T02:04:00+00:00, run_start_date=2024-05-25 02:06:00.838532+00:00, run_end_date=2024-05-25 02:06:02.434439+00:00, run_duration=1.595907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:04:00+00:00, data_interval_end=2024-05-25 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:06:02.444932129Z [2024-05-25T02:06:02.444+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:06:00+00:00, run_after=2024-05-25T02:08:00+00:00 2024-05-25T02:06:02.453512222Z [2024-05-25T02:06:02.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:06:02.454294501Z [2024-05-25T02:06:02.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:05:00+00:00, run_id=scheduled__2024-05-25T02:05:00+00:00, run_start_date=2024-05-25 02:06:00.840124+00:00, run_end_date=2024-05-25 02:06:02.453425+00:00, run_duration=1.613301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:05:00+00:00, data_interval_end=2024-05-25 02:06:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:06:02.474482525Z [2024-05-25T02:06:02.474+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:06:00+00:00, run_after=2024-05-25T02:07:00+00:00 2024-05-25T02:06:02.534865346Z [2024-05-25T02:06:02.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:04:00+00:00 exited with status success for try_number 1 2024-05-25T02:06:02.540301301Z [2024-05-25T02:06:02.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:04:00+00:00, map_index=-1, run_start_date=2024-05-25 02:06:01.807216+00:00, run_end_date=2024-05-25 02:06:02.259983+00:00, run_duration=0.452767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=831, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:06:00.936899+00:00, queued_by_job_id=1, pid=12249 2024-05-25T02:06:03.652345342Z [2024-05-25T02:06:03.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status success for try_number 1 2024-05-25T02:06:03.662951103Z [2024-05-25T02:06:03.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:05:00+00:00, map_index=-1, run_start_date=2024-05-25 02:06:01.923509+00:00, run_end_date=2024-05-25 02:06:02.434223+00:00, run_duration=0.510714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=832, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:06:00.936899+00:00, queued_by_job_id=1, pid=12250 2024-05-25T02:06:05.831730300Z [2024-05-25T02:06:05.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:06:05.832255159Z [2024-05-25T02:06:05.831+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:05:00+00:00, run_id=scheduled__2024-05-25T02:05:00+00:00, run_start_date=2024-05-25 02:06:00.841660+00:00, run_end_date=2024-05-25 02:06:05.831585+00:00, run_duration=4.989925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:05:00+00:00, data_interval_end=2024-05-25 02:06:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:06:05.845430725Z [2024-05-25T02:06:05.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:06:00+00:00, run_after=2024-05-25T02:07:00+00:00 2024-05-25T02:06:05.857542623Z [2024-05-25T02:06:05.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:06:05.858005502Z [2024-05-25T02:06:05.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:05:00+00:00, run_id=scheduled__2024-05-25T02:05:00+00:00, run_start_date=2024-05-25 02:06:00.842947+00:00, run_end_date=2024-05-25 02:06:05.857419+00:00, run_duration=5.014472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:05:00+00:00, data_interval_end=2024-05-25 02:06:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:06:05.869426703Z [2024-05-25T02:06:05.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:06:00+00:00, run_after=2024-05-25T02:07:00+00:00 2024-05-25T02:06:05.912079710Z [2024-05-25T02:06:05.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status success for try_number 1 2024-05-25T02:06:05.912129846Z [2024-05-25T02:06:05.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status success for try_number 1 2024-05-25T02:06:05.920006045Z [2024-05-25T02:06:05.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:05:00+00:00, map_index=-1, run_start_date=2024-05-25 02:06:03.078873+00:00, run_end_date=2024-05-25 02:06:04.840164+00:00, run_duration=1.761291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=834, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:06:00.936899+00:00, queued_by_job_id=1, pid=12274 2024-05-25T02:06:05.920419205Z [2024-05-25T02:06:05.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:05:00+00:00, map_index=-1, run_start_date=2024-05-25 02:06:02.923914+00:00, run_end_date=2024-05-25 02:06:05.210715+00:00, run_duration=2.286801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=833, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:06:00.936899+00:00, queued_by_job_id=1, pid=12273 2024-05-25T02:07:00.516269410Z [2024-05-25T02:07:00.515+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:07:00.541328378Z [2024-05-25T02:07:00.535+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:07:00+00:00, run_after=2024-05-25T02:08:00+00:00 2024-05-25T02:07:00.559017290Z [2024-05-25T02:07:00.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:07:00+00:00, run_after=2024-05-25T02:08:00+00:00 2024-05-25T02:07:00.671678530Z [2024-05-25T02:07:00.670+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:07:00.671748614Z 2024-05-25T02:07:00.671753632Z 2024-05-25T02:07:00.671757007Z 2024-05-25T02:07:00.671760551Z [2024-05-25T02:07:00.671+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:07:00.671764029Z [2024-05-25T02:07:00.671+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:07:00.671876029Z [2024-05-25T02:07:00.671+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:07:00.672301969Z [2024-05-25T02:07:00.672+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:07:00.672319805Z 2024-05-25T02:07:00.672324569Z 2024-05-25T02:07:00.672329044Z 2024-05-25T02:07:00.675496848Z [2024-05-25T02:07:00.675+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:07:00.675520623Z [2024-05-25T02:07:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:07:00.676558033Z [2024-05-25T02:07:00.675+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:07:00.676568227Z [2024-05-25T02:07:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:07:00.676571671Z [2024-05-25T02:07:00.675+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:07:00.676575214Z [2024-05-25T02:07:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:07:01.014559709Z [2024-05-25T02:07:01.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:06:00+00:00 exited with status queued for try_number 1 2024-05-25T02:07:01.014842492Z [2024-05-25T02:07:01.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:06:00+00:00 exited with status queued for try_number 1 2024-05-25T02:07:01.015048737Z [2024-05-25T02:07:01.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:06:00+00:00 exited with status queued for try_number 1 2024-05-25T02:07:01.037659727Z [2024-05-25T02:07:01.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86051e94-b6da-4065-b257-882936b2941a 2024-05-25T02:07:01.038079273Z [2024-05-25T02:07:01.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44b04b49-455d-4861-907d-caf96eb35bc6 2024-05-25T02:07:01.038951244Z [2024-05-25T02:07:01.038+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d107520-4dae-4022-a4d5-f138f73d6b79 2024-05-25T02:07:02.310749190Z [2024-05-25T02:07:02.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:07:02.310955877Z [2024-05-25T02:07:02.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:06:00+00:00, run_id=scheduled__2024-05-25T02:06:00+00:00, run_start_date=2024-05-25 02:07:00.576803+00:00, run_end_date=2024-05-25 02:07:02.310667+00:00, run_duration=1.733864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:06:00+00:00, data_interval_end=2024-05-25 02:07:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:07:02.325954179Z [2024-05-25T02:07:02.325+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:07:00+00:00, run_after=2024-05-25T02:08:00+00:00 2024-05-25T02:07:02.395819828Z [2024-05-25T02:07:02.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:06:00+00:00 exited with status success for try_number 1 2024-05-25T02:07:02.402005966Z [2024-05-25T02:07:02.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:06:00+00:00, map_index=-1, run_start_date=2024-05-25 02:07:01.560771+00:00, run_end_date=2024-05-25 02:07:01.978349+00:00, run_duration=0.417578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=835, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:07:00.672949+00:00, queued_by_job_id=1, pid=12307 2024-05-25T02:07:05.134951819Z [2024-05-25T02:07:05.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:07:05.135471529Z [2024-05-25T02:07:05.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:06:00+00:00, run_id=scheduled__2024-05-25T02:06:00+00:00, run_start_date=2024-05-25 02:07:00.580850+00:00, run_end_date=2024-05-25 02:07:05.134851+00:00, run_duration=4.554001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:06:00+00:00, data_interval_end=2024-05-25 02:07:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:07:05.152895735Z [2024-05-25T02:07:05.152+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:07:00+00:00, run_after=2024-05-25T02:08:00+00:00 2024-05-25T02:07:05.161875084Z [2024-05-25T02:07:05.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:07:05.161999813Z [2024-05-25T02:07:05.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:06:00+00:00, run_id=scheduled__2024-05-25T02:06:00+00:00, run_start_date=2024-05-25 02:07:00.578872+00:00, run_end_date=2024-05-25 02:07:05.161715+00:00, run_duration=4.582843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:06:00+00:00, data_interval_end=2024-05-25 02:07:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:07:05.174062366Z [2024-05-25T02:07:05.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:07:00+00:00, run_after=2024-05-25T02:08:00+00:00 2024-05-25T02:07:05.221450914Z [2024-05-25T02:07:05.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:06:00+00:00 exited with status success for try_number 1 2024-05-25T02:07:05.221994810Z [2024-05-25T02:07:05.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:06:00+00:00 exited with status success for try_number 1 2024-05-25T02:07:05.238174521Z [2024-05-25T02:07:05.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:06:00+00:00, map_index=-1, run_start_date=2024-05-25 02:07:02.755884+00:00, run_end_date=2024-05-25 02:07:04.046543+00:00, run_duration=1.290659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=836, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:07:00.672949+00:00, queued_by_job_id=1, pid=12325 2024-05-25T02:07:05.238672734Z [2024-05-25T02:07:05.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:06:00+00:00, map_index=-1, run_start_date=2024-05-25 02:07:02.773191+00:00, run_end_date=2024-05-25 02:07:04.336616+00:00, run_duration=1.563425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=837, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:07:00.672949+00:00, queued_by_job_id=1, pid=12326 2024-05-25T02:08:01.034248126Z [2024-05-25T02:08:01.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:08:00+00:00, run_after=2024-05-25T02:09:00+00:00 2024-05-25T02:08:01.042257400Z [2024-05-25T02:08:01.041+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:08:01.049450482Z [2024-05-25T02:08:01.049+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:08:01.061399247Z [2024-05-25T02:08:01.061+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:08:00+00:00, run_after=2024-05-25T02:09:00+00:00 2024-05-25T02:08:01.154137311Z [2024-05-25T02:08:01.153+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:08:01.154168970Z 2024-05-25T02:08:01.154190382Z 2024-05-25T02:08:01.154218018Z 2024-05-25T02:08:01.154224016Z 2024-05-25T02:08:01.154243131Z [2024-05-25T02:08:01.153+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:08:01.154467426Z [2024-05-25T02:08:01.154+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:08:01.154662791Z [2024-05-25T02:08:01.154+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:08:01.154880876Z [2024-05-25T02:08:01.154+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:08:01.155657571Z [2024-05-25T02:08:01.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:08:01.155671749Z 2024-05-25T02:08:01.155679764Z 2024-05-25T02:08:01.155686056Z 2024-05-25T02:08:01.155692357Z 2024-05-25T02:08:01.160526848Z [2024-05-25T02:08:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:08:01.160580536Z [2024-05-25T02:08:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:08:01.160980537Z [2024-05-25T02:08:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:08:01.161145457Z [2024-05-25T02:08:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:08:01.161559862Z [2024-05-25T02:08:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:08:01.161798541Z [2024-05-25T02:08:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:08:01.162162537Z [2024-05-25T02:08:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:08:01.162454515Z [2024-05-25T02:08:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:08:01.522291133Z [2024-05-25T02:08:01.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:06:00+00:00 exited with status queued for try_number 1 2024-05-25T02:08:01.522432160Z [2024-05-25T02:08:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:07:00+00:00 exited with status queued for try_number 1 2024-05-25T02:08:01.522574598Z [2024-05-25T02:08:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:07:00+00:00 exited with status queued for try_number 1 2024-05-25T02:08:01.522679797Z [2024-05-25T02:08:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:07:00+00:00 exited with status queued for try_number 1 2024-05-25T02:08:01.532653171Z [2024-05-25T02:08:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2dbaf1e8-5687-4dea-a18f-8269272c84c1 2024-05-25T02:08:01.532879078Z [2024-05-25T02:08:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ddd5d24-5dcb-49fb-bebb-8aa240512a42 2024-05-25T02:08:01.533054446Z [2024-05-25T02:08:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to da5f75fd-0a12-40a8-ac7a-5c386863d65f 2024-05-25T02:08:01.533236069Z [2024-05-25T02:08:01.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc797232-2299-445b-b9a1-1ed351c93e93 2024-05-25T02:08:03.030489352Z [2024-05-25T02:08:03.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:08:03.031053709Z [2024-05-25T02:08:03.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:06:00+00:00, run_id=scheduled__2024-05-25T02:06:00+00:00, run_start_date=2024-05-25 02:08:01.072589+00:00, run_end_date=2024-05-25 02:08:03.030666+00:00, run_duration=1.958077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:06:00+00:00, data_interval_end=2024-05-25 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:08:03.041494634Z [2024-05-25T02:08:03.041+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:08:00+00:00, run_after=2024-05-25T02:10:00+00:00 2024-05-25T02:08:03.050827580Z [2024-05-25T02:08:03.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:08:03.051361930Z [2024-05-25T02:08:03.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:07:00+00:00, run_id=scheduled__2024-05-25T02:07:00+00:00, run_start_date=2024-05-25 02:08:01.073905+00:00, run_end_date=2024-05-25 02:08:03.051042+00:00, run_duration=1.977137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:07:00+00:00, data_interval_end=2024-05-25 02:08:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:08:03.063966817Z [2024-05-25T02:08:03.063+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:08:00+00:00, run_after=2024-05-25T02:09:00+00:00 2024-05-25T02:08:03.140811567Z [2024-05-25T02:08:03.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:06:00+00:00 exited with status success for try_number 1 2024-05-25T02:08:03.140939334Z [2024-05-25T02:08:03.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:07:00+00:00 exited with status success for try_number 1 2024-05-25T02:08:03.152730220Z [2024-05-25T02:08:03.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:06:00+00:00, map_index=-1, run_start_date=2024-05-25 02:08:02.038036+00:00, run_end_date=2024-05-25 02:08:02.611430+00:00, run_duration=0.573394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=838, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:08:01.156782+00:00, queued_by_job_id=1, pid=12360 2024-05-25T02:08:03.153109055Z [2024-05-25T02:08:03.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:07:00+00:00, map_index=-1, run_start_date=2024-05-25 02:08:02.162997+00:00, run_end_date=2024-05-25 02:08:02.706175+00:00, run_duration=0.543178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=839, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:08:01.156782+00:00, queued_by_job_id=1, pid=12361 2024-05-25T02:08:05.644751784Z [2024-05-25T02:08:05.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:08:05.645112802Z [2024-05-25T02:08:05.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:07:00+00:00, run_id=scheduled__2024-05-25T02:07:00+00:00, run_start_date=2024-05-25 02:08:01.075008+00:00, run_end_date=2024-05-25 02:08:05.644599+00:00, run_duration=4.569591, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:07:00+00:00, data_interval_end=2024-05-25 02:08:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:08:05.653422920Z [2024-05-25T02:08:05.652+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:08:00+00:00, run_after=2024-05-25T02:09:00+00:00 2024-05-25T02:08:05.693413916Z [2024-05-25T02:08:05.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:07:00+00:00 exited with status success for try_number 1 2024-05-25T02:08:05.700148707Z [2024-05-25T02:08:05.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:07:00+00:00, map_index=-1, run_start_date=2024-05-25 02:08:03.411529+00:00, run_end_date=2024-05-25 02:08:04.657287+00:00, run_duration=1.245758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=840, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:08:01.156782+00:00, queued_by_job_id=1, pid=12384 2024-05-25T02:08:06.746489600Z [2024-05-25T02:08:06.746+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:08:06.746675282Z [2024-05-25T02:08:06.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:07:00+00:00, run_id=scheduled__2024-05-25T02:07:00+00:00, run_start_date=2024-05-25 02:08:01.076084+00:00, run_end_date=2024-05-25 02:08:06.746343+00:00, run_duration=5.670259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:07:00+00:00, data_interval_end=2024-05-25 02:08:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:08:06.756619996Z [2024-05-25T02:08:06.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:08:00+00:00, run_after=2024-05-25T02:09:00+00:00 2024-05-25T02:08:06.797872398Z [2024-05-25T02:08:06.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:07:00+00:00 exited with status success for try_number 1 2024-05-25T02:08:06.806202437Z [2024-05-25T02:08:06.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:07:00+00:00, map_index=-1, run_start_date=2024-05-25 02:08:03.482665+00:00, run_end_date=2024-05-25 02:08:06.426653+00:00, run_duration=2.943988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=841, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:08:01.156782+00:00, queued_by_job_id=1, pid=12385 2024-05-25T02:09:00.954048480Z [2024-05-25T02:09:00.953+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:09:00+00:00, run_after=2024-05-25T02:10:00+00:00 2024-05-25T02:09:00.973873546Z [2024-05-25T02:09:00.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:09:00+00:00, run_after=2024-05-25T02:10:00+00:00 2024-05-25T02:09:00.983358454Z [2024-05-25T02:09:00.982+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:09:01.062522839Z [2024-05-25T02:09:01.062+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:09:01.062635085Z 2024-05-25T02:09:01.062646243Z 2024-05-25T02:09:01.062652470Z 2024-05-25T02:09:01.062677193Z [2024-05-25T02:09:01.062+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:09:01.062712820Z [2024-05-25T02:09:01.062+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:09:01.062948213Z [2024-05-25T02:09:01.062+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:09:01.063673213Z [2024-05-25T02:09:01.063+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:09:01.063692516Z 2024-05-25T02:09:01.063701690Z 2024-05-25T02:09:01.063764266Z 2024-05-25T02:09:01.068439761Z [2024-05-25T02:09:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:09:01.068510111Z [2024-05-25T02:09:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:09:01.068762302Z [2024-05-25T02:09:01.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:09:01.068840117Z [2024-05-25T02:09:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:09:01.069305486Z [2024-05-25T02:09:01.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:09:01.069336392Z [2024-05-25T02:09:01.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:09:01.303153419Z [2024-05-25T02:09:01.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:08:00+00:00 exited with status queued for try_number 1 2024-05-25T02:09:01.303391668Z [2024-05-25T02:09:01.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:08:00+00:00 exited with status queued for try_number 1 2024-05-25T02:09:01.303656299Z [2024-05-25T02:09:01.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:08:00+00:00 exited with status queued for try_number 1 2024-05-25T02:09:01.312377280Z [2024-05-25T02:09:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to 965e2f8b-b64d-4390-9bca-9f01c279b360 2024-05-25T02:09:01.312530641Z [2024-05-25T02:09:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c79de9b-1955-4ec2-8e23-8b883d51e632 2024-05-25T02:09:01.312685976Z [2024-05-25T02:09:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cd120bc-02f3-4007-8be4-f39d61e80ecb 2024-05-25T02:09:02.513455493Z [2024-05-25T02:09:02.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:09:02.513958161Z [2024-05-25T02:09:02.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:08:00+00:00, run_id=scheduled__2024-05-25T02:08:00+00:00, run_start_date=2024-05-25 02:09:00.995432+00:00, run_end_date=2024-05-25 02:09:02.513371+00:00, run_duration=1.517939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:08:00+00:00, data_interval_end=2024-05-25 02:09:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:09:02.527324736Z [2024-05-25T02:09:02.527+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:09:00+00:00, run_after=2024-05-25T02:10:00+00:00 2024-05-25T02:09:02.594537636Z [2024-05-25T02:09:02.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:08:00+00:00 exited with status success for try_number 1 2024-05-25T02:09:02.603245723Z [2024-05-25T02:09:02.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:08:00+00:00, map_index=-1, run_start_date=2024-05-25 02:09:01.855228+00:00, run_end_date=2024-05-25 02:09:02.390103+00:00, run_duration=0.534875, state=success, executor_state=success, try_number=1, max_tries=1, job_id=842, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:09:01.064634+00:00, queued_by_job_id=1, pid=12418 2024-05-25T02:09:04.991010692Z [2024-05-25T02:09:04.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:09:04.991510036Z [2024-05-25T02:09:04.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:08:00+00:00, run_id=scheduled__2024-05-25T02:08:00+00:00, run_start_date=2024-05-25 02:09:00.997956+00:00, run_end_date=2024-05-25 02:09:04.990980+00:00, run_duration=3.993024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:08:00+00:00, data_interval_end=2024-05-25 02:09:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:09:05.002157914Z [2024-05-25T02:09:05.001+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:09:00+00:00, run_after=2024-05-25T02:10:00+00:00 2024-05-25T02:09:05.012241328Z [2024-05-25T02:09:05.011+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:09:05.012587326Z [2024-05-25T02:09:05.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:08:00+00:00, run_id=scheduled__2024-05-25T02:08:00+00:00, run_start_date=2024-05-25 02:09:00.996814+00:00, run_end_date=2024-05-25 02:09:05.012077+00:00, run_duration=4.015263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:08:00+00:00, data_interval_end=2024-05-25 02:09:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:09:05.025649560Z [2024-05-25T02:09:05.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:09:00+00:00, run_after=2024-05-25T02:10:00+00:00 2024-05-25T02:09:05.080251108Z [2024-05-25T02:09:05.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:08:00+00:00 exited with status success for try_number 1 2024-05-25T02:09:05.080449402Z [2024-05-25T02:09:05.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:08:00+00:00 exited with status success for try_number 1 2024-05-25T02:09:05.093878203Z [2024-05-25T02:09:05.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:08:00+00:00, map_index=-1, run_start_date=2024-05-25 02:09:03.027260+00:00, run_end_date=2024-05-25 02:09:04.419263+00:00, run_duration=1.392003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=844, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:09:01.064634+00:00, queued_by_job_id=1, pid=12437 2024-05-25T02:09:05.094649950Z [2024-05-25T02:09:05.094+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:08:00+00:00, map_index=-1, run_start_date=2024-05-25 02:09:02.921275+00:00, run_end_date=2024-05-25 02:09:04.819094+00:00, run_duration=1.897819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=843, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:09:01.064634+00:00, queued_by_job_id=1, pid=12436 2024-05-25T02:10:00.775442150Z [2024-05-25T02:10:00.774+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:10:00.798986344Z [2024-05-25T02:10:00.798+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:10:00+00:00, run_after=2024-05-25T02:11:00+00:00 2024-05-25T02:10:00.823265870Z [2024-05-25T02:10:00.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:10:00+00:00, run_after=2024-05-25T02:15:00+00:00 2024-05-25T02:10:00.842697853Z [2024-05-25T02:10:00.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:10:00+00:00, run_after=2024-05-25T02:11:00+00:00 2024-05-25T02:10:00.859048115Z [2024-05-25T02:10:00.858+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:10:01.022554078Z [2024-05-25T02:10:01.022+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T02:10:01.022582738Z 2024-05-25T02:10:01.022586871Z 2024-05-25T02:10:01.022591627Z 2024-05-25T02:10:01.022595602Z 2024-05-25T02:10:01.022599161Z 2024-05-25T02:10:01.022697191Z [2024-05-25T02:10:01.022+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:10:01.022911844Z [2024-05-25T02:10:01.022+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:10:01.023101130Z [2024-05-25T02:10:01.022+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:10:01.023304609Z [2024-05-25T02:10:01.023+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:10:01.023499843Z [2024-05-25T02:10:01.023+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:10:01.024199606Z [2024-05-25T02:10:01.024+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:10:01.024211044Z 2024-05-25T02:10:01.024215113Z 2024-05-25T02:10:01.024218563Z 2024-05-25T02:10:01.024221660Z 2024-05-25T02:10:01.024224750Z 2024-05-25T02:10:01.032779009Z [2024-05-25T02:10:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T02:10:01.033015404Z [2024-05-25T02:10:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:10:01.033408303Z [2024-05-25T02:10:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:10:01.033565565Z [2024-05-25T02:10:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:10:01.033834108Z [2024-05-25T02:10:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:10:01.033981668Z [2024-05-25T02:10:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:10:01.034291022Z [2024-05-25T02:10:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:10:01.034451470Z [2024-05-25T02:10:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:10:01.034710612Z [2024-05-25T02:10:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:10:01.034887869Z [2024-05-25T02:10:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:10:01.658578962Z [2024-05-25T02:10:01.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status queued for try_number 1 2024-05-25T02:10:01.658613390Z [2024-05-25T02:10:01.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:08:00+00:00 exited with status queued for try_number 1 2024-05-25T02:10:01.658659442Z [2024-05-25T02:10:01.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:09:00+00:00 exited with status queued for try_number 1 2024-05-25T02:10:01.658731751Z [2024-05-25T02:10:01.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:09:00+00:00 exited with status queued for try_number 1 2024-05-25T02:10:01.658783701Z [2024-05-25T02:10:01.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:09:00+00:00 exited with status queued for try_number 1 2024-05-25T02:10:01.671407359Z [2024-05-25T02:10:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06c74d79-b93b-4500-8bcc-e045cf403ee5 2024-05-25T02:10:01.671486606Z [2024-05-25T02:10:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9fd50f4-721f-4d8c-a011-0b78ffe18c4d 2024-05-25T02:10:01.671600359Z [2024-05-25T02:10:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 575f71a3-f026-4f7c-87f8-dbff144af849 2024-05-25T02:10:01.671707410Z [2024-05-25T02:10:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10b10de3-c246-4283-b04a-334604624638 2024-05-25T02:10:01.671832779Z [2024-05-25T02:10:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a629589-7bc8-4e58-b2cc-23bf6ab0176d 2024-05-25T02:10:03.746764060Z [2024-05-25T02:10:03.746+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:10:03.747137041Z [2024-05-25T02:10:03.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:08:00+00:00, run_id=scheduled__2024-05-25T02:08:00+00:00, run_start_date=2024-05-25 02:10:00.909185+00:00, run_end_date=2024-05-25 02:10:03.746725+00:00, run_duration=2.83754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:08:00+00:00, data_interval_end=2024-05-25 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:10:03.788488791Z [2024-05-25T02:10:03.787+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:10:00+00:00, run_after=2024-05-25T02:12:00+00:00 2024-05-25T02:10:03.898823601Z [2024-05-25T02:10:03.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:08:00+00:00 exited with status success for try_number 1 2024-05-25T02:10:03.908680164Z [2024-05-25T02:10:03.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:08:00+00:00, map_index=-1, run_start_date=2024-05-25 02:10:02.583459+00:00, run_end_date=2024-05-25 02:10:03.256291+00:00, run_duration=0.672832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=845, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:10:01.025288+00:00, queued_by_job_id=1, pid=12472 2024-05-25T02:10:04.413583222Z [2024-05-25T02:10:04.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:10:04.413872832Z [2024-05-25T02:10:04.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:09:00+00:00, run_id=scheduled__2024-05-25T02:09:00+00:00, run_start_date=2024-05-25 02:10:00.912367+00:00, run_end_date=2024-05-25 02:10:04.413547+00:00, run_duration=3.50118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:09:00+00:00, data_interval_end=2024-05-25 02:10:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:10:04.433069017Z [2024-05-25T02:10:04.432+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:10:00+00:00, run_after=2024-05-25T02:11:00+00:00 2024-05-25T02:10:04.593401698Z [2024-05-25T02:10:04.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:09:00+00:00 exited with status success for try_number 1 2024-05-25T02:10:04.614613672Z [2024-05-25T02:10:04.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:09:00+00:00, map_index=-1, run_start_date=2024-05-25 02:10:02.927774+00:00, run_end_date=2024-05-25 02:10:03.570454+00:00, run_duration=0.64268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=846, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:10:01.025288+00:00, queued_by_job_id=1, pid=12474 2024-05-25T02:10:05.825095424Z [2024-05-25T02:10:05.823+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:10:05.825123226Z 2024-05-25T02:10:05.825702113Z [2024-05-25T02:10:05.825+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:10:05.827499701Z [2024-05-25T02:10:05.827+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:10:05.827511427Z 2024-05-25T02:10:05.832041906Z [2024-05-25T02:10:05.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T02:10:05.832703723Z [2024-05-25T02:10:05.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:10:05.929361040Z [2024-05-25T02:10:05.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status queued for try_number 1 2024-05-25T02:10:05.929423521Z [2024-05-25T02:10:05.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status success for try_number 1 2024-05-25T02:10:05.937829741Z [2024-05-25T02:10:05.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4420b369-9acb-4d51-87d5-3151e6c545bc 2024-05-25T02:10:05.939244439Z [2024-05-25T02:10:05.938+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T02:05:00+00:00, map_index=-1, run_start_date=2024-05-25 02:10:04.875700+00:00, run_end_date=2024-05-25 02:10:05.687056+00:00, run_duration=0.811356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=847, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:10:01.025288+00:00, queued_by_job_id=1, pid=12497 2024-05-25T02:10:07.247540395Z [2024-05-25T02:10:07.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:10:07.247902049Z [2024-05-25T02:10:07.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:09:00+00:00, run_id=scheduled__2024-05-25T02:09:00+00:00, run_start_date=2024-05-25 02:10:00.916059+00:00, run_end_date=2024-05-25 02:10:07.247514+00:00, run_duration=6.331455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:09:00+00:00, data_interval_end=2024-05-25 02:10:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:10:07.271118095Z [2024-05-25T02:10:07.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:10:00+00:00, run_after=2024-05-25T02:11:00+00:00 2024-05-25T02:10:07.406397609Z [2024-05-25T02:10:07.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:09:00+00:00 exited with status success for try_number 1 2024-05-25T02:10:07.411433773Z [2024-05-25T02:10:07.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:09:00+00:00, map_index=-1, run_start_date=2024-05-25 02:10:05.007863+00:00, run_end_date=2024-05-25 02:10:06.879656+00:00, run_duration=1.871793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=848, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:10:01.025288+00:00, queued_by_job_id=1, pid=12498 2024-05-25T02:10:08.461976034Z [2024-05-25T02:10:08.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:10:08.463577418Z [2024-05-25T02:10:08.461+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:09:00+00:00, run_id=scheduled__2024-05-25T02:09:00+00:00, run_start_date=2024-05-25 02:10:00.918812+00:00, run_end_date=2024-05-25 02:10:08.461831+00:00, run_duration=7.543019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:09:00+00:00, data_interval_end=2024-05-25 02:10:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:10:08.472788162Z [2024-05-25T02:10:08.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:10:00+00:00, run_after=2024-05-25T02:11:00+00:00 2024-05-25T02:10:08.559492854Z [2024-05-25T02:10:08.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:09:00+00:00 exited with status success for try_number 1 2024-05-25T02:10:08.573100211Z [2024-05-25T02:10:08.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:09:00+00:00, map_index=-1, run_start_date=2024-05-25 02:10:05.554021+00:00, run_end_date=2024-05-25 02:10:07.726150+00:00, run_duration=2.172129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=849, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:10:01.025288+00:00, queued_by_job_id=1, pid=12509 2024-05-25T02:10:09.061403286Z [2024-05-25T02:10:09.052+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:10:09.061429949Z 2024-05-25T02:10:09.061433428Z [2024-05-25T02:10:09.052+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:10:09.061437216Z [2024-05-25T02:10:09.053+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:10:09.061440299Z 2024-05-25T02:10:09.061444036Z [2024-05-25T02:10:09.055+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T02:10:09.061447234Z [2024-05-25T02:10:09.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:10:09.149343872Z [2024-05-25T02:10:09.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status queued for try_number 1 2024-05-25T02:10:09.149369691Z [2024-05-25T02:10:09.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status success for try_number 1 2024-05-25T02:10:09.157546265Z [2024-05-25T02:10:09.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to 659cdde7-e41a-4fcf-b8cb-84c9a3f8c08c 2024-05-25T02:10:09.157577691Z [2024-05-25T02:10:09.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T02:05:00+00:00, map_index=-1, run_start_date=2024-05-25 02:10:08.268456+00:00, run_end_date=2024-05-25 02:10:08.740668+00:00, run_duration=0.472212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=850, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:10:05.828312+00:00, queued_by_job_id=1, pid=12537 2024-05-25T02:10:11.429550088Z [2024-05-25T02:10:11.428+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:10:11.429591611Z 2024-05-25T02:10:11.430211376Z [2024-05-25T02:10:11.429+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:10:11.431305468Z [2024-05-25T02:10:11.430+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:10:11.431338670Z 2024-05-25T02:10:11.434728103Z [2024-05-25T02:10:11.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:10:11.435121033Z [2024-05-25T02:10:11.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:10:11.495770980Z [2024-05-25T02:10:11.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status queued for try_number 1 2024-05-25T02:10:11.495830599Z [2024-05-25T02:10:11.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status success for try_number 1 2024-05-25T02:10:11.501381039Z [2024-05-25T02:10:11.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92f1a0ca-91bf-4527-9c97-3fd999dd6479 2024-05-25T02:10:11.501635080Z [2024-05-25T02:10:11.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T02:05:00+00:00, map_index=0, run_start_date=2024-05-25 02:10:10.623538+00:00, run_end_date=2024-05-25 02:10:10.913165+00:00, run_duration=0.289627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=851, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:10:09.054215+00:00, queued_by_job_id=1, pid=12548 2024-05-25T02:10:14.222791167Z [2024-05-25T02:10:14.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:10:14.223197199Z [2024-05-25T02:10:14.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:05:00+00:00, run_id=scheduled__2024-05-25T02:05:00+00:00, run_start_date=2024-05-25 02:10:00.904660+00:00, run_end_date=2024-05-25 02:10:14.222853+00:00, run_duration=13.318193, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:05:00+00:00, data_interval_end=2024-05-25 02:10:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T02:10:14.229341319Z [2024-05-25T02:10:14.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:10:00+00:00, run_after=2024-05-25T02:15:00+00:00 2024-05-25T02:10:14.257961732Z [2024-05-25T02:10:14.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:05:00+00:00 exited with status success for try_number 1 2024-05-25T02:10:14.263917165Z [2024-05-25T02:10:14.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T02:05:00+00:00, map_index=-1, run_start_date=2024-05-25 02:10:13.324439+00:00, run_end_date=2024-05-25 02:10:13.718093+00:00, run_duration=0.393654, state=success, executor_state=success, try_number=1, max_tries=1, job_id=852, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:10:11.432160+00:00, queued_by_job_id=1, pid=12556 2024-05-25T02:10:29.820848440Z [2024-05-25T02:10:29.820+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T02:11:00.944101094Z [2024-05-25T02:11:00.943+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:11:00.955986557Z [2024-05-25T02:11:00.955+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:11:00+00:00, run_after=2024-05-25T02:12:00+00:00 2024-05-25T02:11:00.967762280Z [2024-05-25T02:11:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:11:00+00:00, run_after=2024-05-25T02:12:00+00:00 2024-05-25T02:11:01.048045533Z [2024-05-25T02:11:01.047+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:11:01.048104941Z 2024-05-25T02:11:01.048111191Z 2024-05-25T02:11:01.048116549Z 2024-05-25T02:11:01.048599377Z [2024-05-25T02:11:01.048+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:11:01.049285374Z [2024-05-25T02:11:01.048+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:11:01.050105257Z [2024-05-25T02:11:01.049+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:11:01.051329573Z [2024-05-25T02:11:01.050+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:11:01.051362668Z 2024-05-25T02:11:01.051370098Z 2024-05-25T02:11:01.051376771Z 2024-05-25T02:11:01.056618313Z [2024-05-25T02:11:01.056+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:11:01.056992862Z [2024-05-25T02:11:01.056+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:11:01.057824179Z [2024-05-25T02:11:01.057+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:11:01.058266749Z [2024-05-25T02:11:01.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:11:01.060335304Z [2024-05-25T02:11:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:11:01.060901227Z [2024-05-25T02:11:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:11:01.323422528Z [2024-05-25T02:11:01.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status queued for try_number 1 2024-05-25T02:11:01.323648088Z [2024-05-25T02:11:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status queued for try_number 1 2024-05-25T02:11:01.323855888Z [2024-05-25T02:11:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status queued for try_number 1 2024-05-25T02:11:01.333737126Z [2024-05-25T02:11:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to eee64c7a-1c1d-47eb-b1e4-baa6e9a3bc6e 2024-05-25T02:11:01.333826449Z [2024-05-25T02:11:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ae02df7-8d76-47de-b254-4d1f0973b389 2024-05-25T02:11:01.334767646Z [2024-05-25T02:11:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7463ab8-711d-40ac-86bd-aaaf6a36fcd6 2024-05-25T02:11:02.539203539Z [2024-05-25T02:11:02.538+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:11:02.539827140Z [2024-05-25T02:11:02.539+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:10:00+00:00, run_id=scheduled__2024-05-25T02:10:00+00:00, run_start_date=2024-05-25 02:11:00.986350+00:00, run_end_date=2024-05-25 02:11:02.539097+00:00, run_duration=1.552747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:10:00+00:00, data_interval_end=2024-05-25 02:11:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:11:02.550969128Z [2024-05-25T02:11:02.550+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:11:00+00:00, run_after=2024-05-25T02:12:00+00:00 2024-05-25T02:11:03.743193051Z [2024-05-25T02:11:03.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status success for try_number 1 2024-05-25T02:11:03.751650353Z [2024-05-25T02:11:03.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:10:00+00:00, map_index=-1, run_start_date=2024-05-25 02:11:01.939747+00:00, run_end_date=2024-05-25 02:11:02.445950+00:00, run_duration=0.506203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=853, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:11:01.052718+00:00, queued_by_job_id=1, pid=12565 2024-05-25T02:11:04.810299460Z [2024-05-25T02:11:04.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:11:04.811047968Z [2024-05-25T02:11:04.810+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:10:00+00:00, run_id=scheduled__2024-05-25T02:10:00+00:00, run_start_date=2024-05-25 02:11:00.988415+00:00, run_end_date=2024-05-25 02:11:04.810440+00:00, run_duration=3.822025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:10:00+00:00, data_interval_end=2024-05-25 02:11:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:11:04.842554011Z [2024-05-25T02:11:04.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:11:00+00:00, run_after=2024-05-25T02:12:00+00:00 2024-05-25T02:11:04.899058208Z [2024-05-25T02:11:04.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status success for try_number 1 2024-05-25T02:11:04.905399280Z [2024-05-25T02:11:04.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:10:00+00:00, map_index=-1, run_start_date=2024-05-25 02:11:03.039432+00:00, run_end_date=2024-05-25 02:11:04.663901+00:00, run_duration=1.624469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=855, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:11:01.052718+00:00, queued_by_job_id=1, pid=12584 2024-05-25T02:11:06.085429680Z [2024-05-25T02:11:06.076+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:11:06.085440072Z [2024-05-25T02:11:06.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:10:00+00:00, run_id=scheduled__2024-05-25T02:10:00+00:00, run_start_date=2024-05-25 02:11:00.990364+00:00, run_end_date=2024-05-25 02:11:06.077080+00:00, run_duration=5.086716, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:10:00+00:00, data_interval_end=2024-05-25 02:11:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:11:06.087423289Z [2024-05-25T02:11:06.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:11:00+00:00, run_after=2024-05-25T02:12:00+00:00 2024-05-25T02:11:06.124906073Z [2024-05-25T02:11:06.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status success for try_number 1 2024-05-25T02:11:06.131663299Z [2024-05-25T02:11:06.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:10:00+00:00, map_index=-1, run_start_date=2024-05-25 02:11:02.947333+00:00, run_end_date=2024-05-25 02:11:05.342110+00:00, run_duration=2.394777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=854, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:11:01.052718+00:00, queued_by_job_id=1, pid=12583 2024-05-25T02:12:00.852019150Z [2024-05-25T02:12:00.851+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:12:00.864702396Z [2024-05-25T02:12:00.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:12:00+00:00, run_after=2024-05-25T02:13:00+00:00 2024-05-25T02:12:00.879343581Z [2024-05-25T02:12:00.879+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:12:00+00:00, run_after=2024-05-25T02:13:00+00:00 2024-05-25T02:12:00.886795094Z [2024-05-25T02:12:00.886+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:12:00.953308412Z [2024-05-25T02:12:00.952+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:12:00.953333476Z 2024-05-25T02:12:00.953350586Z 2024-05-25T02:12:00.953354199Z 2024-05-25T02:12:00.953357315Z 2024-05-25T02:12:00.953756725Z [2024-05-25T02:12:00.953+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:12:00.954071440Z [2024-05-25T02:12:00.953+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:12:00.954299387Z [2024-05-25T02:12:00.953+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:12:00.954621923Z [2024-05-25T02:12:00.954+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:12:00.955276176Z [2024-05-25T02:12:00.955+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:12:00.955286992Z 2024-05-25T02:12:00.955290753Z 2024-05-25T02:12:00.955293876Z 2024-05-25T02:12:00.955310816Z 2024-05-25T02:12:00.960274619Z [2024-05-25T02:12:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:12:00.960599755Z [2024-05-25T02:12:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:12:00.961895034Z [2024-05-25T02:12:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:12:00.962980173Z [2024-05-25T02:12:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:12:00.963356953Z [2024-05-25T02:12:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:12:00.963615372Z [2024-05-25T02:12:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:12:00.964005634Z [2024-05-25T02:12:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:12:00.964310263Z [2024-05-25T02:12:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:12:01.620418894Z [2024-05-25T02:12:01.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status queued for try_number 1 2024-05-25T02:12:01.620698341Z [2024-05-25T02:12:01.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:11:00+00:00 exited with status queued for try_number 1 2024-05-25T02:12:01.620839943Z [2024-05-25T02:12:01.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:11:00+00:00 exited with status queued for try_number 1 2024-05-25T02:12:01.621023903Z [2024-05-25T02:12:01.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:11:00+00:00 exited with status queued for try_number 1 2024-05-25T02:12:01.637602393Z [2024-05-25T02:12:01.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc9009b4-a354-41b3-bd97-719fe21a9f62 2024-05-25T02:12:01.637829579Z [2024-05-25T02:12:01.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 618fb0e0-9139-4313-bf59-2ce55e880f01 2024-05-25T02:12:01.638156071Z [2024-05-25T02:12:01.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1948b9d2-f71c-43ec-a62f-75e50193fa07 2024-05-25T02:12:01.638546106Z [2024-05-25T02:12:01.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0323ca4-c54a-4c80-a3fc-daa161c6c607 2024-05-25T02:12:03.042858593Z [2024-05-25T02:12:03.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:12:03.043247730Z [2024-05-25T02:12:03.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:10:00+00:00, run_id=scheduled__2024-05-25T02:10:00+00:00, run_start_date=2024-05-25 02:12:00.895825+00:00, run_end_date=2024-05-25 02:12:03.042724+00:00, run_duration=2.146899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:10:00+00:00, data_interval_end=2024-05-25 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:12:03.050584021Z [2024-05-25T02:12:03.050+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:12:00+00:00, run_after=2024-05-25T02:14:00+00:00 2024-05-25T02:12:03.058792547Z [2024-05-25T02:12:03.058+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:12:03.059316138Z [2024-05-25T02:12:03.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:11:00+00:00, run_id=scheduled__2024-05-25T02:11:00+00:00, run_start_date=2024-05-25 02:12:00.896960+00:00, run_end_date=2024-05-25 02:12:03.058725+00:00, run_duration=2.161765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:11:00+00:00, data_interval_end=2024-05-25 02:12:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:12:03.071076339Z [2024-05-25T02:12:03.070+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:12:00+00:00, run_after=2024-05-25T02:13:00+00:00 2024-05-25T02:12:03.127227611Z [2024-05-25T02:12:03.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status success for try_number 1 2024-05-25T02:12:03.127959982Z [2024-05-25T02:12:03.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:11:00+00:00 exited with status success for try_number 1 2024-05-25T02:12:03.138627832Z [2024-05-25T02:12:03.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:11:00+00:00, map_index=-1, run_start_date=2024-05-25 02:12:02.076751+00:00, run_end_date=2024-05-25 02:12:02.661323+00:00, run_duration=0.584572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=856, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:12:00.957716+00:00, queued_by_job_id=1, pid=12616 2024-05-25T02:12:03.139015157Z [2024-05-25T02:12:03.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:10:00+00:00, map_index=-1, run_start_date=2024-05-25 02:12:02.180091+00:00, run_end_date=2024-05-25 02:12:02.727436+00:00, run_duration=0.547345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=857, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:12:00.957716+00:00, queued_by_job_id=1, pid=12617 2024-05-25T02:12:05.286168859Z [2024-05-25T02:12:05.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:12:05.286656487Z [2024-05-25T02:12:05.286+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:11:00+00:00, run_id=scheduled__2024-05-25T02:11:00+00:00, run_start_date=2024-05-25 02:12:00.898017+00:00, run_end_date=2024-05-25 02:12:05.286215+00:00, run_duration=4.388198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:11:00+00:00, data_interval_end=2024-05-25 02:12:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:12:05.301326217Z [2024-05-25T02:12:05.300+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:12:00+00:00, run_after=2024-05-25T02:13:00+00:00 2024-05-25T02:12:05.310703898Z [2024-05-25T02:12:05.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:12:05.311119178Z [2024-05-25T02:12:05.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:11:00+00:00, run_id=scheduled__2024-05-25T02:11:00+00:00, run_start_date=2024-05-25 02:12:00.899035+00:00, run_end_date=2024-05-25 02:12:05.310485+00:00, run_duration=4.41145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:11:00+00:00, data_interval_end=2024-05-25 02:12:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:12:05.325678300Z [2024-05-25T02:12:05.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:12:00+00:00, run_after=2024-05-25T02:13:00+00:00 2024-05-25T02:12:05.391908270Z [2024-05-25T02:12:05.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:11:00+00:00 exited with status success for try_number 1 2024-05-25T02:12:05.392336493Z [2024-05-25T02:12:05.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:11:00+00:00 exited with status success for try_number 1 2024-05-25T02:12:05.407074114Z [2024-05-25T02:12:05.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:11:00+00:00, map_index=-1, run_start_date=2024-05-25 02:12:03.346459+00:00, run_end_date=2024-05-25 02:12:04.728786+00:00, run_duration=1.382327, state=success, executor_state=success, try_number=1, max_tries=1, job_id=859, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:12:00.957716+00:00, queued_by_job_id=1, pid=12641 2024-05-25T02:12:05.407407425Z [2024-05-25T02:12:05.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:11:00+00:00, map_index=-1, run_start_date=2024-05-25 02:12:03.242495+00:00, run_end_date=2024-05-25 02:12:05.064099+00:00, run_duration=1.821604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=858, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:12:00.957716+00:00, queued_by_job_id=1, pid=12640 2024-05-25T02:13:00.176390206Z [2024-05-25T02:13:00.175+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:13:00+00:00, run_after=2024-05-25T02:14:00+00:00 2024-05-25T02:13:00.194441506Z [2024-05-25T02:13:00.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:13:00+00:00, run_after=2024-05-25T02:14:00+00:00 2024-05-25T02:13:00.207934958Z [2024-05-25T02:13:00.207+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:13:00.306066319Z [2024-05-25T02:13:00.305+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:13:00.306098812Z 2024-05-25T02:13:00.306104067Z 2024-05-25T02:13:00.306108488Z 2024-05-25T02:13:00.306193519Z [2024-05-25T02:13:00.305+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:13:00.306402175Z [2024-05-25T02:13:00.306+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:13:00.306580035Z [2024-05-25T02:13:00.306+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:13:00.307732610Z [2024-05-25T02:13:00.307+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:13:00.307743659Z 2024-05-25T02:13:00.307746829Z 2024-05-25T02:13:00.307750210Z 2024-05-25T02:13:00.311642141Z [2024-05-25T02:13:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:13:00.311702927Z [2024-05-25T02:13:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:13:00.312061419Z [2024-05-25T02:13:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:13:00.312169937Z [2024-05-25T02:13:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:13:00.312424860Z [2024-05-25T02:13:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:13:00.312531226Z [2024-05-25T02:13:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:13:00.543661638Z [2024-05-25T02:13:00.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:12:00+00:00 exited with status queued for try_number 1 2024-05-25T02:13:00.543873556Z [2024-05-25T02:13:00.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:12:00+00:00 exited with status queued for try_number 1 2024-05-25T02:13:00.544106380Z [2024-05-25T02:13:00.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:12:00+00:00 exited with status queued for try_number 1 2024-05-25T02:13:00.558159755Z [2024-05-25T02:13:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dc0d8f6-dfdf-4a45-8795-813bd249a417 2024-05-25T02:13:00.558460618Z [2024-05-25T02:13:00.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9145723-6c58-4569-ac6b-df2df9d00fe0 2024-05-25T02:13:00.558658251Z [2024-05-25T02:13:00.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 272d3f57-e54e-4c60-82a3-82f0a7f52db0 2024-05-25T02:13:01.694159192Z [2024-05-25T02:13:01.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:13:01.694421173Z [2024-05-25T02:13:01.694+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:12:00+00:00, run_id=scheduled__2024-05-25T02:12:00+00:00, run_start_date=2024-05-25 02:13:00.222860+00:00, run_end_date=2024-05-25 02:13:01.694030+00:00, run_duration=1.47117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:12:00+00:00, data_interval_end=2024-05-25 02:13:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:13:01.703262645Z [2024-05-25T02:13:01.702+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:13:00+00:00, run_after=2024-05-25T02:14:00+00:00 2024-05-25T02:13:01.748165729Z [2024-05-25T02:13:01.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:12:00+00:00 exited with status success for try_number 1 2024-05-25T02:13:01.761600384Z [2024-05-25T02:13:01.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:12:00+00:00, map_index=-1, run_start_date=2024-05-25 02:13:01.092615+00:00, run_end_date=2024-05-25 02:13:01.433510+00:00, run_duration=0.340895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=860, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:13:00.308662+00:00, queued_by_job_id=1, pid=12673 2024-05-25T02:13:03.794089460Z [2024-05-25T02:13:03.792+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:13:03.794502284Z [2024-05-25T02:13:03.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:12:00+00:00, run_id=scheduled__2024-05-25T02:12:00+00:00, run_start_date=2024-05-25 02:13:00.224517+00:00, run_end_date=2024-05-25 02:13:03.794027+00:00, run_duration=3.56951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:12:00+00:00, data_interval_end=2024-05-25 02:13:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:13:03.804423431Z [2024-05-25T02:13:03.804+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:13:00+00:00, run_after=2024-05-25T02:14:00+00:00 2024-05-25T02:13:03.841900369Z [2024-05-25T02:13:03.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:12:00+00:00 exited with status success for try_number 1 2024-05-25T02:13:03.846295782Z [2024-05-25T02:13:03.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:12:00+00:00, map_index=-1, run_start_date=2024-05-25 02:13:02.142395+00:00, run_end_date=2024-05-25 02:13:03.404447+00:00, run_duration=1.262052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=862, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:13:00.308662+00:00, queued_by_job_id=1, pid=12692 2024-05-25T02:13:04.910803911Z [2024-05-25T02:13:04.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:13:04.911717741Z [2024-05-25T02:13:04.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:12:00+00:00, run_id=scheduled__2024-05-25T02:12:00+00:00, run_start_date=2024-05-25 02:13:00.226136+00:00, run_end_date=2024-05-25 02:13:04.910865+00:00, run_duration=4.684729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:12:00+00:00, data_interval_end=2024-05-25 02:13:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:13:04.930793593Z [2024-05-25T02:13:04.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:13:00+00:00, run_after=2024-05-25T02:14:00+00:00 2024-05-25T02:13:04.985931971Z [2024-05-25T02:13:04.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:12:00+00:00 exited with status success for try_number 1 2024-05-25T02:13:04.997394974Z [2024-05-25T02:13:04.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:12:00+00:00, map_index=-1, run_start_date=2024-05-25 02:13:02.098761+00:00, run_end_date=2024-05-25 02:13:03.808163+00:00, run_duration=1.709402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=861, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:13:00.308662+00:00, queued_by_job_id=1, pid=12691 2024-05-25T02:14:00.733322386Z [2024-05-25T02:14:00.732+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:14:00.751326660Z [2024-05-25T02:14:00.750+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:14:00+00:00, run_after=2024-05-25T02:15:00+00:00 2024-05-25T02:14:00.770776442Z [2024-05-25T02:14:00.770+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:14:00.799968981Z [2024-05-25T02:14:00.799+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:14:00+00:00, run_after=2024-05-25T02:15:00+00:00 2024-05-25T02:14:00.906281977Z [2024-05-25T02:14:00.905+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:14:00.906314082Z 2024-05-25T02:14:00.906322976Z 2024-05-25T02:14:00.906329740Z 2024-05-25T02:14:00.906336190Z 2024-05-25T02:14:00.906497934Z [2024-05-25T02:14:00.906+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:14:00.906889388Z [2024-05-25T02:14:00.906+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:14:00.907119594Z [2024-05-25T02:14:00.906+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:14:00.907365131Z [2024-05-25T02:14:00.907+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:14:00.908482697Z [2024-05-25T02:14:00.908+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:14:00.908500377Z 2024-05-25T02:14:00.908511451Z 2024-05-25T02:14:00.908517886Z 2024-05-25T02:14:00.908523923Z 2024-05-25T02:14:00.914218858Z [2024-05-25T02:14:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:14:00.914431797Z [2024-05-25T02:14:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:14:00.914857815Z [2024-05-25T02:14:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:14:00.915063048Z [2024-05-25T02:14:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:14:00.915408905Z [2024-05-25T02:14:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:14:00.915572443Z [2024-05-25T02:14:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:14:00.915986692Z [2024-05-25T02:14:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:14:00.916014606Z [2024-05-25T02:14:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:14:01.272293176Z [2024-05-25T02:14:01.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:12:00+00:00 exited with status queued for try_number 1 2024-05-25T02:14:01.272364694Z [2024-05-25T02:14:01.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:13:00+00:00 exited with status queued for try_number 1 2024-05-25T02:14:01.272493977Z [2024-05-25T02:14:01.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:13:00+00:00 exited with status queued for try_number 1 2024-05-25T02:14:01.272555846Z [2024-05-25T02:14:01.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:13:00+00:00 exited with status queued for try_number 1 2024-05-25T02:14:01.282105938Z [2024-05-25T02:14:01.281+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe9c7dd9-5bd0-428f-81c9-508b3c71336e 2024-05-25T02:14:01.282267132Z [2024-05-25T02:14:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22bdb7bb-e57b-446c-9994-fb8dfc566974 2024-05-25T02:14:01.282454423Z [2024-05-25T02:14:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f070e9e-be46-443f-9e6b-d11f792bafba 2024-05-25T02:14:01.282694969Z [2024-05-25T02:14:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6817787d-28df-4eac-afc4-94632ae28a9a 2024-05-25T02:14:02.495983536Z [2024-05-25T02:14:02.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:14:02.496779766Z [2024-05-25T02:14:02.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:12:00+00:00, run_id=scheduled__2024-05-25T02:12:00+00:00, run_start_date=2024-05-25 02:14:00.814015+00:00, run_end_date=2024-05-25 02:14:02.496122+00:00, run_duration=1.682107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:12:00+00:00, data_interval_end=2024-05-25 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:14:02.516817365Z [2024-05-25T02:14:02.516+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:14:00+00:00, run_after=2024-05-25T02:16:00+00:00 2024-05-25T02:14:02.647193654Z [2024-05-25T02:14:02.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:12:00+00:00 exited with status success for try_number 1 2024-05-25T02:14:02.657067165Z [2024-05-25T02:14:02.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:12:00+00:00, map_index=-1, run_start_date=2024-05-25 02:14:01.823425+00:00, run_end_date=2024-05-25 02:14:02.289907+00:00, run_duration=0.466482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=863, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:14:00.909931+00:00, queued_by_job_id=1, pid=12725 2024-05-25T02:14:03.676996177Z [2024-05-25T02:14:03.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:14:03.677698237Z [2024-05-25T02:14:03.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:13:00+00:00, run_id=scheduled__2024-05-25T02:13:00+00:00, run_start_date=2024-05-25 02:14:00.815347+00:00, run_end_date=2024-05-25 02:14:03.676821+00:00, run_duration=2.861474, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:13:00+00:00, data_interval_end=2024-05-25 02:14:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:14:03.701880339Z [2024-05-25T02:14:03.701+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:14:00+00:00, run_after=2024-05-25T02:15:00+00:00 2024-05-25T02:14:03.774086181Z [2024-05-25T02:14:03.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:13:00+00:00 exited with status success for try_number 1 2024-05-25T02:14:03.784532572Z [2024-05-25T02:14:03.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:13:00+00:00, map_index=-1, run_start_date=2024-05-25 02:14:01.992962+00:00, run_end_date=2024-05-25 02:14:02.673004+00:00, run_duration=0.680042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=864, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:14:00.909931+00:00, queued_by_job_id=1, pid=12726 2024-05-25T02:14:05.977771382Z [2024-05-25T02:14:05.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:14:05.978265860Z [2024-05-25T02:14:05.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:13:00+00:00, run_id=scheduled__2024-05-25T02:13:00+00:00, run_start_date=2024-05-25 02:14:00.816536+00:00, run_end_date=2024-05-25 02:14:05.977539+00:00, run_duration=5.161003, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:13:00+00:00, data_interval_end=2024-05-25 02:14:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:14:05.988665456Z [2024-05-25T02:14:05.988+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:14:00+00:00, run_after=2024-05-25T02:15:00+00:00 2024-05-25T02:14:06.011652322Z [2024-05-25T02:14:06.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:14:06.011989829Z [2024-05-25T02:14:06.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:13:00+00:00, run_id=scheduled__2024-05-25T02:13:00+00:00, run_start_date=2024-05-25 02:14:00.818157+00:00, run_end_date=2024-05-25 02:14:06.011355+00:00, run_duration=5.193198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:13:00+00:00, data_interval_end=2024-05-25 02:14:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:14:06.033464402Z [2024-05-25T02:14:06.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:14:00+00:00, run_after=2024-05-25T02:15:00+00:00 2024-05-25T02:14:06.079592724Z [2024-05-25T02:14:06.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:13:00+00:00 exited with status success for try_number 1 2024-05-25T02:14:06.081303794Z [2024-05-25T02:14:06.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:13:00+00:00 exited with status success for try_number 1 2024-05-25T02:14:06.090113469Z [2024-05-25T02:14:06.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:13:00+00:00, map_index=-1, run_start_date=2024-05-25 02:14:03.434196+00:00, run_end_date=2024-05-25 02:14:04.846654+00:00, run_duration=1.412458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=866, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:14:00.909931+00:00, queued_by_job_id=1, pid=12750 2024-05-25T02:14:06.091287988Z [2024-05-25T02:14:06.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:13:00+00:00, map_index=-1, run_start_date=2024-05-25 02:14:03.265198+00:00, run_end_date=2024-05-25 02:14:05.068289+00:00, run_duration=1.803091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=865, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:14:00.909931+00:00, queued_by_job_id=1, pid=12749 2024-05-25T02:15:00.688060163Z [2024-05-25T02:15:00.687+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:15:00.706355806Z [2024-05-25T02:15:00.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:15:00+00:00, run_after=2024-05-25T02:16:00+00:00 2024-05-25T02:15:00.719467574Z [2024-05-25T02:15:00.719+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:15:00+00:00, run_after=2024-05-25T02:16:00+00:00 2024-05-25T02:15:00.729830992Z [2024-05-25T02:15:00.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:15:00+00:00, run_after=2024-05-25T02:20:00+00:00 2024-05-25T02:15:00.828073400Z [2024-05-25T02:15:00.827+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:15:00.828105114Z 2024-05-25T02:15:00.828111956Z 2024-05-25T02:15:00.828117934Z 2024-05-25T02:15:00.828122972Z 2024-05-25T02:15:00.828506360Z [2024-05-25T02:15:00.827+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:15:00.828933854Z [2024-05-25T02:15:00.828+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:15:00.829292271Z [2024-05-25T02:15:00.828+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:15:00.829748374Z [2024-05-25T02:15:00.829+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:15:00.831246030Z [2024-05-25T02:15:00.830+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:15:00.831284972Z 2024-05-25T02:15:00.831296289Z 2024-05-25T02:15:00.831304764Z 2024-05-25T02:15:00.831313464Z 2024-05-25T02:15:00.840369758Z [2024-05-25T02:15:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T02:15:00.840571782Z [2024-05-25T02:15:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:15:00.841154760Z [2024-05-25T02:15:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:15:00.841499965Z [2024-05-25T02:15:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:15:00.841982622Z [2024-05-25T02:15:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:15:00.842301377Z [2024-05-25T02:15:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:15:00.843190555Z [2024-05-25T02:15:00.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:15:00.843469781Z [2024-05-25T02:15:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:15:01.348817061Z [2024-05-25T02:15:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status queued for try_number 1 2024-05-25T02:15:01.348865625Z [2024-05-25T02:15:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:14:00+00:00 exited with status queued for try_number 1 2024-05-25T02:15:01.348870078Z [2024-05-25T02:15:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:14:00+00:00 exited with status queued for try_number 1 2024-05-25T02:15:01.348874339Z [2024-05-25T02:15:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:14:00+00:00 exited with status queued for try_number 1 2024-05-25T02:15:01.366532016Z [2024-05-25T02:15:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc6bebf9-423f-40a2-b3c2-7a512ee7a49f 2024-05-25T02:15:01.366637598Z [2024-05-25T02:15:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42055790-8d56-40c2-9acd-96509c60ddac 2024-05-25T02:15:01.366692233Z [2024-05-25T02:15:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab4b26b1-aefc-42fa-a623-f5dd0c69bc7c 2024-05-25T02:15:01.369413650Z [2024-05-25T02:15:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9ef091d-8cfd-451e-a81e-bb3ab6128df5 2024-05-25T02:15:02.669140564Z [2024-05-25T02:15:02.668+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:15:02.669686778Z [2024-05-25T02:15:02.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:14:00+00:00, run_id=scheduled__2024-05-25T02:14:00+00:00, run_start_date=2024-05-25 02:15:00.740257+00:00, run_end_date=2024-05-25 02:15:02.669102+00:00, run_duration=1.928845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:14:00+00:00, data_interval_end=2024-05-25 02:15:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:15:02.682988373Z [2024-05-25T02:15:02.682+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:15:00+00:00, run_after=2024-05-25T02:16:00+00:00 2024-05-25T02:15:02.762042803Z [2024-05-25T02:15:02.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:14:00+00:00 exited with status success for try_number 1 2024-05-25T02:15:02.770925532Z [2024-05-25T02:15:02.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:14:00+00:00, map_index=-1, run_start_date=2024-05-25 02:15:01.753266+00:00, run_end_date=2024-05-25 02:15:02.200732+00:00, run_duration=0.447466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=867, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:15:00.833446+00:00, queued_by_job_id=1, pid=12783 2024-05-25T02:15:03.905144170Z [2024-05-25T02:15:03.902+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:15:03.905181829Z 2024-05-25T02:15:03.905189402Z [2024-05-25T02:15:03.902+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:15:03.905195727Z [2024-05-25T02:15:03.903+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:15:03.905201248Z 2024-05-25T02:15:03.906469402Z [2024-05-25T02:15:03.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T02:15:03.906607872Z [2024-05-25T02:15:03.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:15:03.992336001Z [2024-05-25T02:15:03.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status queued for try_number 1 2024-05-25T02:15:03.992488340Z [2024-05-25T02:15:03.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status success for try_number 1 2024-05-25T02:15:04.006746423Z [2024-05-25T02:15:04.006+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c8105d9-f34c-4c50-a1ad-1e23ed1c114d 2024-05-25T02:15:04.007008779Z [2024-05-25T02:15:04.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T02:10:00+00:00, map_index=-1, run_start_date=2024-05-25 02:15:03.096472+00:00, run_end_date=2024-05-25 02:15:03.471181+00:00, run_duration=0.374709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=870, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:15:00.833446+00:00, queued_by_job_id=1, pid=12814 2024-05-25T02:15:04.699759207Z [2024-05-25T02:15:04.699+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:15:04.700238476Z [2024-05-25T02:15:04.700+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:14:00+00:00, run_id=scheduled__2024-05-25T02:14:00+00:00, run_start_date=2024-05-25 02:15:00.741254+00:00, run_end_date=2024-05-25 02:15:04.699911+00:00, run_duration=3.958657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:14:00+00:00, data_interval_end=2024-05-25 02:15:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:15:04.710693873Z [2024-05-25T02:15:04.710+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:15:00+00:00, run_after=2024-05-25T02:16:00+00:00 2024-05-25T02:15:04.761537122Z [2024-05-25T02:15:04.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:14:00+00:00 exited with status success for try_number 1 2024-05-25T02:15:04.762165296Z [2024-05-25T02:15:04.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:14:00+00:00 exited with status success for try_number 1 2024-05-25T02:15:04.775921818Z [2024-05-25T02:15:04.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:14:00+00:00, map_index=-1, run_start_date=2024-05-25 02:15:02.942424+00:00, run_end_date=2024-05-25 02:15:04.218983+00:00, run_duration=1.276559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=869, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:15:00.833446+00:00, queued_by_job_id=1, pid=12808 2024-05-25T02:15:04.776612848Z [2024-05-25T02:15:04.776+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:14:00+00:00, map_index=-1, run_start_date=2024-05-25 02:15:02.771135+00:00, run_end_date=2024-05-25 02:15:04.579286+00:00, run_duration=1.808151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=868, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:15:00.833446+00:00, queued_by_job_id=1, pid=12802 2024-05-25T02:15:05.836979343Z [2024-05-25T02:15:05.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:15:05.838713661Z [2024-05-25T02:15:05.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:14:00+00:00, run_id=scheduled__2024-05-25T02:14:00+00:00, run_start_date=2024-05-25 02:15:00.742143+00:00, run_end_date=2024-05-25 02:15:05.837572+00:00, run_duration=5.095429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:14:00+00:00, data_interval_end=2024-05-25 02:15:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:15:05.848395075Z [2024-05-25T02:15:05.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:15:00+00:00, run_after=2024-05-25T02:16:00+00:00 2024-05-25T02:15:06.609297799Z [2024-05-25T02:15:06.608+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:15:06.609348236Z 2024-05-25T02:15:06.609389613Z [2024-05-25T02:15:06.609+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:15:06.610201512Z [2024-05-25T02:15:06.609+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:15:06.610222975Z 2024-05-25T02:15:06.612419944Z [2024-05-25T02:15:06.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T02:15:06.612656980Z [2024-05-25T02:15:06.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:15:06.696895049Z [2024-05-25T02:15:06.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status queued for try_number 1 2024-05-25T02:15:06.697076512Z [2024-05-25T02:15:06.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status success for try_number 1 2024-05-25T02:15:06.704590359Z [2024-05-25T02:15:06.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to c58491c9-c774-4f8e-a4c1-d1ebaca60207 2024-05-25T02:15:06.704869105Z [2024-05-25T02:15:06.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T02:10:00+00:00, map_index=-1, run_start_date=2024-05-25 02:15:05.558248+00:00, run_end_date=2024-05-25 02:15:05.937510+00:00, run_duration=0.379262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=871, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:15:03.903935+00:00, queued_by_job_id=1, pid=12832 2024-05-25T02:15:09.012100043Z [2024-05-25T02:15:09.011+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:15:09.012142473Z 2024-05-25T02:15:09.012749989Z [2024-05-25T02:15:09.012+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:15:09.013684619Z [2024-05-25T02:15:09.013+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:15:09.013707822Z 2024-05-25T02:15:09.017054088Z [2024-05-25T02:15:09.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:15:09.017472673Z [2024-05-25T02:15:09.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:15:09.112077653Z [2024-05-25T02:15:09.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status queued for try_number 1 2024-05-25T02:15:09.112269319Z [2024-05-25T02:15:09.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status success for try_number 1 2024-05-25T02:15:09.120231519Z [2024-05-25T02:15:09.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3775e8c6-ecf7-40ac-bac2-8c7b09c2074a 2024-05-25T02:15:09.120583625Z [2024-05-25T02:15:09.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T02:10:00+00:00, map_index=0, run_start_date=2024-05-25 02:15:08.484324+00:00, run_end_date=2024-05-25 02:15:08.915820+00:00, run_duration=0.431496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=872, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:15:06.610560+00:00, queued_by_job_id=1, pid=12853 2024-05-25T02:15:12.083296114Z [2024-05-25T02:15:12.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:15:12.083491230Z [2024-05-25T02:15:12.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:10:00+00:00, run_id=scheduled__2024-05-25T02:10:00+00:00, run_start_date=2024-05-25 02:15:00.739148+00:00, run_end_date=2024-05-25 02:15:12.083115+00:00, run_duration=11.343967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:10:00+00:00, data_interval_end=2024-05-25 02:15:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T02:15:12.092298841Z [2024-05-25T02:15:12.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:15:00+00:00, run_after=2024-05-25T02:20:00+00:00 2024-05-25T02:15:12.145086354Z [2024-05-25T02:15:12.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:10:00+00:00 exited with status success for try_number 1 2024-05-25T02:15:12.164245973Z [2024-05-25T02:15:12.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T02:10:00+00:00, map_index=-1, run_start_date=2024-05-25 02:15:10.655661+00:00, run_end_date=2024-05-25 02:15:11.095709+00:00, run_duration=0.440048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=873, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:15:09.014324+00:00, queued_by_job_id=1, pid=12861 2024-05-25T02:15:29.883058092Z [2024-05-25T02:15:29.882+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T02:16:00.665370233Z [2024-05-25T02:16:00.664+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:16:00+00:00, run_after=2024-05-25T02:17:00+00:00 2024-05-25T02:16:00.680573728Z [2024-05-25T02:16:00.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:16:00+00:00, run_after=2024-05-25T02:17:00+00:00 2024-05-25T02:16:00.688216833Z [2024-05-25T02:16:00.687+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:16:00.695273724Z [2024-05-25T02:16:00.694+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:16:00.789893259Z [2024-05-25T02:16:00.788+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:16:00.789935467Z 2024-05-25T02:16:00.789945658Z 2024-05-25T02:16:00.789954252Z 2024-05-25T02:16:00.789962544Z 2024-05-25T02:16:00.790151399Z [2024-05-25T02:16:00.789+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:16:00.790410415Z [2024-05-25T02:16:00.790+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:16:00.790686651Z [2024-05-25T02:16:00.790+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:16:00.790929829Z [2024-05-25T02:16:00.790+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:16:00.792182468Z [2024-05-25T02:16:00.791+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:16:00.792209416Z 2024-05-25T02:16:00.792218686Z 2024-05-25T02:16:00.792227186Z 2024-05-25T02:16:00.792235026Z 2024-05-25T02:16:00.797920655Z [2024-05-25T02:16:00.797+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:16:00.798130274Z [2024-05-25T02:16:00.797+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:16:00.798491953Z [2024-05-25T02:16:00.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:16:00.798663407Z [2024-05-25T02:16:00.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:16:00.798997008Z [2024-05-25T02:16:00.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:16:00.799197731Z [2024-05-25T02:16:00.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:16:00.799541430Z [2024-05-25T02:16:00.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:16:00.799753996Z [2024-05-25T02:16:00.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:16:01.386419863Z [2024-05-25T02:16:01.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:14:00+00:00 exited with status queued for try_number 1 2024-05-25T02:16:01.387982621Z [2024-05-25T02:16:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status queued for try_number 1 2024-05-25T02:16:01.387996597Z [2024-05-25T02:16:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status queued for try_number 1 2024-05-25T02:16:01.388000354Z [2024-05-25T02:16:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status queued for try_number 1 2024-05-25T02:16:01.420101113Z [2024-05-25T02:16:01.418+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c1887ea-994e-4c8d-9cbc-a2bc33355282 2024-05-25T02:16:01.420132854Z [2024-05-25T02:16:01.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6bbc7d3-dbb6-45e9-8849-7d561fa7d836 2024-05-25T02:16:01.420136605Z [2024-05-25T02:16:01.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9518afa8-9423-4401-9b89-67fb582afc9b 2024-05-25T02:16:01.420139849Z [2024-05-25T02:16:01.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67fb1598-1202-4cdd-9b50-8cfa3b1e6cfd 2024-05-25T02:16:03.809565165Z [2024-05-25T02:16:03.808+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:16:03.810036517Z [2024-05-25T02:16:03.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:14:00+00:00, run_id=scheduled__2024-05-25T02:14:00+00:00, run_start_date=2024-05-25 02:16:00.705975+00:00, run_end_date=2024-05-25 02:16:03.809390+00:00, run_duration=3.103415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:14:00+00:00, data_interval_end=2024-05-25 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:16:03.825233079Z [2024-05-25T02:16:03.824+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:16:00+00:00, run_after=2024-05-25T02:18:00+00:00 2024-05-25T02:16:03.832766554Z [2024-05-25T02:16:03.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:16:03.833128389Z [2024-05-25T02:16:03.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:15:00+00:00, run_id=scheduled__2024-05-25T02:15:00+00:00, run_start_date=2024-05-25 02:16:00.707531+00:00, run_end_date=2024-05-25 02:16:03.832650+00:00, run_duration=3.125119, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:15:00+00:00, data_interval_end=2024-05-25 02:16:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:16:03.848477043Z [2024-05-25T02:16:03.848+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:16:00+00:00, run_after=2024-05-25T02:17:00+00:00 2024-05-25T02:16:03.952366886Z [2024-05-25T02:16:03.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:14:00+00:00 exited with status success for try_number 1 2024-05-25T02:16:03.952402291Z [2024-05-25T02:16:03.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status success for try_number 1 2024-05-25T02:16:03.958658889Z [2024-05-25T02:16:03.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:15:00+00:00, map_index=-1, run_start_date=2024-05-25 02:16:02.137171+00:00, run_end_date=2024-05-25 02:16:02.867589+00:00, run_duration=0.730418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=875, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:16:00.793726+00:00, queued_by_job_id=1, pid=12873 2024-05-25T02:16:03.958698567Z [2024-05-25T02:16:03.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:14:00+00:00, map_index=-1, run_start_date=2024-05-25 02:16:02.096578+00:00, run_end_date=2024-05-25 02:16:02.749658+00:00, run_duration=0.65308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=874, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:16:00.793726+00:00, queued_by_job_id=1, pid=12872 2024-05-25T02:16:06.070853988Z [2024-05-25T02:16:06.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:16:06.071011175Z [2024-05-25T02:16:06.070+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:15:00+00:00, run_id=scheduled__2024-05-25T02:15:00+00:00, run_start_date=2024-05-25 02:16:00.708662+00:00, run_end_date=2024-05-25 02:16:06.070747+00:00, run_duration=5.362085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:15:00+00:00, data_interval_end=2024-05-25 02:16:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:16:06.081894041Z [2024-05-25T02:16:06.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:16:00+00:00, run_after=2024-05-25T02:17:00+00:00 2024-05-25T02:16:06.089440036Z [2024-05-25T02:16:06.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:16:06.089802799Z [2024-05-25T02:16:06.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:15:00+00:00, run_id=scheduled__2024-05-25T02:15:00+00:00, run_start_date=2024-05-25 02:16:00.709681+00:00, run_end_date=2024-05-25 02:16:06.089488+00:00, run_duration=5.379807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:15:00+00:00, data_interval_end=2024-05-25 02:16:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:16:06.098701476Z [2024-05-25T02:16:06.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:16:00+00:00, run_after=2024-05-25T02:17:00+00:00 2024-05-25T02:16:06.183294960Z [2024-05-25T02:16:06.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status success for try_number 1 2024-05-25T02:16:06.183573621Z [2024-05-25T02:16:06.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status success for try_number 1 2024-05-25T02:16:06.189178647Z [2024-05-25T02:16:06.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:15:00+00:00, map_index=-1, run_start_date=2024-05-25 02:16:03.156134+00:00, run_end_date=2024-05-25 02:16:05.982987+00:00, run_duration=2.826853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=876, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:16:00.793726+00:00, queued_by_job_id=1, pid=12890 2024-05-25T02:16:06.189426316Z [2024-05-25T02:16:06.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:15:00+00:00, map_index=-1, run_start_date=2024-05-25 02:16:03.374774+00:00, run_end_date=2024-05-25 02:16:05.879976+00:00, run_duration=2.505202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=877, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:16:00.793726+00:00, queued_by_job_id=1, pid=12896 2024-05-25T02:17:00.189913562Z [2024-05-25T02:17:00.189+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:17:00.207947429Z [2024-05-25T02:17:00.207+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:17:00+00:00, run_after=2024-05-25T02:18:00+00:00 2024-05-25T02:17:00.221423791Z [2024-05-25T02:17:00.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:17:00+00:00, run_after=2024-05-25T02:18:00+00:00 2024-05-25T02:17:00.307739083Z [2024-05-25T02:17:00.307+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:17:00.307820506Z 2024-05-25T02:17:00.307828109Z 2024-05-25T02:17:00.307834909Z 2024-05-25T02:17:00.307864776Z [2024-05-25T02:17:00.307+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:17:00.308101660Z [2024-05-25T02:17:00.307+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:17:00.308384340Z [2024-05-25T02:17:00.308+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:17:00.309298283Z [2024-05-25T02:17:00.308+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:17:00.309316270Z 2024-05-25T02:17:00.309321317Z 2024-05-25T02:17:00.309325875Z 2024-05-25T02:17:00.315087614Z [2024-05-25T02:17:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:17:00.315378928Z [2024-05-25T02:17:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:17:00.316090698Z [2024-05-25T02:17:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:17:00.316681504Z [2024-05-25T02:17:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:17:00.317380820Z [2024-05-25T02:17:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:17:00.317887615Z [2024-05-25T02:17:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:17:00.528762404Z [2024-05-25T02:17:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:16:00+00:00 exited with status queued for try_number 1 2024-05-25T02:17:00.529886316Z [2024-05-25T02:17:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:16:00+00:00 exited with status queued for try_number 1 2024-05-25T02:17:00.530030146Z [2024-05-25T02:17:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:16:00+00:00 exited with status queued for try_number 1 2024-05-25T02:17:00.540200644Z [2024-05-25T02:17:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to a636e889-bc37-4f81-99d1-14e15defef60 2024-05-25T02:17:00.540342973Z [2024-05-25T02:17:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a415ab3-09f1-4b06-b074-b0ef1d226e26 2024-05-25T02:17:00.540467140Z [2024-05-25T02:17:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad5bf752-4192-471e-9c9f-c0ad600f70c8 2024-05-25T02:17:01.693672666Z [2024-05-25T02:17:01.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:17:01.695751102Z [2024-05-25T02:17:01.694+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:16:00+00:00, run_id=scheduled__2024-05-25T02:16:00+00:00, run_start_date=2024-05-25 02:17:00.236538+00:00, run_end_date=2024-05-25 02:17:01.693574+00:00, run_duration=1.457036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:16:00+00:00, data_interval_end=2024-05-25 02:17:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:17:01.705554245Z [2024-05-25T02:17:01.705+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:17:00+00:00, run_after=2024-05-25T02:18:00+00:00 2024-05-25T02:17:01.767713867Z [2024-05-25T02:17:01.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:16:00+00:00 exited with status success for try_number 1 2024-05-25T02:17:01.776452088Z [2024-05-25T02:17:01.776+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:16:00+00:00, map_index=-1, run_start_date=2024-05-25 02:17:01.083377+00:00, run_end_date=2024-05-25 02:17:01.554784+00:00, run_duration=0.471407, state=success, executor_state=success, try_number=1, max_tries=1, job_id=878, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:17:00.310278+00:00, queued_by_job_id=1, pid=12928 2024-05-25T02:17:04.624880810Z [2024-05-25T02:17:04.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:17:04.625421569Z [2024-05-25T02:17:04.624+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:16:00+00:00, run_id=scheduled__2024-05-25T02:16:00+00:00, run_start_date=2024-05-25 02:17:00.238010+00:00, run_end_date=2024-05-25 02:17:04.624580+00:00, run_duration=4.38657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:16:00+00:00, data_interval_end=2024-05-25 02:17:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:17:04.637080545Z [2024-05-25T02:17:04.636+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:17:00+00:00, run_after=2024-05-25T02:18:00+00:00 2024-05-25T02:17:04.644014241Z [2024-05-25T02:17:04.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:17:04.644282187Z [2024-05-25T02:17:04.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:16:00+00:00, run_id=scheduled__2024-05-25T02:16:00+00:00, run_start_date=2024-05-25 02:17:00.239255+00:00, run_end_date=2024-05-25 02:17:04.643848+00:00, run_duration=4.404593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:16:00+00:00, data_interval_end=2024-05-25 02:17:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:17:04.653263836Z [2024-05-25T02:17:04.652+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:17:00+00:00, run_after=2024-05-25T02:18:00+00:00 2024-05-25T02:17:04.696433424Z [2024-05-25T02:17:04.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:16:00+00:00 exited with status success for try_number 1 2024-05-25T02:17:04.696728944Z [2024-05-25T02:17:04.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:16:00+00:00 exited with status success for try_number 1 2024-05-25T02:17:04.709092360Z [2024-05-25T02:17:04.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:16:00+00:00, map_index=-1, run_start_date=2024-05-25 02:17:02.247062+00:00, run_end_date=2024-05-25 02:17:04.035498+00:00, run_duration=1.788436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=880, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:17:00.310278+00:00, queued_by_job_id=1, pid=12947 2024-05-25T02:17:04.710304142Z [2024-05-25T02:17:04.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:16:00+00:00, map_index=-1, run_start_date=2024-05-25 02:17:02.163706+00:00, run_end_date=2024-05-25 02:17:03.516969+00:00, run_duration=1.353263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=879, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:17:00.310278+00:00, queued_by_job_id=1, pid=12946 2024-05-25T02:18:00.401280234Z [2024-05-25T02:18:00.400+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:18:00+00:00, run_after=2024-05-25T02:19:00+00:00 2024-05-25T02:18:00.411584087Z [2024-05-25T02:18:00.411+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:18:00.419511820Z [2024-05-25T02:18:00.419+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:18:00.434057092Z [2024-05-25T02:18:00.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:18:00+00:00, run_after=2024-05-25T02:19:00+00:00 2024-05-25T02:18:00.542050703Z [2024-05-25T02:18:00.541+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:18:00.542082921Z 2024-05-25T02:18:00.542097227Z 2024-05-25T02:18:00.542103954Z 2024-05-25T02:18:00.542110382Z 2024-05-25T02:18:00.542303412Z [2024-05-25T02:18:00.541+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:18:00.542686995Z [2024-05-25T02:18:00.542+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:18:00.542923661Z [2024-05-25T02:18:00.542+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:18:00.543377974Z [2024-05-25T02:18:00.543+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:18:00.544931436Z [2024-05-25T02:18:00.544+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:18:00.544950774Z 2024-05-25T02:18:00.544957517Z 2024-05-25T02:18:00.544963648Z 2024-05-25T02:18:00.544969450Z 2024-05-25T02:18:00.552650490Z [2024-05-25T02:18:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:18:00.553103538Z [2024-05-25T02:18:00.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:18:00.553824628Z [2024-05-25T02:18:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:18:00.554258051Z [2024-05-25T02:18:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:18:00.554703646Z [2024-05-25T02:18:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:18:00.554929440Z [2024-05-25T02:18:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:18:00.555290051Z [2024-05-25T02:18:00.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:18:00.556121427Z [2024-05-25T02:18:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:18:00.848051764Z [2024-05-25T02:18:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:16:00+00:00 exited with status queued for try_number 1 2024-05-25T02:18:00.848414142Z [2024-05-25T02:18:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:17:00+00:00 exited with status queued for try_number 1 2024-05-25T02:18:00.848581152Z [2024-05-25T02:18:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:17:00+00:00 exited with status queued for try_number 1 2024-05-25T02:18:00.848757419Z [2024-05-25T02:18:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:17:00+00:00 exited with status queued for try_number 1 2024-05-25T02:18:00.857914801Z [2024-05-25T02:18:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4b6c42d-16b5-4eed-9037-ae87ce8c0332 2024-05-25T02:18:00.858153727Z [2024-05-25T02:18:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9c5d95a-a952-40b4-bc3d-e950864d3090 2024-05-25T02:18:00.858376614Z [2024-05-25T02:18:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to d078bc3e-1afa-4663-95f6-9ced6305195e 2024-05-25T02:18:00.858564720Z [2024-05-25T02:18:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to feabf2cd-cb4e-4c7b-b996-35d10c612b2d 2024-05-25T02:18:02.054929954Z [2024-05-25T02:18:02.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:18:02.055169720Z [2024-05-25T02:18:02.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:16:00+00:00, run_id=scheduled__2024-05-25T02:16:00+00:00, run_start_date=2024-05-25 02:18:00.447309+00:00, run_end_date=2024-05-25 02:18:02.054841+00:00, run_duration=1.607532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:16:00+00:00, data_interval_end=2024-05-25 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:18:02.071674667Z [2024-05-25T02:18:02.071+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:18:00+00:00, run_after=2024-05-25T02:20:00+00:00 2024-05-25T02:18:02.084305483Z [2024-05-25T02:18:02.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:18:02.084730887Z [2024-05-25T02:18:02.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:17:00+00:00, run_id=scheduled__2024-05-25T02:17:00+00:00, run_start_date=2024-05-25 02:18:00.448853+00:00, run_end_date=2024-05-25 02:18:02.084237+00:00, run_duration=1.635384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:17:00+00:00, data_interval_end=2024-05-25 02:18:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:18:02.099437399Z [2024-05-25T02:18:02.099+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:18:00+00:00, run_after=2024-05-25T02:19:00+00:00 2024-05-25T02:18:02.172717147Z [2024-05-25T02:18:02.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:16:00+00:00 exited with status success for try_number 1 2024-05-25T02:18:02.172791509Z [2024-05-25T02:18:02.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:17:00+00:00 exited with status success for try_number 1 2024-05-25T02:18:02.193287763Z [2024-05-25T02:18:02.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:17:00+00:00, map_index=-1, run_start_date=2024-05-25 02:18:01.442440+00:00, run_end_date=2024-05-25 02:18:01.901295+00:00, run_duration=0.458855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=882, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:18:00.547359+00:00, queued_by_job_id=1, pid=12981 2024-05-25T02:18:02.193818542Z [2024-05-25T02:18:02.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:16:00+00:00, map_index=-1, run_start_date=2024-05-25 02:18:01.320714+00:00, run_end_date=2024-05-25 02:18:01.748833+00:00, run_duration=0.428119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=881, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:18:00.547359+00:00, queued_by_job_id=1, pid=12980 2024-05-25T02:18:05.497595273Z [2024-05-25T02:18:05.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:18:05.498302625Z [2024-05-25T02:18:05.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:17:00+00:00, run_id=scheduled__2024-05-25T02:17:00+00:00, run_start_date=2024-05-25 02:18:00.450110+00:00, run_end_date=2024-05-25 02:18:05.497410+00:00, run_duration=5.0473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:17:00+00:00, data_interval_end=2024-05-25 02:18:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:18:05.509587431Z [2024-05-25T02:18:05.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:18:00+00:00, run_after=2024-05-25T02:19:00+00:00 2024-05-25T02:18:05.516630519Z [2024-05-25T02:18:05.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:18:05.516961040Z [2024-05-25T02:18:05.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:17:00+00:00, run_id=scheduled__2024-05-25T02:17:00+00:00, run_start_date=2024-05-25 02:18:00.451199+00:00, run_end_date=2024-05-25 02:18:05.516503+00:00, run_duration=5.065304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:17:00+00:00, data_interval_end=2024-05-25 02:18:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:18:05.534248007Z [2024-05-25T02:18:05.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:18:00+00:00, run_after=2024-05-25T02:19:00+00:00 2024-05-25T02:18:05.600479129Z [2024-05-25T02:18:05.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:17:00+00:00 exited with status success for try_number 1 2024-05-25T02:18:05.600891473Z [2024-05-25T02:18:05.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:17:00+00:00 exited with status success for try_number 1 2024-05-25T02:18:05.611339433Z [2024-05-25T02:18:05.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:17:00+00:00, map_index=-1, run_start_date=2024-05-25 02:18:02.772142+00:00, run_end_date=2024-05-25 02:18:05.164849+00:00, run_duration=2.392707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=883, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:18:00.547359+00:00, queued_by_job_id=1, pid=13004 2024-05-25T02:18:05.611834843Z [2024-05-25T02:18:05.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:17:00+00:00, map_index=-1, run_start_date=2024-05-25 02:18:02.803753+00:00, run_end_date=2024-05-25 02:18:04.671534+00:00, run_duration=1.867781, state=success, executor_state=success, try_number=1, max_tries=1, job_id=884, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:18:00.547359+00:00, queued_by_job_id=1, pid=13005 2024-05-25T02:19:00.679003810Z [2024-05-25T02:19:00.678+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:19:00+00:00, run_after=2024-05-25T02:20:00+00:00 2024-05-25T02:19:00.689091694Z [2024-05-25T02:19:00.688+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:19:00.715787975Z [2024-05-25T02:19:00.715+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:19:00+00:00, run_after=2024-05-25T02:20:00+00:00 2024-05-25T02:19:00.803074265Z [2024-05-25T02:19:00.802+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:19:00.803111707Z 2024-05-25T02:19:00.803119610Z 2024-05-25T02:19:00.803126496Z 2024-05-25T02:19:00.803598218Z [2024-05-25T02:19:00.802+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:19:00.804030441Z [2024-05-25T02:19:00.803+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:19:00.804464144Z [2024-05-25T02:19:00.804+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:19:00.805779707Z [2024-05-25T02:19:00.805+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:19:00.805815981Z 2024-05-25T02:19:00.805823306Z 2024-05-25T02:19:00.805829919Z 2024-05-25T02:19:00.812103298Z [2024-05-25T02:19:00.811+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:19:00.812501438Z [2024-05-25T02:19:00.811+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:19:00.812923135Z [2024-05-25T02:19:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:19:00.813160983Z [2024-05-25T02:19:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:19:00.813561915Z [2024-05-25T02:19:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:19:00.813774282Z [2024-05-25T02:19:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:19:01.048565464Z [2024-05-25T02:19:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:18:00+00:00 exited with status queued for try_number 1 2024-05-25T02:19:01.048796942Z [2024-05-25T02:19:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:18:00+00:00 exited with status queued for try_number 1 2024-05-25T02:19:01.048971604Z [2024-05-25T02:19:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:18:00+00:00 exited with status queued for try_number 1 2024-05-25T02:19:01.060101687Z [2024-05-25T02:19:01.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa5055a8-f8db-423a-bc8b-6749ea1361f9 2024-05-25T02:19:01.060337904Z [2024-05-25T02:19:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to e297f9bd-58e6-4cd7-b115-272618e6f085 2024-05-25T02:19:01.060554645Z [2024-05-25T02:19:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 610aa79f-70c0-4e8c-9980-f5b6311710f6 2024-05-25T02:19:03.400664182Z [2024-05-25T02:19:03.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:19:03.401272982Z [2024-05-25T02:19:03.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:18:00+00:00, run_id=scheduled__2024-05-25T02:18:00+00:00, run_start_date=2024-05-25 02:19:00.731156+00:00, run_end_date=2024-05-25 02:19:03.400772+00:00, run_duration=2.669616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:18:00+00:00, data_interval_end=2024-05-25 02:19:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:19:03.421162218Z [2024-05-25T02:19:03.420+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:19:00+00:00, run_after=2024-05-25T02:20:00+00:00 2024-05-25T02:19:03.476190304Z [2024-05-25T02:19:03.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:18:00+00:00 exited with status success for try_number 1 2024-05-25T02:19:03.482522958Z [2024-05-25T02:19:03.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:18:00+00:00, map_index=-1, run_start_date=2024-05-25 02:19:01.723010+00:00, run_end_date=2024-05-25 02:19:02.122019+00:00, run_duration=0.399009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=885, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:19:00.807789+00:00, queued_by_job_id=1, pid=13037 2024-05-25T02:19:05.387850883Z [2024-05-25T02:19:05.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:19:05.388799536Z [2024-05-25T02:19:05.388+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:18:00+00:00, run_id=scheduled__2024-05-25T02:18:00+00:00, run_start_date=2024-05-25 02:19:00.732740+00:00, run_end_date=2024-05-25 02:19:05.388036+00:00, run_duration=4.655296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:18:00+00:00, data_interval_end=2024-05-25 02:19:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:19:05.402209386Z [2024-05-25T02:19:05.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:19:00+00:00, run_after=2024-05-25T02:20:00+00:00 2024-05-25T02:19:05.414801288Z [2024-05-25T02:19:05.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:19:05.415140161Z [2024-05-25T02:19:05.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:18:00+00:00, run_id=scheduled__2024-05-25T02:18:00+00:00, run_start_date=2024-05-25 02:19:00.734557+00:00, run_end_date=2024-05-25 02:19:05.414588+00:00, run_duration=4.680031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:18:00+00:00, data_interval_end=2024-05-25 02:19:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:19:05.435455868Z [2024-05-25T02:19:05.434+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:19:00+00:00, run_after=2024-05-25T02:20:00+00:00 2024-05-25T02:19:05.473424578Z [2024-05-25T02:19:05.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:18:00+00:00 exited with status success for try_number 1 2024-05-25T02:19:05.473463296Z [2024-05-25T02:19:05.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:18:00+00:00 exited with status success for try_number 1 2024-05-25T02:19:05.487014536Z [2024-05-25T02:19:05.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:18:00+00:00, map_index=-1, run_start_date=2024-05-25 02:19:02.901135+00:00, run_end_date=2024-05-25 02:19:04.638635+00:00, run_duration=1.7375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=886, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:19:00.807789+00:00, queued_by_job_id=1, pid=13055 2024-05-25T02:19:05.487385255Z [2024-05-25T02:19:05.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:18:00+00:00, map_index=-1, run_start_date=2024-05-25 02:19:03.038977+00:00, run_end_date=2024-05-25 02:19:05.170081+00:00, run_duration=2.131104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=887, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:19:00.807789+00:00, queued_by_job_id=1, pid=13056 2024-05-25T02:20:00.142275083Z [2024-05-25T02:20:00.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:20:00+00:00, run_after=2024-05-25T02:25:00+00:00 2024-05-25T02:20:00.157903261Z [2024-05-25T02:20:00.157+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:20:00+00:00, run_after=2024-05-25T02:21:00+00:00 2024-05-25T02:20:00.165489909Z [2024-05-25T02:20:00.165+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:20:00.177323829Z [2024-05-25T02:20:00.176+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:20:00+00:00, run_after=2024-05-25T02:21:00+00:00 2024-05-25T02:20:00.183849176Z [2024-05-25T02:20:00.183+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:20:00.277320589Z [2024-05-25T02:20:00.276+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T02:20:00.277372076Z 2024-05-25T02:20:00.277378621Z 2024-05-25T02:20:00.277394404Z 2024-05-25T02:20:00.277400133Z 2024-05-25T02:20:00.277405708Z 2024-05-25T02:20:00.277746519Z [2024-05-25T02:20:00.277+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:20:00.278099432Z [2024-05-25T02:20:00.277+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:20:00.278482225Z [2024-05-25T02:20:00.278+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:20:00.278844982Z [2024-05-25T02:20:00.278+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:20:00.279160539Z [2024-05-25T02:20:00.278+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:20:00.280312840Z [2024-05-25T02:20:00.280+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:20:00.280325848Z 2024-05-25T02:20:00.280331211Z 2024-05-25T02:20:00.280356100Z 2024-05-25T02:20:00.280360871Z 2024-05-25T02:20:00.280364979Z 2024-05-25T02:20:00.286486910Z [2024-05-25T02:20:00.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T02:20:00.288226290Z [2024-05-25T02:20:00.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:20:00.288708377Z [2024-05-25T02:20:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:20:00.289006406Z [2024-05-25T02:20:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:20:00.289453983Z [2024-05-25T02:20:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:20:00.289758875Z [2024-05-25T02:20:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:20:00.290165387Z [2024-05-25T02:20:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:20:00.290808708Z [2024-05-25T02:20:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:20:00.291337390Z [2024-05-25T02:20:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:20:00.291657770Z [2024-05-25T02:20:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:20:00.946420602Z [2024-05-25T02:20:00.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status queued for try_number 1 2024-05-25T02:20:00.946645995Z [2024-05-25T02:20:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:18:00+00:00 exited with status queued for try_number 1 2024-05-25T02:20:00.946818535Z [2024-05-25T02:20:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:19:00+00:00 exited with status queued for try_number 1 2024-05-25T02:20:00.946969193Z [2024-05-25T02:20:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:19:00+00:00 exited with status queued for try_number 1 2024-05-25T02:20:00.947130292Z [2024-05-25T02:20:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:19:00+00:00 exited with status queued for try_number 1 2024-05-25T02:20:00.967840911Z [2024-05-25T02:20:00.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ba03f29-40a3-46b9-8b67-c3908cbb361e 2024-05-25T02:20:00.968175416Z [2024-05-25T02:20:00.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4f209e9-77fc-4797-9e2c-3efe36f77f58 2024-05-25T02:20:00.968421026Z [2024-05-25T02:20:00.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffeebc4f-8250-49b8-98d6-033700718c43 2024-05-25T02:20:00.968624132Z [2024-05-25T02:20:00.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7771176d-9f2a-4f86-a706-e658a2e714be 2024-05-25T02:20:00.968824010Z [2024-05-25T02:20:00.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f32c48b-a334-4a22-997f-f6792f92340c 2024-05-25T02:20:02.330630976Z [2024-05-25T02:20:02.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:20:02.330969746Z [2024-05-25T02:20:02.330+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:19:00+00:00, run_id=scheduled__2024-05-25T02:19:00+00:00, run_start_date=2024-05-25 02:20:00.195372+00:00, run_end_date=2024-05-25 02:20:02.330555+00:00, run_duration=2.135183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:19:00+00:00, data_interval_end=2024-05-25 02:20:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:20:02.341351442Z [2024-05-25T02:20:02.341+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:20:00+00:00, run_after=2024-05-25T02:21:00+00:00 2024-05-25T02:20:02.371088493Z [2024-05-25T02:20:02.370+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:20:02.371432584Z [2024-05-25T02:20:02.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:18:00+00:00, run_id=scheduled__2024-05-25T02:18:00+00:00, run_start_date=2024-05-25 02:20:00.194249+00:00, run_end_date=2024-05-25 02:20:02.371052+00:00, run_duration=2.176803, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:18:00+00:00, data_interval_end=2024-05-25 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:20:02.379516089Z [2024-05-25T02:20:02.379+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:20:00+00:00, run_after=2024-05-25T02:22:00+00:00 2024-05-25T02:20:02.437280806Z [2024-05-25T02:20:02.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:18:00+00:00 exited with status success for try_number 1 2024-05-25T02:20:02.437361087Z [2024-05-25T02:20:02.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:19:00+00:00 exited with status success for try_number 1 2024-05-25T02:20:02.443671163Z [2024-05-25T02:20:02.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:19:00+00:00, map_index=-1, run_start_date=2024-05-25 02:20:01.337763+00:00, run_end_date=2024-05-25 02:20:02.046548+00:00, run_duration=0.708785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=888, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:20:00.282091+00:00, queued_by_job_id=1, pid=13090 2024-05-25T02:20:02.443805023Z [2024-05-25T02:20:02.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:18:00+00:00, map_index=-1, run_start_date=2024-05-25 02:20:01.767799+00:00, run_end_date=2024-05-25 02:20:02.115133+00:00, run_duration=0.347334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=889, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:20:00.282091+00:00, queued_by_job_id=1, pid=13092 2024-05-25T02:20:04.609963778Z [2024-05-25T02:20:04.609+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:20:04.610976929Z [2024-05-25T02:20:04.609+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:19:00+00:00, run_id=scheduled__2024-05-25T02:19:00+00:00, run_start_date=2024-05-25 02:20:00.196358+00:00, run_end_date=2024-05-25 02:20:04.609685+00:00, run_duration=4.413327, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:19:00+00:00, data_interval_end=2024-05-25 02:20:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:20:04.623121155Z [2024-05-25T02:20:04.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:20:00+00:00, run_after=2024-05-25T02:21:00+00:00 2024-05-25T02:20:04.632195181Z [2024-05-25T02:20:04.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:20:04.632415187Z [2024-05-25T02:20:04.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:19:00+00:00, run_id=scheduled__2024-05-25T02:19:00+00:00, run_start_date=2024-05-25 02:20:00.197412+00:00, run_end_date=2024-05-25 02:20:04.631847+00:00, run_duration=4.434435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:19:00+00:00, data_interval_end=2024-05-25 02:20:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:20:04.647245281Z [2024-05-25T02:20:04.646+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:20:00+00:00, run_after=2024-05-25T02:21:00+00:00 2024-05-25T02:20:04.677151137Z [2024-05-25T02:20:04.676+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:20:04.677239859Z 2024-05-25T02:20:04.677556935Z [2024-05-25T02:20:04.677+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:20:04.678313950Z [2024-05-25T02:20:04.678+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:20:04.678328141Z 2024-05-25T02:20:04.687657777Z [2024-05-25T02:20:04.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T02:20:04.687690394Z [2024-05-25T02:20:04.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:20:04.796632201Z [2024-05-25T02:20:04.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status queued for try_number 1 2024-05-25T02:20:04.796654681Z [2024-05-25T02:20:04.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status success for try_number 1 2024-05-25T02:20:04.796658663Z [2024-05-25T02:20:04.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:19:00+00:00 exited with status success for try_number 1 2024-05-25T02:20:04.796691954Z [2024-05-25T02:20:04.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:19:00+00:00 exited with status success for try_number 1 2024-05-25T02:20:04.803582871Z [2024-05-25T02:20:04.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T02:15:00+00:00, map_index=-1, run_start_date=2024-05-25 02:20:03.192391+00:00, run_end_date=2024-05-25 02:20:03.666352+00:00, run_duration=0.473961, state=success, executor_state=success, try_number=1, max_tries=1, job_id=892, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:20:00.282091+00:00, queued_by_job_id=1, pid=13127 2024-05-25T02:20:04.803876937Z [2024-05-25T02:20:04.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:19:00+00:00, map_index=-1, run_start_date=2024-05-25 02:20:02.997735+00:00, run_end_date=2024-05-25 02:20:04.283817+00:00, run_duration=1.286082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=891, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:20:00.282091+00:00, queued_by_job_id=1, pid=13121 2024-05-25T02:20:04.804184137Z [2024-05-25T02:20:04.803+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2bac30a-9056-4007-9d00-9a06b024e3c7 2024-05-25T02:20:04.804363733Z [2024-05-25T02:20:04.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:19:00+00:00, map_index=-1, run_start_date=2024-05-25 02:20:02.791312+00:00, run_end_date=2024-05-25 02:20:04.431583+00:00, run_duration=1.640271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=890, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:20:00.282091+00:00, queued_by_job_id=1, pid=13115 2024-05-25T02:20:07.207941445Z [2024-05-25T02:20:07.207+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:20:07.208031246Z 2024-05-25T02:20:07.208061599Z [2024-05-25T02:20:07.207+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:20:07.208591265Z [2024-05-25T02:20:07.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:20:07.208604698Z 2024-05-25T02:20:07.210985634Z [2024-05-25T02:20:07.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T02:20:07.211228704Z [2024-05-25T02:20:07.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:20:07.262278456Z [2024-05-25T02:20:07.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status queued for try_number 1 2024-05-25T02:20:07.262410862Z [2024-05-25T02:20:07.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status success for try_number 1 2024-05-25T02:20:07.269139046Z [2024-05-25T02:20:07.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3f08fd2-6e0f-42ce-9748-93bfd7bddd82 2024-05-25T02:20:07.269492876Z [2024-05-25T02:20:07.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T02:15:00+00:00, map_index=-1, run_start_date=2024-05-25 02:20:06.408772+00:00, run_end_date=2024-05-25 02:20:06.851993+00:00, run_duration=0.443221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=893, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:20:04.679034+00:00, queued_by_job_id=1, pid=13155 2024-05-25T02:20:10.035745969Z [2024-05-25T02:20:10.035+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:20:10.035802927Z 2024-05-25T02:20:10.036145348Z [2024-05-25T02:20:10.035+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:20:10.036815960Z [2024-05-25T02:20:10.036+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:20:10.036833708Z 2024-05-25T02:20:10.041238716Z [2024-05-25T02:20:10.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:20:10.041622260Z [2024-05-25T02:20:10.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:20:10.099405817Z [2024-05-25T02:20:10.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status queued for try_number 1 2024-05-25T02:20:10.099683157Z [2024-05-25T02:20:10.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status success for try_number 1 2024-05-25T02:20:10.105889431Z [2024-05-25T02:20:10.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59f4fa3a-e7a8-48c0-9a1a-8dd4d067c51e 2024-05-25T02:20:10.106156647Z [2024-05-25T02:20:10.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T02:15:00+00:00, map_index=0, run_start_date=2024-05-25 02:20:09.159499+00:00, run_end_date=2024-05-25 02:20:09.580243+00:00, run_duration=0.420744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=894, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:20:07.208924+00:00, queued_by_job_id=1, pid=13166 2024-05-25T02:20:12.293798289Z [2024-05-25T02:20:12.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:20:12.293905965Z [2024-05-25T02:20:12.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:15:00+00:00, run_id=scheduled__2024-05-25T02:15:00+00:00, run_start_date=2024-05-25 02:20:00.193057+00:00, run_end_date=2024-05-25 02:20:12.293669+00:00, run_duration=12.100612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:15:00+00:00, data_interval_end=2024-05-25 02:20:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T02:20:12.299337341Z [2024-05-25T02:20:12.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:20:00+00:00, run_after=2024-05-25T02:25:00+00:00 2024-05-25T02:20:12.326285602Z [2024-05-25T02:20:12.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:15:00+00:00 exited with status success for try_number 1 2024-05-25T02:20:12.338769971Z [2024-05-25T02:20:12.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T02:15:00+00:00, map_index=-1, run_start_date=2024-05-25 02:20:11.614940+00:00, run_end_date=2024-05-25 02:20:12.028917+00:00, run_duration=0.413977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=895, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:20:10.037395+00:00, queued_by_job_id=1, pid=13174 2024-05-25T02:20:29.970051796Z [2024-05-25T02:20:29.969+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T02:21:00.198640066Z [2024-05-25T02:21:00.197+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:21:00+00:00, run_after=2024-05-25T02:22:00+00:00 2024-05-25T02:21:00.223078884Z [2024-05-25T02:21:00.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:21:00+00:00, run_after=2024-05-25T02:22:00+00:00 2024-05-25T02:21:00.234600167Z [2024-05-25T02:21:00.234+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:21:00.317720624Z [2024-05-25T02:21:00.317+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:21:00.317748009Z 2024-05-25T02:21:00.317752800Z 2024-05-25T02:21:00.317756666Z 2024-05-25T02:21:00.318037422Z [2024-05-25T02:21:00.317+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:21:00.318287537Z [2024-05-25T02:21:00.318+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:21:00.318537853Z [2024-05-25T02:21:00.318+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:21:00.319280815Z [2024-05-25T02:21:00.319+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:21:00.319294452Z 2024-05-25T02:21:00.319298727Z 2024-05-25T02:21:00.319302465Z 2024-05-25T02:21:00.323263623Z [2024-05-25T02:21:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:21:00.323601403Z [2024-05-25T02:21:00.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:21:00.324047038Z [2024-05-25T02:21:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:21:00.324297191Z [2024-05-25T02:21:00.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:21:00.324639117Z [2024-05-25T02:21:00.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:21:00.324869728Z [2024-05-25T02:21:00.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:21:00.526466217Z [2024-05-25T02:21:00.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status queued for try_number 1 2024-05-25T02:21:00.526751480Z [2024-05-25T02:21:00.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status queued for try_number 1 2024-05-25T02:21:00.528295444Z [2024-05-25T02:21:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status queued for try_number 1 2024-05-25T02:21:00.539664884Z [2024-05-25T02:21:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40291549-971c-4107-92d6-8d4d79797072 2024-05-25T02:21:00.539951897Z [2024-05-25T02:21:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f1d5e8c-a451-40dd-a81a-50e51f4d78cb 2024-05-25T02:21:00.540215849Z [2024-05-25T02:21:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e473ccb-3987-4366-9cac-7b2320fe97ae 2024-05-25T02:21:01.673646925Z [2024-05-25T02:21:01.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:21:01.674019061Z [2024-05-25T02:21:01.673+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:20:00+00:00, run_id=scheduled__2024-05-25T02:20:00+00:00, run_start_date=2024-05-25 02:21:00.245804+00:00, run_end_date=2024-05-25 02:21:01.673610+00:00, run_duration=1.427806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:20:00+00:00, data_interval_end=2024-05-25 02:21:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:21:01.699523492Z [2024-05-25T02:21:01.699+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:21:00+00:00, run_after=2024-05-25T02:22:00+00:00 2024-05-25T02:21:01.752850838Z [2024-05-25T02:21:01.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status success for try_number 1 2024-05-25T02:21:01.759504494Z [2024-05-25T02:21:01.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:20:00+00:00, map_index=-1, run_start_date=2024-05-25 02:21:01.033525+00:00, run_end_date=2024-05-25 02:21:01.424334+00:00, run_duration=0.390809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=896, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:21:00.320357+00:00, queued_by_job_id=1, pid=13183 2024-05-25T02:21:04.354365363Z [2024-05-25T02:21:04.353+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:21:04.354663335Z [2024-05-25T02:21:04.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:20:00+00:00, run_id=scheduled__2024-05-25T02:20:00+00:00, run_start_date=2024-05-25 02:21:00.248590+00:00, run_end_date=2024-05-25 02:21:04.354176+00:00, run_duration=4.105586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:20:00+00:00, data_interval_end=2024-05-25 02:21:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:21:04.366219508Z [2024-05-25T02:21:04.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:21:00+00:00, run_after=2024-05-25T02:22:00+00:00 2024-05-25T02:21:04.424620357Z [2024-05-25T02:21:04.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status success for try_number 1 2024-05-25T02:21:04.431441369Z [2024-05-25T02:21:04.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:20:00+00:00, map_index=-1, run_start_date=2024-05-25 02:21:02.169852+00:00, run_end_date=2024-05-25 02:21:03.823785+00:00, run_duration=1.653933, state=success, executor_state=success, try_number=1, max_tries=1, job_id=898, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:21:00.320357+00:00, queued_by_job_id=1, pid=13202 2024-05-25T02:21:05.496667813Z [2024-05-25T02:21:05.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:21:05.497200485Z [2024-05-25T02:21:05.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:20:00+00:00, run_id=scheduled__2024-05-25T02:20:00+00:00, run_start_date=2024-05-25 02:21:00.247265+00:00, run_end_date=2024-05-25 02:21:05.496776+00:00, run_duration=5.249511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:20:00+00:00, data_interval_end=2024-05-25 02:21:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:21:05.523747887Z [2024-05-25T02:21:05.523+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:21:00+00:00, run_after=2024-05-25T02:22:00+00:00 2024-05-25T02:21:05.572361580Z [2024-05-25T02:21:05.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status success for try_number 1 2024-05-25T02:21:05.579568798Z [2024-05-25T02:21:05.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:20:00+00:00, map_index=-1, run_start_date=2024-05-25 02:21:02.027015+00:00, run_end_date=2024-05-25 02:21:04.747667+00:00, run_duration=2.720652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=897, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:21:00.320357+00:00, queued_by_job_id=1, pid=13201 2024-05-25T02:22:00.808940166Z [2024-05-25T02:22:00.808+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:22:00+00:00, run_after=2024-05-25T02:23:00+00:00 2024-05-25T02:22:00.816286723Z [2024-05-25T02:22:00.815+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:22:00.828005209Z [2024-05-25T02:22:00.827+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:22:00+00:00, run_after=2024-05-25T02:23:00+00:00 2024-05-25T02:22:00.836521163Z [2024-05-25T02:22:00.836+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:22:00.930823424Z [2024-05-25T02:22:00.930+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:22:00.930869699Z 2024-05-25T02:22:00.930887481Z 2024-05-25T02:22:00.930896469Z 2024-05-25T02:22:00.930904999Z 2024-05-25T02:22:00.930914416Z [2024-05-25T02:22:00.930+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:22:00.930938508Z [2024-05-25T02:22:00.930+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:22:00.930980126Z [2024-05-25T02:22:00.930+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:22:00.931224282Z [2024-05-25T02:22:00.930+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:22:00.932058880Z [2024-05-25T02:22:00.931+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:22:00.932085800Z 2024-05-25T02:22:00.932102377Z 2024-05-25T02:22:00.932111347Z 2024-05-25T02:22:00.932119851Z 2024-05-25T02:22:00.937253835Z [2024-05-25T02:22:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:22:00.937552806Z [2024-05-25T02:22:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:22:00.937933970Z [2024-05-25T02:22:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:22:00.938194749Z [2024-05-25T02:22:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:22:00.938817892Z [2024-05-25T02:22:00.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:22:00.939059660Z [2024-05-25T02:22:00.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:22:00.939466696Z [2024-05-25T02:22:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:22:00.939665447Z [2024-05-25T02:22:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:22:01.301896018Z [2024-05-25T02:22:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status queued for try_number 1 2024-05-25T02:22:01.302020412Z [2024-05-25T02:22:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:21:00+00:00 exited with status queued for try_number 1 2024-05-25T02:22:01.302246857Z [2024-05-25T02:22:01.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:21:00+00:00 exited with status queued for try_number 1 2024-05-25T02:22:01.302421730Z [2024-05-25T02:22:01.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:21:00+00:00 exited with status queued for try_number 1 2024-05-25T02:22:01.314994893Z [2024-05-25T02:22:01.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16166dbc-be5e-41ce-b5aa-39cef141728d 2024-05-25T02:22:01.315141680Z [2024-05-25T02:22:01.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c9e7b96-877a-4cd3-a65f-448c16c5f4df 2024-05-25T02:22:01.315341676Z [2024-05-25T02:22:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39c0a585-7627-4af2-9a2b-08a2a9297b28 2024-05-25T02:22:01.315520369Z [2024-05-25T02:22:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdf57b61-b404-42e1-ac07-268d852ab5b5 2024-05-25T02:22:02.470227478Z [2024-05-25T02:22:02.469+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:22:02.471793113Z [2024-05-25T02:22:02.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:20:00+00:00, run_id=scheduled__2024-05-25T02:20:00+00:00, run_start_date=2024-05-25 02:22:00.848433+00:00, run_end_date=2024-05-25 02:22:02.470137+00:00, run_duration=1.621704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:20:00+00:00, data_interval_end=2024-05-25 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:22:02.485619710Z [2024-05-25T02:22:02.485+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:22:00+00:00, run_after=2024-05-25T02:24:00+00:00 2024-05-25T02:22:02.493980993Z [2024-05-25T02:22:02.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:22:02.494308545Z [2024-05-25T02:22:02.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:21:00+00:00, run_id=scheduled__2024-05-25T02:21:00+00:00, run_start_date=2024-05-25 02:22:00.850501+00:00, run_end_date=2024-05-25 02:22:02.493888+00:00, run_duration=1.643387, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:21:00+00:00, data_interval_end=2024-05-25 02:22:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:22:02.504035986Z [2024-05-25T02:22:02.503+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:22:00+00:00, run_after=2024-05-25T02:23:00+00:00 2024-05-25T02:22:02.557984637Z [2024-05-25T02:22:02.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status success for try_number 1 2024-05-25T02:22:02.563125597Z [2024-05-25T02:22:02.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:20:00+00:00, map_index=-1, run_start_date=2024-05-25 02:22:01.712411+00:00, run_end_date=2024-05-25 02:22:02.113888+00:00, run_duration=0.401477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=899, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:22:00.933064+00:00, queued_by_job_id=1, pid=13235 2024-05-25T02:22:03.104218948Z [2024-05-25T02:22:03.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:21:00+00:00 exited with status success for try_number 1 2024-05-25T02:22:03.111964808Z [2024-05-25T02:22:03.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:21:00+00:00, map_index=-1, run_start_date=2024-05-25 02:22:01.879371+00:00, run_end_date=2024-05-25 02:22:02.405925+00:00, run_duration=0.526554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=900, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:22:00.933064+00:00, queued_by_job_id=1, pid=13236 2024-05-25T02:22:05.291932209Z [2024-05-25T02:22:05.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:22:05.292500361Z [2024-05-25T02:22:05.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:21:00+00:00, run_id=scheduled__2024-05-25T02:21:00+00:00, run_start_date=2024-05-25 02:22:00.852924+00:00, run_end_date=2024-05-25 02:22:05.291736+00:00, run_duration=4.438812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:21:00+00:00, data_interval_end=2024-05-25 02:22:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:22:05.302354809Z [2024-05-25T02:22:05.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:22:00+00:00, run_after=2024-05-25T02:23:00+00:00 2024-05-25T02:22:05.310656119Z [2024-05-25T02:22:05.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:22:05.310811795Z [2024-05-25T02:22:05.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:21:00+00:00, run_id=scheduled__2024-05-25T02:21:00+00:00, run_start_date=2024-05-25 02:22:00.851701+00:00, run_end_date=2024-05-25 02:22:05.310476+00:00, run_duration=4.458775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:21:00+00:00, data_interval_end=2024-05-25 02:22:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:22:05.322148628Z [2024-05-25T02:22:05.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:22:00+00:00, run_after=2024-05-25T02:23:00+00:00 2024-05-25T02:22:05.368160296Z [2024-05-25T02:22:05.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:21:00+00:00 exited with status success for try_number 1 2024-05-25T02:22:05.368452397Z [2024-05-25T02:22:05.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:21:00+00:00 exited with status success for try_number 1 2024-05-25T02:22:05.380081447Z [2024-05-25T02:22:05.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:21:00+00:00, map_index=-1, run_start_date=2024-05-25 02:22:03.255346+00:00, run_end_date=2024-05-25 02:22:04.867489+00:00, run_duration=1.612143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=902, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:22:00.933064+00:00, queued_by_job_id=1, pid=13260 2024-05-25T02:22:05.381400087Z [2024-05-25T02:22:05.380+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:21:00+00:00, map_index=-1, run_start_date=2024-05-25 02:22:03.090117+00:00, run_end_date=2024-05-25 02:22:04.876434+00:00, run_duration=1.786317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=901, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:22:00.933064+00:00, queued_by_job_id=1, pid=13259 2024-05-25T02:23:00.090657392Z [2024-05-25T02:23:00.089+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:23:00.110454321Z [2024-05-25T02:23:00.110+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:23:00+00:00, run_after=2024-05-25T02:24:00+00:00 2024-05-25T02:23:00.125849791Z [2024-05-25T02:23:00.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:23:00+00:00, run_after=2024-05-25T02:24:00+00:00 2024-05-25T02:23:00.202303326Z [2024-05-25T02:23:00.201+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:23:00.202331297Z 2024-05-25T02:23:00.202336181Z 2024-05-25T02:23:00.202340977Z 2024-05-25T02:23:00.202783699Z [2024-05-25T02:23:00.202+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:23:00.203089166Z [2024-05-25T02:23:00.202+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:23:00.203285648Z [2024-05-25T02:23:00.203+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:23:00.204164560Z [2024-05-25T02:23:00.203+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:23:00.204183413Z 2024-05-25T02:23:00.204191234Z 2024-05-25T02:23:00.204198319Z 2024-05-25T02:23:00.208344216Z [2024-05-25T02:23:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:23:00.208695136Z [2024-05-25T02:23:00.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:23:00.209090541Z [2024-05-25T02:23:00.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:23:00.209301271Z [2024-05-25T02:23:00.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:23:00.210117191Z [2024-05-25T02:23:00.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:23:00.210411069Z [2024-05-25T02:23:00.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:23:00.413811510Z [2024-05-25T02:23:00.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:22:00+00:00 exited with status queued for try_number 1 2024-05-25T02:23:00.413875747Z [2024-05-25T02:23:00.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:22:00+00:00 exited with status queued for try_number 1 2024-05-25T02:23:00.413981580Z [2024-05-25T02:23:00.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:22:00+00:00 exited with status queued for try_number 1 2024-05-25T02:23:00.420822885Z [2024-05-25T02:23:00.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cd36e5d-b9cf-4e31-89ca-04f7b2a4e9b5 2024-05-25T02:23:00.420964897Z [2024-05-25T02:23:00.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca76eca6-8e03-478e-a82d-a0d4ceb5ad4c 2024-05-25T02:23:00.421106259Z [2024-05-25T02:23:00.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to e67c4014-2756-4b3e-bdcd-f52580805ebb 2024-05-25T02:23:01.560568415Z [2024-05-25T02:23:01.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:23:01.561128836Z [2024-05-25T02:23:01.560+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:22:00+00:00, run_id=scheduled__2024-05-25T02:22:00+00:00, run_start_date=2024-05-25 02:23:00.139407+00:00, run_end_date=2024-05-25 02:23:01.560593+00:00, run_duration=1.421186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:22:00+00:00, data_interval_end=2024-05-25 02:23:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:23:01.571168694Z [2024-05-25T02:23:01.570+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:23:00+00:00, run_after=2024-05-25T02:24:00+00:00 2024-05-25T02:23:02.776884617Z [2024-05-25T02:23:02.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:22:00+00:00 exited with status success for try_number 1 2024-05-25T02:23:02.786405054Z [2024-05-25T02:23:02.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:22:00+00:00, map_index=-1, run_start_date=2024-05-25 02:23:00.990304+00:00, run_end_date=2024-05-25 02:23:01.516899+00:00, run_duration=0.526595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=903, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:23:00.205138+00:00, queued_by_job_id=1, pid=13291 2024-05-25T02:23:03.850777337Z [2024-05-25T02:23:03.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:23:03.851100082Z [2024-05-25T02:23:03.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:22:00+00:00, run_id=scheduled__2024-05-25T02:22:00+00:00, run_start_date=2024-05-25 02:23:00.140629+00:00, run_end_date=2024-05-25 02:23:03.850579+00:00, run_duration=3.70995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:22:00+00:00, data_interval_end=2024-05-25 02:23:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:23:03.866128455Z [2024-05-25T02:23:03.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:23:00+00:00, run_after=2024-05-25T02:24:00+00:00 2024-05-25T02:23:03.937366874Z [2024-05-25T02:23:03.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:22:00+00:00 exited with status success for try_number 1 2024-05-25T02:23:03.941917699Z [2024-05-25T02:23:03.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:22:00+00:00, map_index=-1, run_start_date=2024-05-25 02:23:02.103152+00:00, run_end_date=2024-05-25 02:23:03.602497+00:00, run_duration=1.499345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=904, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:23:00.205138+00:00, queued_by_job_id=1, pid=13309 2024-05-25T02:23:04.084555051Z [2024-05-25T02:23:04.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:23:04.084740866Z [2024-05-25T02:23:04.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:22:00+00:00, run_id=scheduled__2024-05-25T02:22:00+00:00, run_start_date=2024-05-25 02:23:00.141758+00:00, run_end_date=2024-05-25 02:23:04.084345+00:00, run_duration=3.942587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:22:00+00:00, data_interval_end=2024-05-25 02:23:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:23:04.093796748Z [2024-05-25T02:23:04.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:23:00+00:00, run_after=2024-05-25T02:24:00+00:00 2024-05-25T02:23:05.229647680Z [2024-05-25T02:23:05.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:22:00+00:00 exited with status success for try_number 1 2024-05-25T02:23:05.238003590Z [2024-05-25T02:23:05.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:22:00+00:00, map_index=-1, run_start_date=2024-05-25 02:23:02.162551+00:00, run_end_date=2024-05-25 02:23:03.929367+00:00, run_duration=1.766816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=905, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:23:00.205138+00:00, queued_by_job_id=1, pid=13310 2024-05-25T02:24:00.793796731Z [2024-05-25T02:24:00.793+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:24:00.804818835Z [2024-05-25T02:24:00.804+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:24:00+00:00, run_after=2024-05-25T02:25:00+00:00 2024-05-25T02:24:00.810528505Z [2024-05-25T02:24:00.810+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:24:00.822834304Z [2024-05-25T02:24:00.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:24:00+00:00, run_after=2024-05-25T02:25:00+00:00 2024-05-25T02:24:00.913486311Z [2024-05-25T02:24:00.913+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:24:00.913517553Z 2024-05-25T02:24:00.913527230Z 2024-05-25T02:24:00.913552071Z 2024-05-25T02:24:00.913558055Z 2024-05-25T02:24:00.913730319Z [2024-05-25T02:24:00.913+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:24:00.913889237Z [2024-05-25T02:24:00.913+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:24:00.914072183Z [2024-05-25T02:24:00.913+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:24:00.914225158Z [2024-05-25T02:24:00.914+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:24:00.915000998Z [2024-05-25T02:24:00.914+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:24:00.915012052Z 2024-05-25T02:24:00.915018090Z 2024-05-25T02:24:00.915023841Z 2024-05-25T02:24:00.915029431Z 2024-05-25T02:24:00.919917237Z [2024-05-25T02:24:00.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:24:00.920181911Z [2024-05-25T02:24:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:24:00.920491558Z [2024-05-25T02:24:00.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:24:00.920687883Z [2024-05-25T02:24:00.920+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:24:00.920949382Z [2024-05-25T02:24:00.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:24:00.921047321Z [2024-05-25T02:24:00.920+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:24:00.921380801Z [2024-05-25T02:24:00.921+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:24:00.921507178Z [2024-05-25T02:24:00.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:24:01.330451456Z [2024-05-25T02:24:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:22:00+00:00 exited with status queued for try_number 1 2024-05-25T02:24:01.333482273Z [2024-05-25T02:24:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:23:00+00:00 exited with status queued for try_number 1 2024-05-25T02:24:01.333498376Z [2024-05-25T02:24:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:23:00+00:00 exited with status queued for try_number 1 2024-05-25T02:24:01.333501902Z [2024-05-25T02:24:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:23:00+00:00 exited with status queued for try_number 1 2024-05-25T02:24:01.359954480Z [2024-05-25T02:24:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63126c50-c078-4402-a173-05d4801723c5 2024-05-25T02:24:01.359980286Z [2024-05-25T02:24:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc10fdc5-15c4-4620-962f-f39916273bbb 2024-05-25T02:24:01.359985556Z [2024-05-25T02:24:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to a94877c1-61f6-4e7e-9d90-7691a4074289 2024-05-25T02:24:01.359990772Z [2024-05-25T02:24:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to e01900b9-bd66-40fd-884b-575eb94ae130 2024-05-25T02:24:03.114399488Z [2024-05-25T02:24:03.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:24:03.114692659Z [2024-05-25T02:24:03.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:23:00+00:00, run_id=scheduled__2024-05-25T02:23:00+00:00, run_start_date=2024-05-25 02:24:00.840012+00:00, run_end_date=2024-05-25 02:24:03.114266+00:00, run_duration=2.274254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:23:00+00:00, data_interval_end=2024-05-25 02:24:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:24:03.126226183Z [2024-05-25T02:24:03.125+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:24:00+00:00, run_after=2024-05-25T02:25:00+00:00 2024-05-25T02:24:03.142717452Z [2024-05-25T02:24:03.140+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:24:03.142739501Z [2024-05-25T02:24:03.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:22:00+00:00, run_id=scheduled__2024-05-25T02:22:00+00:00, run_start_date=2024-05-25 02:24:00.837542+00:00, run_end_date=2024-05-25 02:24:03.140643+00:00, run_duration=2.303101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:22:00+00:00, data_interval_end=2024-05-25 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:24:03.151313856Z [2024-05-25T02:24:03.151+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:24:00+00:00, run_after=2024-05-25T02:26:00+00:00 2024-05-25T02:24:03.209189027Z [2024-05-25T02:24:03.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:22:00+00:00 exited with status success for try_number 1 2024-05-25T02:24:03.209293082Z [2024-05-25T02:24:03.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:23:00+00:00 exited with status success for try_number 1 2024-05-25T02:24:03.222949984Z [2024-05-25T02:24:03.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:22:00+00:00, map_index=-1, run_start_date=2024-05-25 02:24:01.851232+00:00, run_end_date=2024-05-25 02:24:02.399163+00:00, run_duration=0.547931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=906, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:24:00.916201+00:00, queued_by_job_id=1, pid=13344 2024-05-25T02:24:03.223111499Z [2024-05-25T02:24:03.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:23:00+00:00, map_index=-1, run_start_date=2024-05-25 02:24:01.828780+00:00, run_end_date=2024-05-25 02:24:02.429744+00:00, run_duration=0.600964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=907, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:24:00.916201+00:00, queued_by_job_id=1, pid=13343 2024-05-25T02:24:05.103890584Z [2024-05-25T02:24:05.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:24:05.104151593Z [2024-05-25T02:24:05.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:23:00+00:00, run_id=scheduled__2024-05-25T02:23:00+00:00, run_start_date=2024-05-25 02:24:00.842346+00:00, run_end_date=2024-05-25 02:24:05.103639+00:00, run_duration=4.261293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:23:00+00:00, data_interval_end=2024-05-25 02:24:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:24:05.118738072Z [2024-05-25T02:24:05.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:24:00+00:00, run_after=2024-05-25T02:25:00+00:00 2024-05-25T02:24:05.149024517Z [2024-05-25T02:24:05.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:23:00+00:00 exited with status success for try_number 1 2024-05-25T02:24:05.153590252Z [2024-05-25T02:24:05.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:23:00+00:00, map_index=-1, run_start_date=2024-05-25 02:24:03.107804+00:00, run_end_date=2024-05-25 02:24:04.456701+00:00, run_duration=1.348897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=908, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:24:00.916201+00:00, queued_by_job_id=1, pid=13367 2024-05-25T02:24:06.216242864Z [2024-05-25T02:24:06.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:24:06.216480785Z [2024-05-25T02:24:06.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:23:00+00:00, run_id=scheduled__2024-05-25T02:23:00+00:00, run_start_date=2024-05-25 02:24:00.845279+00:00, run_end_date=2024-05-25 02:24:06.216025+00:00, run_duration=5.370746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:23:00+00:00, data_interval_end=2024-05-25 02:24:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:24:06.224761776Z [2024-05-25T02:24:06.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:24:00+00:00, run_after=2024-05-25T02:25:00+00:00 2024-05-25T02:24:06.259536713Z [2024-05-25T02:24:06.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:23:00+00:00 exited with status success for try_number 1 2024-05-25T02:24:06.266410319Z [2024-05-25T02:24:06.265+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:23:00+00:00, map_index=-1, run_start_date=2024-05-25 02:24:03.169609+00:00, run_end_date=2024-05-25 02:24:05.077177+00:00, run_duration=1.907568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=909, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:24:00.916201+00:00, queued_by_job_id=1, pid=13368 2024-05-25T02:25:00.153366747Z [2024-05-25T02:25:00.152+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:25:00.172364953Z [2024-05-25T02:25:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:25:00+00:00, run_after=2024-05-25T02:26:00+00:00 2024-05-25T02:25:00.201809942Z [2024-05-25T02:25:00.201+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:25:00+00:00, run_after=2024-05-25T02:26:00+00:00 2024-05-25T02:25:00.214675592Z [2024-05-25T02:25:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:25:00+00:00, run_after=2024-05-25T02:30:00+00:00 2024-05-25T02:25:00.337667868Z [2024-05-25T02:25:00.337+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:25:00.337688630Z 2024-05-25T02:25:00.337710720Z 2024-05-25T02:25:00.337714041Z 2024-05-25T02:25:00.337717618Z 2024-05-25T02:25:00.337825996Z [2024-05-25T02:25:00.337+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:25:00.338112377Z [2024-05-25T02:25:00.337+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:25:00.338300400Z [2024-05-25T02:25:00.338+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:25:00.338488148Z [2024-05-25T02:25:00.338+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:25:00.339372875Z [2024-05-25T02:25:00.339+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:25:00.339379995Z 2024-05-25T02:25:00.339383922Z 2024-05-25T02:25:00.339387567Z 2024-05-25T02:25:00.339390565Z 2024-05-25T02:25:00.345039200Z [2024-05-25T02:25:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T02:25:00.345375205Z [2024-05-25T02:25:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:25:00.345840704Z [2024-05-25T02:25:00.345+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:25:00.346030507Z [2024-05-25T02:25:00.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:25:00.346475466Z [2024-05-25T02:25:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:25:00.346709714Z [2024-05-25T02:25:00.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:25:00.347223805Z [2024-05-25T02:25:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:25:00.347640227Z [2024-05-25T02:25:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:25:00.854320840Z [2024-05-25T02:25:00.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status queued for try_number 1 2024-05-25T02:25:00.857533358Z [2024-05-25T02:25:00.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:24:00+00:00 exited with status queued for try_number 1 2024-05-25T02:25:00.857800206Z [2024-05-25T02:25:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:24:00+00:00 exited with status queued for try_number 1 2024-05-25T02:25:00.857985092Z [2024-05-25T02:25:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:24:00+00:00 exited with status queued for try_number 1 2024-05-25T02:25:00.877321484Z [2024-05-25T02:25:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9c8b36d-192b-40a4-bae3-3710d3adab0d 2024-05-25T02:25:00.877667340Z [2024-05-25T02:25:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6739de2d-49c7-4425-a1cd-22f1c86128c0 2024-05-25T02:25:00.877943005Z [2024-05-25T02:25:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to eaf52e91-3730-45f5-9642-5880fe90202d 2024-05-25T02:25:00.878190095Z [2024-05-25T02:25:00.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to b546ce4d-be01-4800-a7c1-76a10d67776c 2024-05-25T02:25:02.344161432Z [2024-05-25T02:25:02.343+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:25:02.344834096Z [2024-05-25T02:25:02.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:24:00+00:00, run_id=scheduled__2024-05-25T02:24:00+00:00, run_start_date=2024-05-25 02:25:00.227268+00:00, run_end_date=2024-05-25 02:25:02.344364+00:00, run_duration=2.117096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:24:00+00:00, data_interval_end=2024-05-25 02:25:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:25:02.355585598Z [2024-05-25T02:25:02.355+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:25:00+00:00, run_after=2024-05-25T02:26:00+00:00 2024-05-25T02:25:02.424271956Z [2024-05-25T02:25:02.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:24:00+00:00 exited with status success for try_number 1 2024-05-25T02:25:02.433279518Z [2024-05-25T02:25:02.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:24:00+00:00, map_index=-1, run_start_date=2024-05-25 02:25:01.300819+00:00, run_end_date=2024-05-25 02:25:01.855940+00:00, run_duration=0.555121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=910, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:25:00.340893+00:00, queued_by_job_id=1, pid=13401 2024-05-25T02:25:04.648310320Z [2024-05-25T02:25:04.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:25:04.648780634Z [2024-05-25T02:25:04.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:24:00+00:00, run_id=scheduled__2024-05-25T02:24:00+00:00, run_start_date=2024-05-25 02:25:00.228376+00:00, run_end_date=2024-05-25 02:25:04.648287+00:00, run_duration=4.419911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:24:00+00:00, data_interval_end=2024-05-25 02:25:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:25:04.663216351Z [2024-05-25T02:25:04.661+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:25:00+00:00, run_after=2024-05-25T02:26:00+00:00 2024-05-25T02:25:04.699513012Z [2024-05-25T02:25:04.699+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:25:04.699561424Z 2024-05-25T02:25:04.699794453Z [2024-05-25T02:25:04.699+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:25:04.702213511Z [2024-05-25T02:25:04.700+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:25:04.702239937Z 2024-05-25T02:25:04.703809358Z [2024-05-25T02:25:04.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T02:25:04.703961131Z [2024-05-25T02:25:04.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:25:04.751982594Z [2024-05-25T02:25:04.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status queued for try_number 1 2024-05-25T02:25:04.752174962Z [2024-05-25T02:25:04.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status success for try_number 1 2024-05-25T02:25:04.752404489Z [2024-05-25T02:25:04.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:24:00+00:00 exited with status success for try_number 1 2024-05-25T02:25:04.752568357Z [2024-05-25T02:25:04.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:24:00+00:00 exited with status success for try_number 1 2024-05-25T02:25:04.761651761Z [2024-05-25T02:25:04.761+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6f433fc-bb77-4920-abca-976c18722fdc 2024-05-25T02:25:04.762088561Z [2024-05-25T02:25:04.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:24:00+00:00, map_index=-1, run_start_date=2024-05-25 02:25:02.712728+00:00, run_end_date=2024-05-25 02:25:04.549266+00:00, run_duration=1.836538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=912, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:25:00.340893+00:00, queued_by_job_id=1, pid=13421 2024-05-25T02:25:04.762350645Z [2024-05-25T02:25:04.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T02:20:00+00:00, map_index=-1, run_start_date=2024-05-25 02:25:03.056152+00:00, run_end_date=2024-05-25 02:25:03.495711+00:00, run_duration=0.439559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=913, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:25:00.340893+00:00, queued_by_job_id=1, pid=13432 2024-05-25T02:25:04.762984402Z [2024-05-25T02:25:04.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:24:00+00:00, map_index=-1, run_start_date=2024-05-25 02:25:02.639138+00:00, run_end_date=2024-05-25 02:25:04.036519+00:00, run_duration=1.397381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=911, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:25:00.340893+00:00, queued_by_job_id=1, pid=13420 2024-05-25T02:25:04.811898281Z [2024-05-25T02:25:04.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:25:04.812325794Z [2024-05-25T02:25:04.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:24:00+00:00, run_id=scheduled__2024-05-25T02:24:00+00:00, run_start_date=2024-05-25 02:25:00.229498+00:00, run_end_date=2024-05-25 02:25:04.811659+00:00, run_duration=4.582161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:24:00+00:00, data_interval_end=2024-05-25 02:25:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:25:04.823919632Z [2024-05-25T02:25:04.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:25:00+00:00, run_after=2024-05-25T02:26:00+00:00 2024-05-25T02:25:07.192302422Z [2024-05-25T02:25:07.191+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:25:07.192452461Z 2024-05-25T02:25:07.192469291Z [2024-05-25T02:25:07.191+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:25:07.192778821Z [2024-05-25T02:25:07.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:25:07.192805097Z 2024-05-25T02:25:07.194810723Z [2024-05-25T02:25:07.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T02:25:07.194926797Z [2024-05-25T02:25:07.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:25:07.270304469Z [2024-05-25T02:25:07.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status queued for try_number 1 2024-05-25T02:25:07.270580618Z [2024-05-25T02:25:07.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status success for try_number 1 2024-05-25T02:25:07.279565423Z [2024-05-25T02:25:07.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd106f87-f0ef-490a-b007-309c19ee7cfc 2024-05-25T02:25:07.279852672Z [2024-05-25T02:25:07.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T02:20:00+00:00, map_index=-1, run_start_date=2024-05-25 02:25:06.270373+00:00, run_end_date=2024-05-25 02:25:06.672571+00:00, run_duration=0.402198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=914, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:25:04.701021+00:00, queued_by_job_id=1, pid=13460 2024-05-25T02:25:10.644171924Z [2024-05-25T02:25:10.643+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:25:10.644282676Z 2024-05-25T02:25:10.644294087Z [2024-05-25T02:25:10.643+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:25:10.644982275Z [2024-05-25T02:25:10.644+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:25:10.645048228Z 2024-05-25T02:25:10.649542038Z [2024-05-25T02:25:10.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:25:10.649910426Z [2024-05-25T02:25:10.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:25:10.705935153Z [2024-05-25T02:25:10.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status queued for try_number 1 2024-05-25T02:25:10.706282267Z [2024-05-25T02:25:10.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status success for try_number 1 2024-05-25T02:25:10.718500735Z [2024-05-25T02:25:10.717+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9de1a07-1050-4aee-a3f1-b6daa88d1670 2024-05-25T02:25:10.718934625Z [2024-05-25T02:25:10.718+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T02:20:00+00:00, map_index=0, run_start_date=2024-05-25 02:25:09.071018+00:00, run_end_date=2024-05-25 02:25:10.442549+00:00, run_duration=1.371531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=915, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:25:07.192883+00:00, queued_by_job_id=1, pid=13471 2024-05-25T02:25:13.016493184Z [2024-05-25T02:25:13.015+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:25:13.017169725Z [2024-05-25T02:25:13.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:20:00+00:00, run_id=scheduled__2024-05-25T02:20:00+00:00, run_start_date=2024-05-25 02:25:00.225978+00:00, run_end_date=2024-05-25 02:25:13.016398+00:00, run_duration=12.79042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:20:00+00:00, data_interval_end=2024-05-25 02:25:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T02:25:13.031459500Z [2024-05-25T02:25:13.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:25:00+00:00, run_after=2024-05-25T02:30:00+00:00 2024-05-25T02:25:13.068742107Z [2024-05-25T02:25:13.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:20:00+00:00 exited with status success for try_number 1 2024-05-25T02:25:13.073282018Z [2024-05-25T02:25:13.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T02:20:00+00:00, map_index=-1, run_start_date=2024-05-25 02:25:12.403386+00:00, run_end_date=2024-05-25 02:25:12.831531+00:00, run_duration=0.428145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=916, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:25:10.645668+00:00, queued_by_job_id=1, pid=13484 2024-05-25T02:25:30.067499273Z [2024-05-25T02:25:30.066+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T02:26:00.149302806Z [2024-05-25T02:26:00.148+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:26:00+00:00, run_after=2024-05-25T02:27:00+00:00 2024-05-25T02:26:00.161411927Z [2024-05-25T02:26:00.161+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:26:00.170894464Z [2024-05-25T02:26:00.170+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:26:00.185566042Z [2024-05-25T02:26:00.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:26:00+00:00, run_after=2024-05-25T02:27:00+00:00 2024-05-25T02:26:00.330916393Z [2024-05-25T02:26:00.330+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:26:00.330940639Z 2024-05-25T02:26:00.330947264Z 2024-05-25T02:26:00.330952104Z 2024-05-25T02:26:00.330956823Z 2024-05-25T02:26:00.331317814Z [2024-05-25T02:26:00.330+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:26:00.331715647Z [2024-05-25T02:26:00.331+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:26:00.332159310Z [2024-05-25T02:26:00.331+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:26:00.332584018Z [2024-05-25T02:26:00.332+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:26:00.333737738Z [2024-05-25T02:26:00.333+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:26:00.333756846Z 2024-05-25T02:26:00.333764651Z 2024-05-25T02:26:00.333771887Z 2024-05-25T02:26:00.333778598Z 2024-05-25T02:26:00.340753908Z [2024-05-25T02:26:00.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:26:00.341013207Z [2024-05-25T02:26:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:26:00.341531906Z [2024-05-25T02:26:00.341+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:26:00.341763225Z [2024-05-25T02:26:00.341+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:26:00.342300922Z [2024-05-25T02:26:00.341+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:26:00.342610255Z [2024-05-25T02:26:00.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:26:00.343019762Z [2024-05-25T02:26:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:26:00.343347065Z [2024-05-25T02:26:00.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:26:00.790783518Z [2024-05-25T02:26:00.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:24:00+00:00 exited with status queued for try_number 1 2024-05-25T02:26:00.791111342Z [2024-05-25T02:26:00.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status queued for try_number 1 2024-05-25T02:26:00.791497738Z [2024-05-25T02:26:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status queued for try_number 1 2024-05-25T02:26:00.791832908Z [2024-05-25T02:26:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status queued for try_number 1 2024-05-25T02:26:00.807229384Z [2024-05-25T02:26:00.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5c8acd7-0008-4e62-bd94-77b6e7b3cc07 2024-05-25T02:26:00.807552098Z [2024-05-25T02:26:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73db2c9c-3d2e-4832-ae7b-292daf16e0c4 2024-05-25T02:26:00.807828629Z [2024-05-25T02:26:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7c055c4-5f26-4074-a41b-3ba207ea4770 2024-05-25T02:26:00.808170009Z [2024-05-25T02:26:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8c9d427-2ba9-4168-a11a-03cda5364da1 2024-05-25T02:26:01.975706312Z [2024-05-25T02:26:01.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:26:01.976377887Z [2024-05-25T02:26:01.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:24:00+00:00, run_id=scheduled__2024-05-25T02:24:00+00:00, run_start_date=2024-05-25 02:26:00.208771+00:00, run_end_date=2024-05-25 02:26:01.975613+00:00, run_duration=1.766842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:24:00+00:00, data_interval_end=2024-05-25 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:26:01.988680221Z [2024-05-25T02:26:01.983+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:26:00+00:00, run_after=2024-05-25T02:28:00+00:00 2024-05-25T02:26:01.996705653Z [2024-05-25T02:26:01.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:26:01.997152828Z [2024-05-25T02:26:01.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:25:00+00:00, run_id=scheduled__2024-05-25T02:25:00+00:00, run_start_date=2024-05-25 02:26:00.211133+00:00, run_end_date=2024-05-25 02:26:01.996581+00:00, run_duration=1.785448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:25:00+00:00, data_interval_end=2024-05-25 02:26:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:26:02.006701645Z [2024-05-25T02:26:02.006+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:26:00+00:00, run_after=2024-05-25T02:27:00+00:00 2024-05-25T02:26:02.060303502Z [2024-05-25T02:26:02.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:24:00+00:00 exited with status success for try_number 1 2024-05-25T02:26:02.067677726Z [2024-05-25T02:26:02.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:24:00+00:00, map_index=-1, run_start_date=2024-05-25 02:26:01.130978+00:00, run_end_date=2024-05-25 02:26:01.549555+00:00, run_duration=0.418577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=917, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:26:00.336155+00:00, queued_by_job_id=1, pid=13494 2024-05-25T02:26:02.372676565Z [2024-05-25T02:26:02.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status success for try_number 1 2024-05-25T02:26:02.378237968Z [2024-05-25T02:26:02.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:25:00+00:00, map_index=-1, run_start_date=2024-05-25 02:26:01.324235+00:00, run_end_date=2024-05-25 02:26:01.913235+00:00, run_duration=0.589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=918, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:26:00.336155+00:00, queued_by_job_id=1, pid=13495 2024-05-25T02:26:04.915623383Z [2024-05-25T02:26:04.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:26:04.916170508Z [2024-05-25T02:26:04.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:25:00+00:00, run_id=scheduled__2024-05-25T02:25:00+00:00, run_start_date=2024-05-25 02:26:00.225974+00:00, run_end_date=2024-05-25 02:26:04.915508+00:00, run_duration=4.689534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:25:00+00:00, data_interval_end=2024-05-25 02:26:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:26:04.926500726Z [2024-05-25T02:26:04.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:26:00+00:00, run_after=2024-05-25T02:27:00+00:00 2024-05-25T02:26:04.933953456Z [2024-05-25T02:26:04.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:26:04.934226191Z [2024-05-25T02:26:04.933+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:25:00+00:00, run_id=scheduled__2024-05-25T02:25:00+00:00, run_start_date=2024-05-25 02:26:00.221911+00:00, run_end_date=2024-05-25 02:26:04.933819+00:00, run_duration=4.711908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:25:00+00:00, data_interval_end=2024-05-25 02:26:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:26:04.946701583Z [2024-05-25T02:26:04.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:26:00+00:00, run_after=2024-05-25T02:27:00+00:00 2024-05-25T02:26:04.976032927Z [2024-05-25T02:26:04.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status success for try_number 1 2024-05-25T02:26:04.976334243Z [2024-05-25T02:26:04.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status success for try_number 1 2024-05-25T02:26:04.984377070Z [2024-05-25T02:26:04.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:25:00+00:00, map_index=-1, run_start_date=2024-05-25 02:26:02.578071+00:00, run_end_date=2024-05-25 02:26:04.735848+00:00, run_duration=2.157777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=919, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:26:00.336155+00:00, queued_by_job_id=1, pid=13518 2024-05-25T02:26:04.984775913Z [2024-05-25T02:26:04.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:25:00+00:00, map_index=-1, run_start_date=2024-05-25 02:26:02.643858+00:00, run_end_date=2024-05-25 02:26:04.174628+00:00, run_duration=1.53077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=920, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:26:00.336155+00:00, queued_by_job_id=1, pid=13519 2024-05-25T02:27:00.063872350Z [2024-05-25T02:27:00.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:27:00+00:00, run_after=2024-05-25T02:28:00+00:00 2024-05-25T02:27:00.081042448Z [2024-05-25T02:27:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:27:00+00:00, run_after=2024-05-25T02:28:00+00:00 2024-05-25T02:27:00.089158839Z [2024-05-25T02:27:00.088+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:27:00.187454661Z [2024-05-25T02:27:00.186+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:27:00.187499068Z 2024-05-25T02:27:00.187505919Z 2024-05-25T02:27:00.187511811Z 2024-05-25T02:27:00.187755614Z [2024-05-25T02:27:00.187+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:27:00.188148354Z [2024-05-25T02:27:00.187+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:27:00.188365503Z [2024-05-25T02:27:00.188+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:27:00.189481939Z [2024-05-25T02:27:00.189+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:27:00.189500937Z 2024-05-25T02:27:00.189509849Z 2024-05-25T02:27:00.189518775Z 2024-05-25T02:27:00.196309964Z [2024-05-25T02:27:00.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:27:00.196347722Z [2024-05-25T02:27:00.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:27:00.196718115Z [2024-05-25T02:27:00.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:27:00.197129842Z [2024-05-25T02:27:00.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:27:00.197812507Z [2024-05-25T02:27:00.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:27:00.197843376Z [2024-05-25T02:27:00.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:27:00.464102085Z [2024-05-25T02:27:00.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:26:00+00:00 exited with status queued for try_number 1 2024-05-25T02:27:00.464299998Z [2024-05-25T02:27:00.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:26:00+00:00 exited with status queued for try_number 1 2024-05-25T02:27:00.464404680Z [2024-05-25T02:27:00.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:26:00+00:00 exited with status queued for try_number 1 2024-05-25T02:27:00.471575279Z [2024-05-25T02:27:00.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c03f8fb-573c-483c-8cae-cfed4c498059 2024-05-25T02:27:00.471705972Z [2024-05-25T02:27:00.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48997582-0812-4a2c-b689-4994163797d8 2024-05-25T02:27:00.471914155Z [2024-05-25T02:27:00.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0bdd37f-0637-4bd0-9a04-bc97d0f4128b 2024-05-25T02:27:01.640452570Z [2024-05-25T02:27:01.639+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:27:01.640864884Z [2024-05-25T02:27:01.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:26:00+00:00, run_id=scheduled__2024-05-25T02:26:00+00:00, run_start_date=2024-05-25 02:27:00.098860+00:00, run_end_date=2024-05-25 02:27:01.640321+00:00, run_duration=1.541461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:26:00+00:00, data_interval_end=2024-05-25 02:27:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:27:01.652265204Z [2024-05-25T02:27:01.651+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:27:00+00:00, run_after=2024-05-25T02:28:00+00:00 2024-05-25T02:27:01.703262126Z [2024-05-25T02:27:01.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:26:00+00:00 exited with status success for try_number 1 2024-05-25T02:27:01.709486154Z [2024-05-25T02:27:01.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:26:00+00:00, map_index=-1, run_start_date=2024-05-25 02:27:00.987478+00:00, run_end_date=2024-05-25 02:27:01.394198+00:00, run_duration=0.40672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=921, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:27:00.191268+00:00, queued_by_job_id=1, pid=13551 2024-05-25T02:27:04.126736887Z [2024-05-25T02:27:04.126+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:27:04.127233539Z [2024-05-25T02:27:04.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:26:00+00:00, run_id=scheduled__2024-05-25T02:26:00+00:00, run_start_date=2024-05-25 02:27:00.100078+00:00, run_end_date=2024-05-25 02:27:04.126669+00:00, run_duration=4.026591, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:26:00+00:00, data_interval_end=2024-05-25 02:27:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:27:04.145906007Z [2024-05-25T02:27:04.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:27:00+00:00, run_after=2024-05-25T02:28:00+00:00 2024-05-25T02:27:04.154132126Z [2024-05-25T02:27:04.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:27:04.154495186Z [2024-05-25T02:27:04.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:26:00+00:00, run_id=scheduled__2024-05-25T02:26:00+00:00, run_start_date=2024-05-25 02:27:00.101069+00:00, run_end_date=2024-05-25 02:27:04.154009+00:00, run_duration=4.05294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:26:00+00:00, data_interval_end=2024-05-25 02:27:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:27:04.163740454Z [2024-05-25T02:27:04.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:27:00+00:00, run_after=2024-05-25T02:28:00+00:00 2024-05-25T02:27:04.205167693Z [2024-05-25T02:27:04.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:26:00+00:00 exited with status success for try_number 1 2024-05-25T02:27:04.205559113Z [2024-05-25T02:27:04.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:26:00+00:00 exited with status success for try_number 1 2024-05-25T02:27:04.216825403Z [2024-05-25T02:27:04.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:26:00+00:00, map_index=-1, run_start_date=2024-05-25 02:27:01.975924+00:00, run_end_date=2024-05-25 02:27:03.399939+00:00, run_duration=1.424015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=922, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:27:00.191268+00:00, queued_by_job_id=1, pid=13569 2024-05-25T02:27:04.217309245Z [2024-05-25T02:27:04.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:26:00+00:00, map_index=-1, run_start_date=2024-05-25 02:27:02.039972+00:00, run_end_date=2024-05-25 02:27:03.956174+00:00, run_duration=1.916202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=923, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:27:00.191268+00:00, queued_by_job_id=1, pid=13570 2024-05-25T02:28:01.057131276Z [2024-05-25T02:28:01.056+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:28:01.080904330Z [2024-05-25T02:28:01.080+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:28:00+00:00, run_after=2024-05-25T02:29:00+00:00 2024-05-25T02:28:01.090237721Z [2024-05-25T02:28:01.089+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:28:01.107801206Z [2024-05-25T02:28:01.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:28:00+00:00, run_after=2024-05-25T02:29:00+00:00 2024-05-25T02:28:01.185030832Z [2024-05-25T02:28:01.183+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:28:01.185056768Z 2024-05-25T02:28:01.185061390Z 2024-05-25T02:28:01.185064813Z 2024-05-25T02:28:01.185068168Z 2024-05-25T02:28:01.185236586Z [2024-05-25T02:28:01.185+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:28:01.185417303Z [2024-05-25T02:28:01.185+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:28:01.185547601Z [2024-05-25T02:28:01.185+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:28:01.185743570Z [2024-05-25T02:28:01.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:28:01.186792086Z [2024-05-25T02:28:01.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:28:01.186803781Z 2024-05-25T02:28:01.186807352Z 2024-05-25T02:28:01.186810707Z 2024-05-25T02:28:01.186825519Z 2024-05-25T02:28:01.191747175Z [2024-05-25T02:28:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:28:01.192151364Z [2024-05-25T02:28:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:28:01.192388903Z [2024-05-25T02:28:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:28:01.192546226Z [2024-05-25T02:28:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:28:01.192969964Z [2024-05-25T02:28:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:28:01.193153583Z [2024-05-25T02:28:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:28:01.193410264Z [2024-05-25T02:28:01.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:28:01.194710618Z [2024-05-25T02:28:01.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:28:01.778433494Z [2024-05-25T02:28:01.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:26:00+00:00 exited with status queued for try_number 1 2024-05-25T02:28:01.778709592Z [2024-05-25T02:28:01.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:27:00+00:00 exited with status queued for try_number 1 2024-05-25T02:28:01.778917458Z [2024-05-25T02:28:01.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:27:00+00:00 exited with status queued for try_number 1 2024-05-25T02:28:01.779085265Z [2024-05-25T02:28:01.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:27:00+00:00 exited with status queued for try_number 1 2024-05-25T02:28:01.798643626Z [2024-05-25T02:28:01.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to fac590b4-99da-4e2b-8c72-5e1a6204383b 2024-05-25T02:28:01.798958800Z [2024-05-25T02:28:01.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0817c4a7-ac3f-4c21-8af6-c312908033bd 2024-05-25T02:28:01.799192114Z [2024-05-25T02:28:01.799+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d7fdbcc-bdeb-4d43-9cdc-a99b368a8f65 2024-05-25T02:28:01.799416107Z [2024-05-25T02:28:01.799+0000] {scheduler_job.py:635} INFO - Setting external_id for to c38e0913-55d0-4af6-84af-72d80a22c308 2024-05-25T02:28:03.193334339Z [2024-05-25T02:28:03.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:28:03.193362936Z [2024-05-25T02:28:03.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:26:00+00:00, run_id=scheduled__2024-05-25T02:26:00+00:00, run_start_date=2024-05-25 02:28:01.122513+00:00, run_end_date=2024-05-25 02:28:03.192663+00:00, run_duration=2.07015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:26:00+00:00, data_interval_end=2024-05-25 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:28:03.212586992Z [2024-05-25T02:28:03.210+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:28:00+00:00, run_after=2024-05-25T02:30:00+00:00 2024-05-25T02:28:03.220258141Z [2024-05-25T02:28:03.218+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:28:03.220285083Z [2024-05-25T02:28:03.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:27:00+00:00, run_id=scheduled__2024-05-25T02:27:00+00:00, run_start_date=2024-05-25 02:28:01.123855+00:00, run_end_date=2024-05-25 02:28:03.218873+00:00, run_duration=2.095018, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:27:00+00:00, data_interval_end=2024-05-25 02:28:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:28:03.234825316Z [2024-05-25T02:28:03.233+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:28:00+00:00, run_after=2024-05-25T02:29:00+00:00 2024-05-25T02:28:03.297027009Z [2024-05-25T02:28:03.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:26:00+00:00 exited with status success for try_number 1 2024-05-25T02:28:03.297462063Z [2024-05-25T02:28:03.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:27:00+00:00 exited with status success for try_number 1 2024-05-25T02:28:03.304319992Z [2024-05-25T02:28:03.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:26:00+00:00, map_index=-1, run_start_date=2024-05-25 02:28:02.142116+00:00, run_end_date=2024-05-25 02:28:02.605697+00:00, run_duration=0.463581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=924, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:28:01.187692+00:00, queued_by_job_id=1, pid=13597 2024-05-25T02:28:03.304841756Z [2024-05-25T02:28:03.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:27:00+00:00, map_index=-1, run_start_date=2024-05-25 02:28:02.661058+00:00, run_end_date=2024-05-25 02:28:03.000216+00:00, run_duration=0.339158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=925, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:28:01.187692+00:00, queued_by_job_id=1, pid=13608 2024-05-25T02:28:06.235218854Z [2024-05-25T02:28:06.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:28:06.235479843Z [2024-05-25T02:28:06.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:27:00+00:00, run_id=scheduled__2024-05-25T02:27:00+00:00, run_start_date=2024-05-25 02:28:01.126183+00:00, run_end_date=2024-05-25 02:28:06.235191+00:00, run_duration=5.109008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:27:00+00:00, data_interval_end=2024-05-25 02:28:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:28:06.247462626Z [2024-05-25T02:28:06.247+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:28:00+00:00, run_after=2024-05-25T02:29:00+00:00 2024-05-25T02:28:06.254887510Z [2024-05-25T02:28:06.254+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:28:06.255333771Z [2024-05-25T02:28:06.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:27:00+00:00, run_id=scheduled__2024-05-25T02:27:00+00:00, run_start_date=2024-05-25 02:28:01.125151+00:00, run_end_date=2024-05-25 02:28:06.254795+00:00, run_duration=5.129644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:27:00+00:00, data_interval_end=2024-05-25 02:28:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:28:06.265807676Z [2024-05-25T02:28:06.265+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:28:00+00:00, run_after=2024-05-25T02:29:00+00:00 2024-05-25T02:28:06.305041046Z [2024-05-25T02:28:06.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:27:00+00:00 exited with status success for try_number 1 2024-05-25T02:28:06.305079325Z [2024-05-25T02:28:06.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:27:00+00:00 exited with status success for try_number 1 2024-05-25T02:28:06.313997614Z [2024-05-25T02:28:06.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:27:00+00:00, map_index=-1, run_start_date=2024-05-25 02:28:03.841654+00:00, run_end_date=2024-05-25 02:28:05.589720+00:00, run_duration=1.748066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=927, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:28:01.187692+00:00, queued_by_job_id=1, pid=13627 2024-05-25T02:28:06.314250408Z [2024-05-25T02:28:06.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:27:00+00:00, map_index=-1, run_start_date=2024-05-25 02:28:03.828113+00:00, run_end_date=2024-05-25 02:28:05.148726+00:00, run_duration=1.320613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=926, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:28:01.187692+00:00, queued_by_job_id=1, pid=13626 2024-05-25T02:29:01.009486069Z [2024-05-25T02:29:01.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:29:00+00:00, run_after=2024-05-25T02:30:00+00:00 2024-05-25T02:29:01.022766079Z [2024-05-25T02:29:01.022+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:29:00+00:00, run_after=2024-05-25T02:30:00+00:00 2024-05-25T02:29:01.030610947Z [2024-05-25T02:29:01.030+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:29:01.127027974Z [2024-05-25T02:29:01.126+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:29:01.127071994Z 2024-05-25T02:29:01.127082128Z 2024-05-25T02:29:01.127091386Z 2024-05-25T02:29:01.127100414Z [2024-05-25T02:29:01.126+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:29:01.127147351Z [2024-05-25T02:29:01.126+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:29:01.127229505Z [2024-05-25T02:29:01.127+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:29:01.128154276Z [2024-05-25T02:29:01.127+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:29:01.128180180Z 2024-05-25T02:29:01.128189557Z 2024-05-25T02:29:01.128199074Z 2024-05-25T02:29:01.132894764Z [2024-05-25T02:29:01.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:29:01.133020271Z [2024-05-25T02:29:01.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:29:01.133165374Z [2024-05-25T02:29:01.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:29:01.133288832Z [2024-05-25T02:29:01.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:29:01.133493204Z [2024-05-25T02:29:01.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:29:01.133514439Z [2024-05-25T02:29:01.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:29:01.430357646Z [2024-05-25T02:29:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:28:00+00:00 exited with status queued for try_number 1 2024-05-25T02:29:01.430581080Z [2024-05-25T02:29:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:28:00+00:00 exited with status queued for try_number 1 2024-05-25T02:29:01.430766307Z [2024-05-25T02:29:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:28:00+00:00 exited with status queued for try_number 1 2024-05-25T02:29:01.438044661Z [2024-05-25T02:29:01.437+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a215287-8944-4553-9281-d2d6a211d345 2024-05-25T02:29:01.438321689Z [2024-05-25T02:29:01.438+0000] {scheduler_job.py:635} INFO - Setting external_id for to 414b34c5-243e-4927-b26c-e7cdbdbae520 2024-05-25T02:29:01.438571626Z [2024-05-25T02:29:01.438+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bc66046-3a34-4edb-9490-aa5c9342d636 2024-05-25T02:29:02.608140208Z [2024-05-25T02:29:02.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:29:02.608667399Z [2024-05-25T02:29:02.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:28:00+00:00, run_id=scheduled__2024-05-25T02:28:00+00:00, run_start_date=2024-05-25 02:29:01.051162+00:00, run_end_date=2024-05-25 02:29:02.608012+00:00, run_duration=1.55685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:28:00+00:00, data_interval_end=2024-05-25 02:29:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:29:02.621323785Z [2024-05-25T02:29:02.620+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:29:00+00:00, run_after=2024-05-25T02:30:00+00:00 2024-05-25T02:29:02.684804504Z [2024-05-25T02:29:02.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:28:00+00:00 exited with status success for try_number 1 2024-05-25T02:29:02.691923670Z [2024-05-25T02:29:02.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:28:00+00:00, map_index=-1, run_start_date=2024-05-25 02:29:01.928968+00:00, run_end_date=2024-05-25 02:29:02.432638+00:00, run_duration=0.50367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=928, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:29:01.129196+00:00, queued_by_job_id=1, pid=13659 2024-05-25T02:29:04.879257031Z [2024-05-25T02:29:04.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:29:04.879433201Z [2024-05-25T02:29:04.879+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:28:00+00:00, run_id=scheduled__2024-05-25T02:28:00+00:00, run_start_date=2024-05-25 02:29:01.054036+00:00, run_end_date=2024-05-25 02:29:04.879013+00:00, run_duration=3.824977, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:28:00+00:00, data_interval_end=2024-05-25 02:29:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:29:04.896041695Z [2024-05-25T02:29:04.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:29:00+00:00, run_after=2024-05-25T02:30:00+00:00 2024-05-25T02:29:04.945896893Z [2024-05-25T02:29:04.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:28:00+00:00 exited with status success for try_number 1 2024-05-25T02:29:04.952422419Z [2024-05-25T02:29:04.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:28:00+00:00, map_index=-1, run_start_date=2024-05-25 02:29:03.221485+00:00, run_end_date=2024-05-25 02:29:04.710674+00:00, run_duration=1.489189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=929, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:29:01.129196+00:00, queued_by_job_id=1, pid=13677 2024-05-25T02:29:05.999439471Z [2024-05-25T02:29:05.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:29:05.999580473Z [2024-05-25T02:29:05.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:28:00+00:00, run_id=scheduled__2024-05-25T02:28:00+00:00, run_start_date=2024-05-25 02:29:01.056477+00:00, run_end_date=2024-05-25 02:29:05.999216+00:00, run_duration=4.942739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:28:00+00:00, data_interval_end=2024-05-25 02:29:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:29:06.012035684Z [2024-05-25T02:29:06.011+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:29:00+00:00, run_after=2024-05-25T02:30:00+00:00 2024-05-25T02:29:06.063403777Z [2024-05-25T02:29:06.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:28:00+00:00 exited with status success for try_number 1 2024-05-25T02:29:06.088690207Z [2024-05-25T02:29:06.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:28:00+00:00, map_index=-1, run_start_date=2024-05-25 02:29:03.351140+00:00, run_end_date=2024-05-25 02:29:05.320511+00:00, run_duration=1.969371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=930, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:29:01.129196+00:00, queued_by_job_id=1, pid=13678 2024-05-25T02:30:00.061311168Z [2024-05-25T02:30:00.060+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:30:00.076845318Z [2024-05-25T02:30:00.076+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:30:00.104189956Z [2024-05-25T02:30:00.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:30:00+00:00, run_after=2024-05-25T02:35:00+00:00 2024-05-25T02:30:00.120206693Z [2024-05-25T02:30:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:30:00+00:00, run_after=2024-05-25T02:31:00+00:00 2024-05-25T02:30:00.134318280Z [2024-05-25T02:30:00.133+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:30:00+00:00, run_after=2024-05-25T02:31:00+00:00 2024-05-25T02:30:00.257957747Z [2024-05-25T02:30:00.257+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T02:30:00.258010715Z 2024-05-25T02:30:00.258021190Z 2024-05-25T02:30:00.258031598Z 2024-05-25T02:30:00.258040340Z 2024-05-25T02:30:00.258048798Z 2024-05-25T02:30:00.258282874Z [2024-05-25T02:30:00.257+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:30:00.258783003Z [2024-05-25T02:30:00.258+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:30:00.259175041Z [2024-05-25T02:30:00.258+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:30:00.259545286Z [2024-05-25T02:30:00.259+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:30:00.259882869Z [2024-05-25T02:30:00.259+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:30:00.261055030Z [2024-05-25T02:30:00.260+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:30:00.261072324Z 2024-05-25T02:30:00.261082509Z 2024-05-25T02:30:00.261091185Z 2024-05-25T02:30:00.261099669Z 2024-05-25T02:30:00.261108020Z 2024-05-25T02:30:00.268521774Z [2024-05-25T02:30:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T02:30:00.269321502Z [2024-05-25T02:30:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:30:00.270101569Z [2024-05-25T02:30:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:30:00.270580557Z [2024-05-25T02:30:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:30:00.271226016Z [2024-05-25T02:30:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:30:00.271656287Z [2024-05-25T02:30:00.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:30:00.272344511Z [2024-05-25T02:30:00.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:30:00.272688014Z [2024-05-25T02:30:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:30:00.273292947Z [2024-05-25T02:30:00.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:30:00.273785524Z [2024-05-25T02:30:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:30:00.698081688Z [2024-05-25T02:30:00.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status queued for try_number 1 2024-05-25T02:30:00.698279414Z [2024-05-25T02:30:00.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:28:00+00:00 exited with status queued for try_number 1 2024-05-25T02:30:00.698436611Z [2024-05-25T02:30:00.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:29:00+00:00 exited with status queued for try_number 1 2024-05-25T02:30:00.698577145Z [2024-05-25T02:30:00.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:29:00+00:00 exited with status queued for try_number 1 2024-05-25T02:30:00.698713803Z [2024-05-25T02:30:00.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:29:00+00:00 exited with status queued for try_number 1 2024-05-25T02:30:00.707115577Z [2024-05-25T02:30:00.706+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88323abf-e14a-4e63-876a-3fde561729e4 2024-05-25T02:30:00.707355062Z [2024-05-25T02:30:00.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 713b9f82-de89-4b29-8967-49427854d942 2024-05-25T02:30:00.707543059Z [2024-05-25T02:30:00.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0e4728a-2da7-425f-bd18-f3104babb438 2024-05-25T02:30:00.707730708Z [2024-05-25T02:30:00.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77b8d511-2000-422d-b6ad-321684c3d212 2024-05-25T02:30:00.707906802Z [2024-05-25T02:30:00.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35040600-7362-4e63-a47c-6bcab43a16c4 2024-05-25T02:30:02.016999848Z [2024-05-25T02:30:02.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:30:02.017314341Z [2024-05-25T02:30:02.017+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:28:00+00:00, run_id=scheduled__2024-05-25T02:28:00+00:00, run_start_date=2024-05-25 02:30:00.149076+00:00, run_end_date=2024-05-25 02:30:02.016900+00:00, run_duration=1.867824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:28:00+00:00, data_interval_end=2024-05-25 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:30:02.024942310Z [2024-05-25T02:30:02.024+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:30:00+00:00, run_after=2024-05-25T02:32:00+00:00 2024-05-25T02:30:02.034518755Z [2024-05-25T02:30:02.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:30:02.034730830Z [2024-05-25T02:30:02.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:29:00+00:00, run_id=scheduled__2024-05-25T02:29:00+00:00, run_start_date=2024-05-25 02:30:00.150319+00:00, run_end_date=2024-05-25 02:30:02.034405+00:00, run_duration=1.884086, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:29:00+00:00, data_interval_end=2024-05-25 02:30:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:30:02.043878366Z [2024-05-25T02:30:02.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:30:00+00:00, run_after=2024-05-25T02:31:00+00:00 2024-05-25T02:30:02.124492031Z [2024-05-25T02:30:02.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:28:00+00:00 exited with status success for try_number 1 2024-05-25T02:30:02.125074280Z [2024-05-25T02:30:02.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:29:00+00:00 exited with status success for try_number 1 2024-05-25T02:30:02.136154522Z [2024-05-25T02:30:02.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:28:00+00:00, map_index=-1, run_start_date=2024-05-25 02:30:01.145642+00:00, run_end_date=2024-05-25 02:30:01.574613+00:00, run_duration=0.428971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=931, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:30:00.263221+00:00, queued_by_job_id=1, pid=13712 2024-05-25T02:30:02.136824196Z [2024-05-25T02:30:02.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:29:00+00:00, map_index=-1, run_start_date=2024-05-25 02:30:01.335010+00:00, run_end_date=2024-05-25 02:30:01.807640+00:00, run_duration=0.47263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=932, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:30:00.263221+00:00, queued_by_job_id=1, pid=13713 2024-05-25T02:30:03.220793358Z [2024-05-25T02:30:03.220+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:30:03.220817037Z 2024-05-25T02:30:03.221103206Z [2024-05-25T02:30:03.220+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:30:03.222107402Z [2024-05-25T02:30:03.221+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:30:03.222124435Z 2024-05-25T02:30:03.226027815Z [2024-05-25T02:30:03.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T02:30:03.226435375Z [2024-05-25T02:30:03.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:30:03.285234887Z [2024-05-25T02:30:03.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status queued for try_number 1 2024-05-25T02:30:03.286197491Z [2024-05-25T02:30:03.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status success for try_number 1 2024-05-25T02:30:03.295081977Z [2024-05-25T02:30:03.294+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e8bf057-06b9-43fa-a1d9-fcc0c71adb51 2024-05-25T02:30:03.295446581Z [2024-05-25T02:30:03.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T02:25:00+00:00, map_index=-1, run_start_date=2024-05-25 02:30:02.467733+00:00, run_end_date=2024-05-25 02:30:02.861490+00:00, run_duration=0.393757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=933, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:30:00.263221+00:00, queued_by_job_id=1, pid=13737 2024-05-25T02:30:04.231602631Z [2024-05-25T02:30:04.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:30:04.232155655Z [2024-05-25T02:30:04.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:29:00+00:00, run_id=scheduled__2024-05-25T02:29:00+00:00, run_start_date=2024-05-25 02:30:00.151430+00:00, run_end_date=2024-05-25 02:30:04.231515+00:00, run_duration=4.080085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:29:00+00:00, data_interval_end=2024-05-25 02:30:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:30:04.252552967Z [2024-05-25T02:30:04.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:30:00+00:00, run_after=2024-05-25T02:31:00+00:00 2024-05-25T02:30:04.313705261Z [2024-05-25T02:30:04.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:29:00+00:00 exited with status success for try_number 1 2024-05-25T02:30:04.321896419Z [2024-05-25T02:30:04.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:29:00+00:00, map_index=-1, run_start_date=2024-05-25 02:30:02.652489+00:00, run_end_date=2024-05-25 02:30:03.888177+00:00, run_duration=1.235688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=934, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:30:00.263221+00:00, queued_by_job_id=1, pid=13743 2024-05-25T02:30:05.403417814Z [2024-05-25T02:30:05.403+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:30:05.403800224Z [2024-05-25T02:30:05.403+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:29:00+00:00, run_id=scheduled__2024-05-25T02:29:00+00:00, run_start_date=2024-05-25 02:30:00.152820+00:00, run_end_date=2024-05-25 02:30:05.403506+00:00, run_duration=5.250686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:29:00+00:00, data_interval_end=2024-05-25 02:30:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:30:05.414958975Z [2024-05-25T02:30:05.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:30:00+00:00, run_after=2024-05-25T02:31:00+00:00 2024-05-25T02:30:05.479522450Z [2024-05-25T02:30:05.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:29:00+00:00 exited with status success for try_number 1 2024-05-25T02:30:05.487451131Z [2024-05-25T02:30:05.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:29:00+00:00, map_index=-1, run_start_date=2024-05-25 02:30:02.839137+00:00, run_end_date=2024-05-25 02:30:04.660384+00:00, run_duration=1.821247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=935, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:30:00.263221+00:00, queued_by_job_id=1, pid=13749 2024-05-25T02:30:06.046599511Z [2024-05-25T02:30:06.046+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:30:06.046625717Z 2024-05-25T02:30:06.049346422Z [2024-05-25T02:30:06.046+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:30:06.049362015Z [2024-05-25T02:30:06.047+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:30:06.049365569Z 2024-05-25T02:30:06.049955722Z [2024-05-25T02:30:06.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T02:30:06.056778009Z [2024-05-25T02:30:06.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:30:06.123978222Z [2024-05-25T02:30:06.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status queued for try_number 1 2024-05-25T02:30:06.124123911Z [2024-05-25T02:30:06.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status success for try_number 1 2024-05-25T02:30:06.130568951Z [2024-05-25T02:30:06.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d7f9804-d34b-4cb1-8cb8-88823f47a738 2024-05-25T02:30:06.130771424Z [2024-05-25T02:30:06.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T02:25:00+00:00, map_index=-1, run_start_date=2024-05-25 02:30:05.095301+00:00, run_end_date=2024-05-25 02:30:05.492020+00:00, run_duration=0.396719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=936, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:30:03.223096+00:00, queued_by_job_id=1, pid=13767 2024-05-25T02:30:09.493476036Z [2024-05-25T02:30:09.492+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:30:09.493526258Z 2024-05-25T02:30:09.493893584Z [2024-05-25T02:30:09.493+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:30:09.495353614Z [2024-05-25T02:30:09.494+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:30:09.495380408Z 2024-05-25T02:30:09.499952182Z [2024-05-25T02:30:09.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:30:09.500589042Z [2024-05-25T02:30:09.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:30:09.568586414Z [2024-05-25T02:30:09.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status queued for try_number 1 2024-05-25T02:30:09.568907964Z [2024-05-25T02:30:09.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status success for try_number 1 2024-05-25T02:30:09.577511691Z [2024-05-25T02:30:09.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff1da448-a430-49a1-8766-f979ca37ddc5 2024-05-25T02:30:09.577806033Z [2024-05-25T02:30:09.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T02:25:00+00:00, map_index=0, run_start_date=2024-05-25 02:30:07.632130+00:00, run_end_date=2024-05-25 02:30:09.020530+00:00, run_duration=1.3884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=937, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:30:06.047569+00:00, queued_by_job_id=1, pid=13786 2024-05-25T02:30:12.315973897Z [2024-05-25T02:30:12.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:30:12.316316472Z [2024-05-25T02:30:12.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:25:00+00:00, run_id=scheduled__2024-05-25T02:25:00+00:00, run_start_date=2024-05-25 02:30:00.147692+00:00, run_end_date=2024-05-25 02:30:12.315880+00:00, run_duration=12.168188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:25:00+00:00, data_interval_end=2024-05-25 02:30:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T02:30:12.326420549Z [2024-05-25T02:30:12.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:30:00+00:00, run_after=2024-05-25T02:35:00+00:00 2024-05-25T02:30:12.361738494Z [2024-05-25T02:30:12.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:25:00+00:00 exited with status success for try_number 1 2024-05-25T02:30:12.366630855Z [2024-05-25T02:30:12.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T02:25:00+00:00, map_index=-1, run_start_date=2024-05-25 02:30:11.045829+00:00, run_end_date=2024-05-25 02:30:11.479797+00:00, run_duration=0.433968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=938, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:30:09.496176+00:00, queued_by_job_id=1, pid=13802 2024-05-25T02:30:30.141140569Z [2024-05-25T02:30:30.136+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T02:31:00.119398967Z [2024-05-25T02:31:00.116+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:31:00.135813184Z [2024-05-25T02:31:00.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:31:00+00:00, run_after=2024-05-25T02:32:00+00:00 2024-05-25T02:31:00.150075065Z [2024-05-25T02:31:00.149+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:31:00+00:00, run_after=2024-05-25T02:32:00+00:00 2024-05-25T02:31:00.217200158Z [2024-05-25T02:31:00.216+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:31:00.217288418Z 2024-05-25T02:31:00.217297001Z 2024-05-25T02:31:00.217307149Z 2024-05-25T02:31:00.217481009Z [2024-05-25T02:31:00.217+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:31:00.217508323Z [2024-05-25T02:31:00.217+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:31:00.217653820Z [2024-05-25T02:31:00.217+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:31:00.218223369Z [2024-05-25T02:31:00.217+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:31:00.218243698Z 2024-05-25T02:31:00.218254898Z 2024-05-25T02:31:00.218265783Z 2024-05-25T02:31:00.221519316Z [2024-05-25T02:31:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:31:00.221633900Z [2024-05-25T02:31:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:31:00.221978735Z [2024-05-25T02:31:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:31:00.222130240Z [2024-05-25T02:31:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:31:00.222428163Z [2024-05-25T02:31:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:31:00.222844380Z [2024-05-25T02:31:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:31:00.481332882Z [2024-05-25T02:31:00.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status queued for try_number 1 2024-05-25T02:31:00.481513758Z [2024-05-25T02:31:00.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status queued for try_number 1 2024-05-25T02:31:00.481638644Z [2024-05-25T02:31:00.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status queued for try_number 1 2024-05-25T02:31:00.489186716Z [2024-05-25T02:31:00.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e90e384-95d4-48bb-8d14-0236dc8a92b6 2024-05-25T02:31:00.489485190Z [2024-05-25T02:31:00.489+0000] {scheduler_job.py:635} INFO - Setting external_id for to c230b9ac-bd3a-4859-ae53-3bc02201174f 2024-05-25T02:31:00.489690675Z [2024-05-25T02:31:00.489+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f838505-e347-4691-8b24-f8c50037b597 2024-05-25T02:31:01.631468482Z [2024-05-25T02:31:01.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:31:01.631736387Z [2024-05-25T02:31:01.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:30:00+00:00, run_id=scheduled__2024-05-25T02:30:00+00:00, run_start_date=2024-05-25 02:31:00.163769+00:00, run_end_date=2024-05-25 02:31:01.631328+00:00, run_duration=1.467559, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:30:00+00:00, data_interval_end=2024-05-25 02:31:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:31:01.643500449Z [2024-05-25T02:31:01.643+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:31:00+00:00, run_after=2024-05-25T02:32:00+00:00 2024-05-25T02:31:02.041397518Z [2024-05-25T02:31:02.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status success for try_number 1 2024-05-25T02:31:02.048339658Z [2024-05-25T02:31:02.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:30:00+00:00, map_index=-1, run_start_date=2024-05-25 02:31:01.107763+00:00, run_end_date=2024-05-25 02:31:01.550351+00:00, run_duration=0.442588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=939, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:31:00.218823+00:00, queued_by_job_id=1, pid=13811 2024-05-25T02:31:04.238058720Z [2024-05-25T02:31:04.237+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:31:04.238237672Z [2024-05-25T02:31:04.237+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:30:00+00:00, run_id=scheduled__2024-05-25T02:30:00+00:00, run_start_date=2024-05-25 02:31:00.165395+00:00, run_end_date=2024-05-25 02:31:04.237849+00:00, run_duration=4.072454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:30:00+00:00, data_interval_end=2024-05-25 02:31:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:31:04.252440941Z [2024-05-25T02:31:04.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:31:00+00:00, run_after=2024-05-25T02:32:00+00:00 2024-05-25T02:31:04.262742481Z [2024-05-25T02:31:04.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:31:04.262890844Z [2024-05-25T02:31:04.262+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:30:00+00:00, run_id=scheduled__2024-05-25T02:30:00+00:00, run_start_date=2024-05-25 02:31:00.166521+00:00, run_end_date=2024-05-25 02:31:04.262593+00:00, run_duration=4.096072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:30:00+00:00, data_interval_end=2024-05-25 02:31:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:31:04.271887299Z [2024-05-25T02:31:04.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:31:00+00:00, run_after=2024-05-25T02:32:00+00:00 2024-05-25T02:31:04.311389084Z [2024-05-25T02:31:04.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status success for try_number 1 2024-05-25T02:31:04.311419014Z [2024-05-25T02:31:04.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status success for try_number 1 2024-05-25T02:31:04.320084758Z [2024-05-25T02:31:04.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:30:00+00:00, map_index=-1, run_start_date=2024-05-25 02:31:01.967926+00:00, run_end_date=2024-05-25 02:31:03.640989+00:00, run_duration=1.673063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=940, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:31:00.218823+00:00, queued_by_job_id=1, pid=13824 2024-05-25T02:31:04.320308032Z [2024-05-25T02:31:04.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:30:00+00:00, map_index=-1, run_start_date=2024-05-25 02:31:02.428690+00:00, run_end_date=2024-05-25 02:31:03.857098+00:00, run_duration=1.428408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=941, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:31:00.218823+00:00, queued_by_job_id=1, pid=13835 2024-05-25T02:32:00.101094042Z [2024-05-25T02:32:00.100+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:32:00.123474433Z [2024-05-25T02:32:00.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:32:00+00:00, run_after=2024-05-25T02:33:00+00:00 2024-05-25T02:32:00.145760106Z [2024-05-25T02:32:00.145+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:32:00+00:00, run_after=2024-05-25T02:33:00+00:00 2024-05-25T02:32:00.158452217Z [2024-05-25T02:32:00.158+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:32:00.300632866Z [2024-05-25T02:32:00.300+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:32:00.300676149Z 2024-05-25T02:32:00.300709674Z 2024-05-25T02:32:00.300719406Z 2024-05-25T02:32:00.300727849Z 2024-05-25T02:32:00.300915121Z [2024-05-25T02:32:00.300+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:32:00.301421538Z [2024-05-25T02:32:00.301+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:32:00.301798149Z [2024-05-25T02:32:00.301+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:32:00.302196407Z [2024-05-25T02:32:00.301+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:32:00.303235922Z [2024-05-25T02:32:00.302+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:32:00.303252648Z 2024-05-25T02:32:00.303258410Z 2024-05-25T02:32:00.303263347Z 2024-05-25T02:32:00.303268077Z 2024-05-25T02:32:00.308684311Z [2024-05-25T02:32:00.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:32:00.309057826Z [2024-05-25T02:32:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:32:00.309595756Z [2024-05-25T02:32:00.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:32:00.310029661Z [2024-05-25T02:32:00.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:32:00.310563385Z [2024-05-25T02:32:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:32:00.310899638Z [2024-05-25T02:32:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:32:00.311405506Z [2024-05-25T02:32:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:32:00.311686806Z [2024-05-25T02:32:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:32:00.966468346Z [2024-05-25T02:32:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status queued for try_number 1 2024-05-25T02:32:00.966827400Z [2024-05-25T02:32:00.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:31:00+00:00 exited with status queued for try_number 1 2024-05-25T02:32:00.967081042Z [2024-05-25T02:32:00.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:31:00+00:00 exited with status queued for try_number 1 2024-05-25T02:32:00.967242368Z [2024-05-25T02:32:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:31:00+00:00 exited with status queued for try_number 1 2024-05-25T02:32:00.991346634Z [2024-05-25T02:32:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 643bb48e-eb2b-456a-88dd-7c2d1d339b7e 2024-05-25T02:32:00.992432577Z [2024-05-25T02:32:00.992+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5aae381b-6914-4dc9-bede-42c0037ba0c9 2024-05-25T02:32:00.992825765Z [2024-05-25T02:32:00.992+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8cd0c77-a7a0-4454-9fe4-9a4bc8e9ae65 2024-05-25T02:32:00.994087010Z [2024-05-25T02:32:00.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to 426cd843-536c-4fe4-8bd3-9b894cbae468 2024-05-25T02:32:02.316343597Z [2024-05-25T02:32:02.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:32:02.316574869Z [2024-05-25T02:32:02.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:30:00+00:00, run_id=scheduled__2024-05-25T02:30:00+00:00, run_start_date=2024-05-25 02:32:00.176663+00:00, run_end_date=2024-05-25 02:32:02.316225+00:00, run_duration=2.139562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:30:00+00:00, data_interval_end=2024-05-25 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:32:02.329735543Z [2024-05-25T02:32:02.324+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:32:00+00:00, run_after=2024-05-25T02:34:00+00:00 2024-05-25T02:32:02.344717723Z [2024-05-25T02:32:02.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:32:02.344924999Z [2024-05-25T02:32:02.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:31:00+00:00, run_id=scheduled__2024-05-25T02:31:00+00:00, run_start_date=2024-05-25 02:32:00.178928+00:00, run_end_date=2024-05-25 02:32:02.344645+00:00, run_duration=2.165717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:31:00+00:00, data_interval_end=2024-05-25 02:32:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:32:02.359337183Z [2024-05-25T02:32:02.359+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:32:00+00:00, run_after=2024-05-25T02:33:00+00:00 2024-05-25T02:32:02.462533775Z [2024-05-25T02:32:02.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status success for try_number 1 2024-05-25T02:32:02.462664390Z [2024-05-25T02:32:02.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:31:00+00:00 exited with status success for try_number 1 2024-05-25T02:32:02.474090286Z [2024-05-25T02:32:02.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:31:00+00:00, map_index=-1, run_start_date=2024-05-25 02:32:01.209945+00:00, run_end_date=2024-05-25 02:32:01.728684+00:00, run_duration=0.518739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=943, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:32:00.304619+00:00, queued_by_job_id=1, pid=13863 2024-05-25T02:32:02.476427978Z [2024-05-25T02:32:02.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:30:00+00:00, map_index=-1, run_start_date=2024-05-25 02:32:01.213831+00:00, run_end_date=2024-05-25 02:32:01.695584+00:00, run_duration=0.481753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=942, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:32:00.304619+00:00, queued_by_job_id=1, pid=13862 2024-05-25T02:32:04.136019290Z [2024-05-25T02:32:04.135+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:32:04.136094686Z [2024-05-25T02:32:04.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:31:00+00:00, run_id=scheduled__2024-05-25T02:31:00+00:00, run_start_date=2024-05-25 02:32:00.180359+00:00, run_end_date=2024-05-25 02:32:04.135808+00:00, run_duration=3.955449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:31:00+00:00, data_interval_end=2024-05-25 02:32:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:32:04.144373389Z [2024-05-25T02:32:04.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:32:00+00:00, run_after=2024-05-25T02:33:00+00:00 2024-05-25T02:32:04.186853647Z [2024-05-25T02:32:04.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:31:00+00:00 exited with status success for try_number 1 2024-05-25T02:32:04.192779136Z [2024-05-25T02:32:04.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:31:00+00:00, map_index=-1, run_start_date=2024-05-25 02:32:02.241868+00:00, run_end_date=2024-05-25 02:32:03.710050+00:00, run_duration=1.468182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=944, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:32:00.304619+00:00, queued_by_job_id=1, pid=13886 2024-05-25T02:32:04.603722725Z [2024-05-25T02:32:04.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:32:04.604181315Z [2024-05-25T02:32:04.603+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:31:00+00:00, run_id=scheduled__2024-05-25T02:31:00+00:00, run_start_date=2024-05-25 02:32:00.181886+00:00, run_end_date=2024-05-25 02:32:04.603593+00:00, run_duration=4.421707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:31:00+00:00, data_interval_end=2024-05-25 02:32:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:32:04.614370744Z [2024-05-25T02:32:04.613+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:32:00+00:00, run_after=2024-05-25T02:33:00+00:00 2024-05-25T02:32:04.665932958Z [2024-05-25T02:32:04.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:31:00+00:00 exited with status success for try_number 1 2024-05-25T02:32:04.691729692Z [2024-05-25T02:32:04.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:31:00+00:00, map_index=-1, run_start_date=2024-05-25 02:32:02.428624+00:00, run_end_date=2024-05-25 02:32:04.361838+00:00, run_duration=1.933214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=945, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:32:00.304619+00:00, queued_by_job_id=1, pid=13887 2024-05-25T02:33:01.095111144Z [2024-05-25T02:33:01.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:33:00+00:00, run_after=2024-05-25T02:34:00+00:00 2024-05-25T02:33:01.116988844Z [2024-05-25T02:33:01.116+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:33:00+00:00, run_after=2024-05-25T02:34:00+00:00 2024-05-25T02:33:01.127319080Z [2024-05-25T02:33:01.126+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:33:01.216123382Z [2024-05-25T02:33:01.215+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:33:01.216156362Z 2024-05-25T02:33:01.216161505Z 2024-05-25T02:33:01.216166066Z 2024-05-25T02:33:01.216492646Z [2024-05-25T02:33:01.215+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:33:01.216897448Z [2024-05-25T02:33:01.216+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:33:01.217325532Z [2024-05-25T02:33:01.217+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:33:01.218869666Z [2024-05-25T02:33:01.218+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:33:01.218902562Z 2024-05-25T02:33:01.218908299Z 2024-05-25T02:33:01.218912973Z 2024-05-25T02:33:01.227033438Z [2024-05-25T02:33:01.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:33:01.227557918Z [2024-05-25T02:33:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:33:01.228282072Z [2024-05-25T02:33:01.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:33:01.228652816Z [2024-05-25T02:33:01.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:33:01.229169713Z [2024-05-25T02:33:01.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:33:01.229477227Z [2024-05-25T02:33:01.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:33:01.479805092Z [2024-05-25T02:33:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:32:00+00:00 exited with status queued for try_number 1 2024-05-25T02:33:01.479895155Z [2024-05-25T02:33:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:32:00+00:00 exited with status queued for try_number 1 2024-05-25T02:33:01.480067475Z [2024-05-25T02:33:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:32:00+00:00 exited with status queued for try_number 1 2024-05-25T02:33:01.494818181Z [2024-05-25T02:33:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb54f3b3-a42f-475b-98de-3def0bd8012a 2024-05-25T02:33:01.494952476Z [2024-05-25T02:33:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e18a348-e0e0-44c9-9e48-661659a48b03 2024-05-25T02:33:01.495150562Z [2024-05-25T02:33:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63ca354d-e2d7-43d9-8fb6-45e57e47d02f 2024-05-25T02:33:02.644053629Z [2024-05-25T02:33:02.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:33:02.644816994Z [2024-05-25T02:33:02.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:32:00+00:00, run_id=scheduled__2024-05-25T02:32:00+00:00, run_start_date=2024-05-25 02:33:01.140502+00:00, run_end_date=2024-05-25 02:33:02.644216+00:00, run_duration=1.503714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:32:00+00:00, data_interval_end=2024-05-25 02:33:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:33:02.656198442Z [2024-05-25T02:33:02.655+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:33:00+00:00, run_after=2024-05-25T02:34:00+00:00 2024-05-25T02:33:02.720829403Z [2024-05-25T02:33:02.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:32:00+00:00 exited with status success for try_number 1 2024-05-25T02:33:02.726759832Z [2024-05-25T02:33:02.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:32:00+00:00, map_index=-1, run_start_date=2024-05-25 02:33:02.044438+00:00, run_end_date=2024-05-25 02:33:02.445088+00:00, run_duration=0.40065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=946, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:33:01.220807+00:00, queued_by_job_id=1, pid=13920 2024-05-25T02:33:05.747809955Z [2024-05-25T02:33:05.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:33:05.748257879Z [2024-05-25T02:33:05.747+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:32:00+00:00, run_id=scheduled__2024-05-25T02:32:00+00:00, run_start_date=2024-05-25 02:33:01.142167+00:00, run_end_date=2024-05-25 02:33:05.747649+00:00, run_duration=4.605482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:32:00+00:00, data_interval_end=2024-05-25 02:33:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:33:05.766925849Z [2024-05-25T02:33:05.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:33:00+00:00, run_after=2024-05-25T02:34:00+00:00 2024-05-25T02:33:05.776988923Z [2024-05-25T02:33:05.776+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:33:05.777084447Z [2024-05-25T02:33:05.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:32:00+00:00, run_id=scheduled__2024-05-25T02:32:00+00:00, run_start_date=2024-05-25 02:33:01.143313+00:00, run_end_date=2024-05-25 02:33:05.776829+00:00, run_duration=4.633516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:32:00+00:00, data_interval_end=2024-05-25 02:33:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:33:05.786804421Z [2024-05-25T02:33:05.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:33:00+00:00, run_after=2024-05-25T02:34:00+00:00 2024-05-25T02:33:05.839165771Z [2024-05-25T02:33:05.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:32:00+00:00 exited with status success for try_number 1 2024-05-25T02:33:05.839188050Z [2024-05-25T02:33:05.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:32:00+00:00 exited with status success for try_number 1 2024-05-25T02:33:05.845286062Z [2024-05-25T02:33:05.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:32:00+00:00, map_index=-1, run_start_date=2024-05-25 02:33:03.190600+00:00, run_end_date=2024-05-25 02:33:04.954347+00:00, run_duration=1.763747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=948, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:33:01.220807+00:00, queued_by_job_id=1, pid=13939 2024-05-25T02:33:05.845302259Z [2024-05-25T02:33:05.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:32:00+00:00, map_index=-1, run_start_date=2024-05-25 02:33:03.069757+00:00, run_end_date=2024-05-25 02:33:05.355193+00:00, run_duration=2.285436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=947, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:33:01.220807+00:00, queued_by_job_id=1, pid=13938 2024-05-25T02:34:00.994591753Z [2024-05-25T02:34:00.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:34:00+00:00, run_after=2024-05-25T02:35:00+00:00 2024-05-25T02:34:01.026672128Z [2024-05-25T02:34:01.026+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:34:00+00:00, run_after=2024-05-25T02:35:00+00:00 2024-05-25T02:34:01.034884093Z [2024-05-25T02:34:01.034+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:34:01.041604666Z [2024-05-25T02:34:01.041+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:34:01.134680117Z [2024-05-25T02:34:01.134+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:34:01.134738440Z 2024-05-25T02:34:01.134749433Z 2024-05-25T02:34:01.134758507Z 2024-05-25T02:34:01.134767054Z 2024-05-25T02:34:01.134777213Z [2024-05-25T02:34:01.134+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:34:01.134882738Z [2024-05-25T02:34:01.134+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:34:01.135117143Z [2024-05-25T02:34:01.134+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:34:01.135335348Z [2024-05-25T02:34:01.135+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:34:01.136252948Z [2024-05-25T02:34:01.135+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:34:01.136275173Z 2024-05-25T02:34:01.136284654Z 2024-05-25T02:34:01.136293054Z 2024-05-25T02:34:01.136301359Z 2024-05-25T02:34:01.142319946Z [2024-05-25T02:34:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:34:01.142601677Z [2024-05-25T02:34:01.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:34:01.142968869Z [2024-05-25T02:34:01.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:34:01.143081836Z [2024-05-25T02:34:01.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:34:01.143535516Z [2024-05-25T02:34:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:34:01.143621295Z [2024-05-25T02:34:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:34:01.144014008Z [2024-05-25T02:34:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:34:01.144104871Z [2024-05-25T02:34:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:34:01.787747170Z [2024-05-25T02:34:01.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:32:00+00:00 exited with status queued for try_number 1 2024-05-25T02:34:01.788049581Z [2024-05-25T02:34:01.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:33:00+00:00 exited with status queued for try_number 1 2024-05-25T02:34:01.793603489Z [2024-05-25T02:34:01.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:33:00+00:00 exited with status queued for try_number 1 2024-05-25T02:34:01.793802362Z [2024-05-25T02:34:01.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:33:00+00:00 exited with status queued for try_number 1 2024-05-25T02:34:01.814804860Z [2024-05-25T02:34:01.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1a9760c-4e73-49b8-8514-b99108a327e5 2024-05-25T02:34:01.815089753Z [2024-05-25T02:34:01.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to a55bfb13-3e2d-4a58-9a06-c69c91c9be6b 2024-05-25T02:34:01.815302272Z [2024-05-25T02:34:01.815+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcbc4c50-4ccb-4294-9f27-9e3cea853436 2024-05-25T02:34:01.815509521Z [2024-05-25T02:34:01.815+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76b7ed78-1dc8-4d83-a338-80c9fa6e7feb 2024-05-25T02:34:02.987449562Z [2024-05-25T02:34:02.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:34:02.987908494Z [2024-05-25T02:34:02.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:32:00+00:00, run_id=scheduled__2024-05-25T02:32:00+00:00, run_start_date=2024-05-25 02:34:01.052185+00:00, run_end_date=2024-05-25 02:34:02.987324+00:00, run_duration=1.935139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:32:00+00:00, data_interval_end=2024-05-25 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:34:02.996870496Z [2024-05-25T02:34:02.996+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:34:00+00:00, run_after=2024-05-25T02:36:00+00:00 2024-05-25T02:34:03.008206047Z [2024-05-25T02:34:03.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:34:03.008644494Z [2024-05-25T02:34:03.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:33:00+00:00, run_id=scheduled__2024-05-25T02:33:00+00:00, run_start_date=2024-05-25 02:34:01.053417+00:00, run_end_date=2024-05-25 02:34:03.008142+00:00, run_duration=1.954725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:33:00+00:00, data_interval_end=2024-05-25 02:34:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:34:03.018805181Z [2024-05-25T02:34:03.018+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:34:00+00:00, run_after=2024-05-25T02:35:00+00:00 2024-05-25T02:34:03.066343156Z [2024-05-25T02:34:03.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:32:00+00:00 exited with status success for try_number 1 2024-05-25T02:34:03.068886490Z [2024-05-25T02:34:03.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:33:00+00:00 exited with status success for try_number 1 2024-05-25T02:34:03.077313514Z [2024-05-25T02:34:03.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:32:00+00:00, map_index=-1, run_start_date=2024-05-25 02:34:01.987667+00:00, run_end_date=2024-05-25 02:34:02.480649+00:00, run_duration=0.492982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=950, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:34:01.137466+00:00, queued_by_job_id=1, pid=13972 2024-05-25T02:34:03.077432034Z [2024-05-25T02:34:03.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:33:00+00:00, map_index=-1, run_start_date=2024-05-25 02:34:01.989603+00:00, run_end_date=2024-05-25 02:34:02.504524+00:00, run_duration=0.514921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=949, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:34:01.137466+00:00, queued_by_job_id=1, pid=13973 2024-05-25T02:34:05.024315814Z [2024-05-25T02:34:05.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:34:05.024832915Z [2024-05-25T02:34:05.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:33:00+00:00, run_id=scheduled__2024-05-25T02:33:00+00:00, run_start_date=2024-05-25 02:34:01.054403+00:00, run_end_date=2024-05-25 02:34:05.024141+00:00, run_duration=3.969738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:33:00+00:00, data_interval_end=2024-05-25 02:34:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:34:05.037698498Z [2024-05-25T02:34:05.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:34:00+00:00, run_after=2024-05-25T02:35:00+00:00 2024-05-25T02:34:05.092043984Z [2024-05-25T02:34:05.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:33:00+00:00 exited with status success for try_number 1 2024-05-25T02:34:05.099515775Z [2024-05-25T02:34:05.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:33:00+00:00, map_index=-1, run_start_date=2024-05-25 02:34:03.382418+00:00, run_end_date=2024-05-25 02:34:04.681908+00:00, run_duration=1.29949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=952, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:34:01.137466+00:00, queued_by_job_id=1, pid=13997 2024-05-25T02:34:05.283447085Z [2024-05-25T02:34:05.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:34:05.283976066Z [2024-05-25T02:34:05.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:33:00+00:00, run_id=scheduled__2024-05-25T02:33:00+00:00, run_start_date=2024-05-25 02:34:01.055354+00:00, run_end_date=2024-05-25 02:34:05.283567+00:00, run_duration=4.228213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:33:00+00:00, data_interval_end=2024-05-25 02:34:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:34:05.305018991Z [2024-05-25T02:34:05.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:34:00+00:00, run_after=2024-05-25T02:35:00+00:00 2024-05-25T02:34:05.361345050Z [2024-05-25T02:34:05.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:33:00+00:00 exited with status success for try_number 1 2024-05-25T02:34:05.372026405Z [2024-05-25T02:34:05.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:33:00+00:00, map_index=-1, run_start_date=2024-05-25 02:34:03.202487+00:00, run_end_date=2024-05-25 02:34:05.055032+00:00, run_duration=1.852545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=951, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:34:01.137466+00:00, queued_by_job_id=1, pid=13996 2024-05-25T02:35:00.877713483Z [2024-05-25T02:35:00.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:35:00+00:00, run_after=2024-05-25T02:40:00+00:00 2024-05-25T02:35:00.896695207Z [2024-05-25T02:35:00.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:35:00+00:00, run_after=2024-05-25T02:36:00+00:00 2024-05-25T02:35:00.907908589Z [2024-05-25T02:35:00.907+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:35:00.926466260Z [2024-05-25T02:35:00.926+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:35:00+00:00, run_after=2024-05-25T02:36:00+00:00 2024-05-25T02:35:01.037375782Z [2024-05-25T02:35:01.036+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:35:01.037670112Z 2024-05-25T02:35:01.037792379Z 2024-05-25T02:35:01.037870866Z 2024-05-25T02:35:01.037883329Z 2024-05-25T02:35:01.037892132Z [2024-05-25T02:35:01.037+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:35:01.037921513Z [2024-05-25T02:35:01.037+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:35:01.037939688Z [2024-05-25T02:35:01.037+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:35:01.037948592Z [2024-05-25T02:35:01.037+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:35:01.038827102Z [2024-05-25T02:35:01.038+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:35:01.038845835Z 2024-05-25T02:35:01.038855543Z 2024-05-25T02:35:01.038863983Z 2024-05-25T02:35:01.038872690Z 2024-05-25T02:35:01.045159966Z [2024-05-25T02:35:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T02:35:01.045441275Z [2024-05-25T02:35:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:35:01.045783312Z [2024-05-25T02:35:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:35:01.045927252Z [2024-05-25T02:35:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:35:01.046525331Z [2024-05-25T02:35:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:35:01.046770484Z [2024-05-25T02:35:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:35:01.047390361Z [2024-05-25T02:35:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:35:01.047469095Z [2024-05-25T02:35:01.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:35:01.562760801Z [2024-05-25T02:35:01.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status queued for try_number 1 2024-05-25T02:35:01.562836705Z [2024-05-25T02:35:01.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:34:00+00:00 exited with status queued for try_number 1 2024-05-25T02:35:01.562987779Z [2024-05-25T02:35:01.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:34:00+00:00 exited with status queued for try_number 1 2024-05-25T02:35:01.563105653Z [2024-05-25T02:35:01.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:34:00+00:00 exited with status queued for try_number 1 2024-05-25T02:35:01.587859092Z [2024-05-25T02:35:01.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f79b8e1-bfd5-4c6c-bade-2466cf44d418 2024-05-25T02:35:01.588459495Z [2024-05-25T02:35:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to d77a3fed-9399-4541-95b2-7cf6299527bb 2024-05-25T02:35:01.588894009Z [2024-05-25T02:35:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12610a62-18f9-4197-9b13-ec2db93b3172 2024-05-25T02:35:01.589322098Z [2024-05-25T02:35:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70ed70c4-60bf-4fb4-8e1a-bcee1569f01c 2024-05-25T02:35:02.775722700Z [2024-05-25T02:35:02.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:35:02.776554110Z [2024-05-25T02:35:02.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:34:00+00:00, run_id=scheduled__2024-05-25T02:34:00+00:00, run_start_date=2024-05-25 02:35:00.939026+00:00, run_end_date=2024-05-25 02:35:02.775967+00:00, run_duration=1.836941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:34:00+00:00, data_interval_end=2024-05-25 02:35:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:35:02.791701769Z [2024-05-25T02:35:02.791+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:35:00+00:00, run_after=2024-05-25T02:36:00+00:00 2024-05-25T02:35:02.858491014Z [2024-05-25T02:35:02.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:34:00+00:00 exited with status success for try_number 1 2024-05-25T02:35:02.864719425Z [2024-05-25T02:35:02.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:34:00+00:00, map_index=-1, run_start_date=2024-05-25 02:35:01.943636+00:00, run_end_date=2024-05-25 02:35:02.368434+00:00, run_duration=0.424798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=953, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:35:01.040642+00:00, queued_by_job_id=1, pid=14031 2024-05-25T02:35:03.991753014Z [2024-05-25T02:35:03.991+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:35:03.991813666Z 2024-05-25T02:35:03.991900764Z [2024-05-25T02:35:03.991+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:35:03.992389852Z [2024-05-25T02:35:03.992+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:35:03.992400911Z 2024-05-25T02:35:03.994826340Z [2024-05-25T02:35:03.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T02:35:03.995030637Z [2024-05-25T02:35:03.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:35:04.053303995Z [2024-05-25T02:35:04.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status queued for try_number 1 2024-05-25T02:35:04.053458817Z [2024-05-25T02:35:04.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status success for try_number 1 2024-05-25T02:35:04.060045931Z [2024-05-25T02:35:04.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to eefa9eb2-8142-4246-b6b9-7b4fce582f15 2024-05-25T02:35:04.060239959Z [2024-05-25T02:35:04.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T02:30:00+00:00, map_index=-1, run_start_date=2024-05-25 02:35:03.253690+00:00, run_end_date=2024-05-25 02:35:03.680342+00:00, run_duration=0.426652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=955, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:35:01.040642+00:00, queued_by_job_id=1, pid=14056 2024-05-25T02:35:05.460996418Z [2024-05-25T02:35:05.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:35:05.461111434Z [2024-05-25T02:35:05.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:34:00+00:00, run_id=scheduled__2024-05-25T02:34:00+00:00, run_start_date=2024-05-25 02:35:00.940121+00:00, run_end_date=2024-05-25 02:35:05.460833+00:00, run_duration=4.520712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:34:00+00:00, data_interval_end=2024-05-25 02:35:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:35:05.470096491Z [2024-05-25T02:35:05.469+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:35:00+00:00, run_after=2024-05-25T02:36:00+00:00 2024-05-25T02:35:05.477844004Z [2024-05-25T02:35:05.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:35:05.478010689Z [2024-05-25T02:35:05.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:34:00+00:00, run_id=scheduled__2024-05-25T02:34:00+00:00, run_start_date=2024-05-25 02:35:00.941136+00:00, run_end_date=2024-05-25 02:35:05.477727+00:00, run_duration=4.536591, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:34:00+00:00, data_interval_end=2024-05-25 02:35:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:35:05.487022893Z [2024-05-25T02:35:05.486+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:35:00+00:00, run_after=2024-05-25T02:36:00+00:00 2024-05-25T02:35:05.557105268Z [2024-05-25T02:35:05.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:34:00+00:00 exited with status success for try_number 1 2024-05-25T02:35:05.557178333Z [2024-05-25T02:35:05.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:34:00+00:00 exited with status success for try_number 1 2024-05-25T02:35:05.565600625Z [2024-05-25T02:35:05.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:34:00+00:00, map_index=-1, run_start_date=2024-05-25 02:35:03.039274+00:00, run_end_date=2024-05-25 02:35:04.299195+00:00, run_duration=1.259921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=954, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:35:01.040642+00:00, queued_by_job_id=1, pid=14050 2024-05-25T02:35:05.565818591Z [2024-05-25T02:35:05.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:34:00+00:00, map_index=-1, run_start_date=2024-05-25 02:35:03.423578+00:00, run_end_date=2024-05-25 02:35:05.167046+00:00, run_duration=1.743468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=956, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:35:01.040642+00:00, queued_by_job_id=1, pid=14062 2024-05-25T02:35:06.679853187Z [2024-05-25T02:35:06.679+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:35:06.679914053Z 2024-05-25T02:35:06.680002913Z [2024-05-25T02:35:06.679+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:35:06.680428969Z [2024-05-25T02:35:06.680+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:35:06.680451387Z 2024-05-25T02:35:06.682709061Z [2024-05-25T02:35:06.682+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T02:35:06.682923426Z [2024-05-25T02:35:06.682+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:35:06.757149275Z [2024-05-25T02:35:06.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status queued for try_number 1 2024-05-25T02:35:06.761577268Z [2024-05-25T02:35:06.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status success for try_number 1 2024-05-25T02:35:06.775317570Z [2024-05-25T02:35:06.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b050cc9-91b8-4e68-8ebb-633433f9fba9 2024-05-25T02:35:06.777722631Z [2024-05-25T02:35:06.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T02:30:00+00:00, map_index=-1, run_start_date=2024-05-25 02:35:05.691311+00:00, run_end_date=2024-05-25 02:35:06.125960+00:00, run_duration=0.434649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=957, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:35:03.992716+00:00, queued_by_job_id=1, pid=14080 2024-05-25T02:35:10.167463208Z [2024-05-25T02:35:10.167+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:35:10.167507747Z 2024-05-25T02:35:10.167518664Z [2024-05-25T02:35:10.167+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:35:10.168096730Z [2024-05-25T02:35:10.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:35:10.168115566Z 2024-05-25T02:35:10.170138646Z [2024-05-25T02:35:10.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:35:10.170259203Z [2024-05-25T02:35:10.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:35:10.240255136Z [2024-05-25T02:35:10.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status queued for try_number 1 2024-05-25T02:35:10.240687127Z [2024-05-25T02:35:10.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status success for try_number 1 2024-05-25T02:35:10.251055900Z [2024-05-25T02:35:10.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5636ff6e-c161-4a3a-aa59-e59c5216c121 2024-05-25T02:35:10.251524518Z [2024-05-25T02:35:10.251+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T02:30:00+00:00, map_index=0, run_start_date=2024-05-25 02:35:08.423407+00:00, run_end_date=2024-05-25 02:35:09.720648+00:00, run_duration=1.297241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=958, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:35:06.680639+00:00, queued_by_job_id=1, pid=14101 2024-05-25T02:35:12.966636093Z [2024-05-25T02:35:12.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:35:12.966750826Z [2024-05-25T02:35:12.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:30:00+00:00, run_id=scheduled__2024-05-25T02:30:00+00:00, run_start_date=2024-05-25 02:35:00.937774+00:00, run_end_date=2024-05-25 02:35:12.966491+00:00, run_duration=12.028717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:30:00+00:00, data_interval_end=2024-05-25 02:35:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T02:35:12.972280631Z [2024-05-25T02:35:12.971+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:35:00+00:00, run_after=2024-05-25T02:40:00+00:00 2024-05-25T02:35:12.999274180Z [2024-05-25T02:35:12.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:30:00+00:00 exited with status success for try_number 1 2024-05-25T02:35:13.004553277Z [2024-05-25T02:35:13.004+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T02:30:00+00:00, map_index=-1, run_start_date=2024-05-25 02:35:11.789125+00:00, run_end_date=2024-05-25 02:35:12.217120+00:00, run_duration=0.427995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=959, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:35:10.168343+00:00, queued_by_job_id=1, pid=14114 2024-05-25T02:35:30.238133499Z [2024-05-25T02:35:30.237+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T02:36:00.865803867Z [2024-05-25T02:36:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:36:00+00:00, run_after=2024-05-25T02:37:00+00:00 2024-05-25T02:36:00.881415261Z [2024-05-25T02:36:00.881+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:36:00+00:00, run_after=2024-05-25T02:37:00+00:00 2024-05-25T02:36:00.889666996Z [2024-05-25T02:36:00.889+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:36:00.898344568Z [2024-05-25T02:36:00.897+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:36:01.004837044Z [2024-05-25T02:36:01.004+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:36:01.004892077Z 2024-05-25T02:36:01.004926677Z 2024-05-25T02:36:01.004940521Z 2024-05-25T02:36:01.004950510Z 2024-05-25T02:36:01.004961317Z [2024-05-25T02:36:01.004+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:36:01.005725525Z [2024-05-25T02:36:01.004+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:36:01.005952556Z [2024-05-25T02:36:01.005+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:36:01.006262285Z [2024-05-25T02:36:01.005+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:36:01.007303011Z [2024-05-25T02:36:01.006+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:36:01.007362762Z 2024-05-25T02:36:01.007374321Z 2024-05-25T02:36:01.007383977Z 2024-05-25T02:36:01.007393804Z 2024-05-25T02:36:01.012619348Z [2024-05-25T02:36:01.012+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:36:01.012731551Z [2024-05-25T02:36:01.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:36:01.013144024Z [2024-05-25T02:36:01.012+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:36:01.013276468Z [2024-05-25T02:36:01.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:36:01.013695885Z [2024-05-25T02:36:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:36:01.013736546Z [2024-05-25T02:36:01.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:36:01.014133159Z [2024-05-25T02:36:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:36:01.014235664Z [2024-05-25T02:36:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:36:01.328873219Z [2024-05-25T02:36:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:34:00+00:00 exited with status queued for try_number 1 2024-05-25T02:36:01.328927812Z [2024-05-25T02:36:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status queued for try_number 1 2024-05-25T02:36:01.329019533Z [2024-05-25T02:36:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status queued for try_number 1 2024-05-25T02:36:01.329122710Z [2024-05-25T02:36:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status queued for try_number 1 2024-05-25T02:36:01.338094584Z [2024-05-25T02:36:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcd658fc-58d8-428c-a1aa-812c8553a8b6 2024-05-25T02:36:01.338178819Z [2024-05-25T02:36:01.338+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba61475f-251d-430e-92d7-9547ae060240 2024-05-25T02:36:01.338337552Z [2024-05-25T02:36:01.338+0000] {scheduler_job.py:635} INFO - Setting external_id for to 882e4230-af2e-499e-845e-79656be6f30b 2024-05-25T02:36:01.338367956Z [2024-05-25T02:36:01.338+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed0f7719-a1c6-414d-9a8f-f4d62dfb69e3 2024-05-25T02:36:02.661637715Z [2024-05-25T02:36:02.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:36:02.661889125Z [2024-05-25T02:36:02.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:34:00+00:00, run_id=scheduled__2024-05-25T02:34:00+00:00, run_start_date=2024-05-25 02:36:00.913399+00:00, run_end_date=2024-05-25 02:36:02.661564+00:00, run_duration=1.748165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:34:00+00:00, data_interval_end=2024-05-25 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:36:02.672974631Z [2024-05-25T02:36:02.672+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:36:00+00:00, run_after=2024-05-25T02:38:00+00:00 2024-05-25T02:36:02.680486428Z [2024-05-25T02:36:02.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:36:02.680654543Z [2024-05-25T02:36:02.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:35:00+00:00, run_id=scheduled__2024-05-25T02:35:00+00:00, run_start_date=2024-05-25 02:36:00.915551+00:00, run_end_date=2024-05-25 02:36:02.680340+00:00, run_duration=1.764789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:35:00+00:00, data_interval_end=2024-05-25 02:36:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:36:02.690837302Z [2024-05-25T02:36:02.690+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:36:00+00:00, run_after=2024-05-25T02:37:00+00:00 2024-05-25T02:36:02.749349187Z [2024-05-25T02:36:02.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:34:00+00:00 exited with status success for try_number 1 2024-05-25T02:36:02.749416365Z [2024-05-25T02:36:02.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status success for try_number 1 2024-05-25T02:36:02.756972038Z [2024-05-25T02:36:02.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:34:00+00:00, map_index=-1, run_start_date=2024-05-25 02:36:01.878224+00:00, run_end_date=2024-05-25 02:36:02.398385+00:00, run_duration=0.520161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=960, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:36:01.008838+00:00, queued_by_job_id=1, pid=14124 2024-05-25T02:36:02.757123652Z [2024-05-25T02:36:02.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:35:00+00:00, map_index=-1, run_start_date=2024-05-25 02:36:01.996918+00:00, run_end_date=2024-05-25 02:36:02.531580+00:00, run_duration=0.534662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=961, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:36:01.008838+00:00, queued_by_job_id=1, pid=14125 2024-05-25T02:36:05.013623280Z [2024-05-25T02:36:05.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:36:05.014270390Z [2024-05-25T02:36:05.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:35:00+00:00, run_id=scheduled__2024-05-25T02:35:00+00:00, run_start_date=2024-05-25 02:36:00.917147+00:00, run_end_date=2024-05-25 02:36:05.013474+00:00, run_duration=4.096327, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:35:00+00:00, data_interval_end=2024-05-25 02:36:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:36:05.031684573Z [2024-05-25T02:36:05.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:36:00+00:00, run_after=2024-05-25T02:37:00+00:00 2024-05-25T02:36:05.046567134Z [2024-05-25T02:36:05.045+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:36:05.047003825Z [2024-05-25T02:36:05.046+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:35:00+00:00, run_id=scheduled__2024-05-25T02:35:00+00:00, run_start_date=2024-05-25 02:36:00.919011+00:00, run_end_date=2024-05-25 02:36:05.046345+00:00, run_duration=4.127334, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:35:00+00:00, data_interval_end=2024-05-25 02:36:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:36:05.068368082Z [2024-05-25T02:36:05.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:36:00+00:00, run_after=2024-05-25T02:37:00+00:00 2024-05-25T02:36:05.120475607Z [2024-05-25T02:36:05.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status success for try_number 1 2024-05-25T02:36:05.120556265Z [2024-05-25T02:36:05.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status success for try_number 1 2024-05-25T02:36:05.131325242Z [2024-05-25T02:36:05.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:35:00+00:00, map_index=-1, run_start_date=2024-05-25 02:36:03.349281+00:00, run_end_date=2024-05-25 02:36:04.658436+00:00, run_duration=1.309155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=963, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:36:01.008838+00:00, queued_by_job_id=1, pid=14149 2024-05-25T02:36:05.131863046Z [2024-05-25T02:36:05.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:35:00+00:00, map_index=-1, run_start_date=2024-05-25 02:36:03.061453+00:00, run_end_date=2024-05-25 02:36:04.687360+00:00, run_duration=1.625907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=962, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:36:01.008838+00:00, queued_by_job_id=1, pid=14143 2024-05-25T02:37:00.791807207Z [2024-05-25T02:37:00.791+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:37:00+00:00, run_after=2024-05-25T02:38:00+00:00 2024-05-25T02:37:00.805665060Z [2024-05-25T02:37:00.805+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:37:00+00:00, run_after=2024-05-25T02:38:00+00:00 2024-05-25T02:37:00.891298458Z [2024-05-25T02:37:00.890+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-25T02:37:00.891348200Z 2024-05-25T02:37:00.891358188Z 2024-05-25T02:37:00.891497325Z [2024-05-25T02:37:00.891+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:37:00.892074036Z [2024-05-25T02:37:00.891+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:37:00.893594042Z [2024-05-25T02:37:00.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:37:00.893617377Z 2024-05-25T02:37:00.893630549Z 2024-05-25T02:37:00.899820609Z [2024-05-25T02:37:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:37:00.900093711Z [2024-05-25T02:37:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:37:00.900802228Z [2024-05-25T02:37:00.900+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:37:00.901309007Z [2024-05-25T02:37:00.900+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:37:01.087427624Z [2024-05-25T02:37:01.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:36:00+00:00 exited with status queued for try_number 1 2024-05-25T02:37:01.088094464Z [2024-05-25T02:37:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:36:00+00:00 exited with status queued for try_number 1 2024-05-25T02:37:01.095186442Z [2024-05-25T02:37:01.094+0000] {scheduler_job.py:635} INFO - Setting external_id for to a49b41f9-14c4-4afc-82d1-8e91fbaf93a4 2024-05-25T02:37:01.095424274Z [2024-05-25T02:37:01.095+0000] {scheduler_job.py:635} INFO - Setting external_id for to a85983e9-8afe-4e10-9382-95bf445bff8f 2024-05-25T02:37:01.124624921Z [2024-05-25T02:37:01.124+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:37:01.198409139Z [2024-05-25T02:37:01.198+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:37:01.198431376Z 2024-05-25T02:37:01.198782951Z [2024-05-25T02:37:01.198+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:37:01.199437079Z [2024-05-25T02:37:01.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:37:01.199449179Z 2024-05-25T02:37:01.201646490Z [2024-05-25T02:37:01.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:37:01.201858697Z [2024-05-25T02:37:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:37:01.298401935Z [2024-05-25T02:37:01.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:36:00+00:00 exited with status queued for try_number 1 2024-05-25T02:37:01.304868365Z [2024-05-25T02:37:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1340fb2c-9b56-4083-851e-9376eba0c9f3 2024-05-25T02:37:02.529411648Z [2024-05-25T02:37:02.527+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:37:02.529881521Z [2024-05-25T02:37:02.529+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:36:00+00:00, run_id=scheduled__2024-05-25T02:36:00+00:00, run_start_date=2024-05-25 02:37:00.818726+00:00, run_end_date=2024-05-25 02:37:02.529465+00:00, run_duration=1.710739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:36:00+00:00, data_interval_end=2024-05-25 02:37:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:37:02.551352231Z [2024-05-25T02:37:02.550+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:37:00+00:00, run_after=2024-05-25T02:38:00+00:00 2024-05-25T02:37:02.650585088Z [2024-05-25T02:37:02.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:36:00+00:00 exited with status success for try_number 1 2024-05-25T02:37:02.658515469Z [2024-05-25T02:37:02.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:36:00+00:00, map_index=-1, run_start_date=2024-05-25 02:37:01.716234+00:00, run_end_date=2024-05-25 02:37:02.067291+00:00, run_duration=0.351057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=964, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:37:00.894915+00:00, queued_by_job_id=1, pid=14180 2024-05-25T02:37:04.883713268Z [2024-05-25T02:37:04.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:37:04.884251628Z [2024-05-25T02:37:04.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:36:00+00:00, run_id=scheduled__2024-05-25T02:36:00+00:00, run_start_date=2024-05-25 02:37:00.821157+00:00, run_end_date=2024-05-25 02:37:04.883324+00:00, run_duration=4.062167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:36:00+00:00, data_interval_end=2024-05-25 02:37:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:37:04.896261219Z [2024-05-25T02:37:04.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:37:00+00:00, run_after=2024-05-25T02:38:00+00:00 2024-05-25T02:37:04.952842184Z [2024-05-25T02:37:04.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:36:00+00:00 exited with status success for try_number 1 2024-05-25T02:37:04.960829588Z [2024-05-25T02:37:04.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:36:00+00:00, map_index=-1, run_start_date=2024-05-25 02:37:02.717319+00:00, run_end_date=2024-05-25 02:37:04.335840+00:00, run_duration=1.618521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=965, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:37:00.894915+00:00, queued_by_job_id=1, pid=14198 2024-05-25T02:37:06.041334997Z [2024-05-25T02:37:06.035+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:37:06.041362719Z [2024-05-25T02:37:06.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:36:00+00:00, run_id=scheduled__2024-05-25T02:36:00+00:00, run_start_date=2024-05-25 02:37:01.148659+00:00, run_end_date=2024-05-25 02:37:06.036022+00:00, run_duration=4.887363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:36:00+00:00, data_interval_end=2024-05-25 02:37:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:37:06.053371181Z [2024-05-25T02:37:06.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:37:00+00:00, run_after=2024-05-25T02:38:00+00:00 2024-05-25T02:37:06.098887695Z [2024-05-25T02:37:06.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:36:00+00:00 exited with status success for try_number 1 2024-05-25T02:37:06.106664097Z [2024-05-25T02:37:06.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:36:00+00:00, map_index=-1, run_start_date=2024-05-25 02:37:02.928123+00:00, run_end_date=2024-05-25 02:37:05.068870+00:00, run_duration=2.140747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=966, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:37:01.199794+00:00, queued_by_job_id=1, pid=14199 2024-05-25T02:38:00.807186859Z [2024-05-25T02:38:00.806+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:38:00.824906969Z [2024-05-25T02:38:00.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:38:00+00:00, run_after=2024-05-25T02:39:00+00:00 2024-05-25T02:38:00.853426331Z [2024-05-25T02:38:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:38:00+00:00, run_after=2024-05-25T02:39:00+00:00 2024-05-25T02:38:00.863446922Z [2024-05-25T02:38:00.863+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:38:00.948508347Z [2024-05-25T02:38:00.947+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:38:00.948553474Z 2024-05-25T02:38:00.948563041Z 2024-05-25T02:38:00.948570915Z 2024-05-25T02:38:00.948607608Z 2024-05-25T02:38:00.949339058Z [2024-05-25T02:38:00.948+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:38:00.949827237Z [2024-05-25T02:38:00.949+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:38:00.951076569Z [2024-05-25T02:38:00.950+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:38:00.951529697Z [2024-05-25T02:38:00.951+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:38:00.952981125Z [2024-05-25T02:38:00.952+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:38:00.953008111Z 2024-05-25T02:38:00.953016592Z 2024-05-25T02:38:00.953023980Z 2024-05-25T02:38:00.953031311Z 2024-05-25T02:38:00.958801488Z [2024-05-25T02:38:00.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:38:00.959202573Z [2024-05-25T02:38:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:38:00.959740108Z [2024-05-25T02:38:00.959+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:38:00.960030685Z [2024-05-25T02:38:00.959+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:38:00.960497309Z [2024-05-25T02:38:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:38:00.960791139Z [2024-05-25T02:38:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:38:00.961262429Z [2024-05-25T02:38:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:38:00.961578307Z [2024-05-25T02:38:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:38:01.366291931Z [2024-05-25T02:38:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:36:00+00:00 exited with status queued for try_number 1 2024-05-25T02:38:01.366326759Z [2024-05-25T02:38:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:37:00+00:00 exited with status queued for try_number 1 2024-05-25T02:38:01.366387230Z [2024-05-25T02:38:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:37:00+00:00 exited with status queued for try_number 1 2024-05-25T02:38:01.366449163Z [2024-05-25T02:38:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:37:00+00:00 exited with status queued for try_number 1 2024-05-25T02:38:01.396356452Z [2024-05-25T02:38:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 617aa222-80d5-4211-a6da-3e853360d3d7 2024-05-25T02:38:01.396379070Z [2024-05-25T02:38:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51b8b3e6-5efa-4240-afce-e4b31ec4e662 2024-05-25T02:38:01.396382670Z [2024-05-25T02:38:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22df08dd-ffb0-43f6-9488-edbcf0ce727f 2024-05-25T02:38:01.396386442Z [2024-05-25T02:38:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd4003c7-2531-4726-9b4e-928317563694 2024-05-25T02:38:02.687966103Z [2024-05-25T02:38:02.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:38:02.688487431Z [2024-05-25T02:38:02.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:36:00+00:00, run_id=scheduled__2024-05-25T02:36:00+00:00, run_start_date=2024-05-25 02:38:00.875559+00:00, run_end_date=2024-05-25 02:38:02.688127+00:00, run_duration=1.812568, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:36:00+00:00, data_interval_end=2024-05-25 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:38:02.695830366Z [2024-05-25T02:38:02.695+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:38:00+00:00, run_after=2024-05-25T02:40:00+00:00 2024-05-25T02:38:02.702504262Z [2024-05-25T02:38:02.702+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:38:02.702958497Z [2024-05-25T02:38:02.702+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:37:00+00:00, run_id=scheduled__2024-05-25T02:37:00+00:00, run_start_date=2024-05-25 02:38:00.877453+00:00, run_end_date=2024-05-25 02:38:02.702673+00:00, run_duration=1.82522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:37:00+00:00, data_interval_end=2024-05-25 02:38:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:38:02.712334408Z [2024-05-25T02:38:02.712+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:38:00+00:00, run_after=2024-05-25T02:39:00+00:00 2024-05-25T02:38:02.758880332Z [2024-05-25T02:38:02.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:36:00+00:00 exited with status success for try_number 1 2024-05-25T02:38:02.759158374Z [2024-05-25T02:38:02.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:37:00+00:00 exited with status success for try_number 1 2024-05-25T02:38:02.769311831Z [2024-05-25T02:38:02.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:37:00+00:00, map_index=-1, run_start_date=2024-05-25 02:38:02.001884+00:00, run_end_date=2024-05-25 02:38:02.488032+00:00, run_duration=0.486148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=968, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:38:00.954855+00:00, queued_by_job_id=1, pid=14233 2024-05-25T02:38:02.769814954Z [2024-05-25T02:38:02.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:36:00+00:00, map_index=-1, run_start_date=2024-05-25 02:38:01.743374+00:00, run_end_date=2024-05-25 02:38:02.127337+00:00, run_duration=0.383963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=967, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:38:00.954855+00:00, queued_by_job_id=1, pid=14230 2024-05-25T02:38:05.949747903Z [2024-05-25T02:38:05.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:38:05.950162980Z [2024-05-25T02:38:05.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:37:00+00:00, run_id=scheduled__2024-05-25T02:37:00+00:00, run_start_date=2024-05-25 02:38:00.878935+00:00, run_end_date=2024-05-25 02:38:05.949557+00:00, run_duration=5.070622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:37:00+00:00, data_interval_end=2024-05-25 02:38:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:38:05.962571004Z [2024-05-25T02:38:05.962+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:38:00+00:00, run_after=2024-05-25T02:39:00+00:00 2024-05-25T02:38:05.968876657Z [2024-05-25T02:38:05.968+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:38:05.969172773Z [2024-05-25T02:38:05.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:37:00+00:00, run_id=scheduled__2024-05-25T02:37:00+00:00, run_start_date=2024-05-25 02:38:00.880437+00:00, run_end_date=2024-05-25 02:38:05.968719+00:00, run_duration=5.088282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:37:00+00:00, data_interval_end=2024-05-25 02:38:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:38:05.977540862Z [2024-05-25T02:38:05.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:38:00+00:00, run_after=2024-05-25T02:39:00+00:00 2024-05-25T02:38:06.019077364Z [2024-05-25T02:38:06.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:37:00+00:00 exited with status success for try_number 1 2024-05-25T02:38:06.019107837Z [2024-05-25T02:38:06.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:37:00+00:00 exited with status success for try_number 1 2024-05-25T02:38:06.028718788Z [2024-05-25T02:38:06.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:37:00+00:00, map_index=-1, run_start_date=2024-05-25 02:38:03.128215+00:00, run_end_date=2024-05-25 02:38:04.803235+00:00, run_duration=1.67502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=969, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:38:00.954855+00:00, queued_by_job_id=1, pid=14256 2024-05-25T02:38:06.028921784Z [2024-05-25T02:38:06.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:37:00+00:00, map_index=-1, run_start_date=2024-05-25 02:38:03.307580+00:00, run_end_date=2024-05-25 02:38:05.640304+00:00, run_duration=2.332724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=970, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:38:00.954855+00:00, queued_by_job_id=1, pid=14257 2024-05-25T02:39:00.577757247Z [2024-05-25T02:39:00.577+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:39:00+00:00, run_after=2024-05-25T02:40:00+00:00 2024-05-25T02:39:00.596197153Z [2024-05-25T02:39:00.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:39:00+00:00, run_after=2024-05-25T02:40:00+00:00 2024-05-25T02:39:00.605146152Z [2024-05-25T02:39:00.604+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:39:00.690285971Z [2024-05-25T02:39:00.689+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:39:00.690343683Z 2024-05-25T02:39:00.690355179Z 2024-05-25T02:39:00.690365354Z 2024-05-25T02:39:00.690392336Z [2024-05-25T02:39:00.690+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:39:00.690665169Z [2024-05-25T02:39:00.690+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:39:00.690929207Z [2024-05-25T02:39:00.690+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:39:00.691799691Z [2024-05-25T02:39:00.691+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:39:00.691815330Z 2024-05-25T02:39:00.691840419Z 2024-05-25T02:39:00.691845450Z 2024-05-25T02:39:00.697788156Z [2024-05-25T02:39:00.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:39:00.698204374Z [2024-05-25T02:39:00.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:39:00.698814121Z [2024-05-25T02:39:00.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:39:00.699101796Z [2024-05-25T02:39:00.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:39:00.699475296Z [2024-05-25T02:39:00.699+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:39:00.699785795Z [2024-05-25T02:39:00.699+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:39:00.931896469Z [2024-05-25T02:39:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:38:00+00:00 exited with status queued for try_number 1 2024-05-25T02:39:00.932068955Z [2024-05-25T02:39:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:38:00+00:00 exited with status queued for try_number 1 2024-05-25T02:39:00.932210522Z [2024-05-25T02:39:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:38:00+00:00 exited with status queued for try_number 1 2024-05-25T02:39:00.938905507Z [2024-05-25T02:39:00.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba5fb056-478a-437c-8562-2bb8e6a82541 2024-05-25T02:39:00.939137029Z [2024-05-25T02:39:00.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83621832-52ea-418e-8c7f-0bba6f706c25 2024-05-25T02:39:00.939312074Z [2024-05-25T02:39:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5eafe5d5-a905-4c2e-ad09-1c96704d3088 2024-05-25T02:39:02.147561785Z [2024-05-25T02:39:02.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:39:02.148277921Z [2024-05-25T02:39:02.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:38:00+00:00, run_id=scheduled__2024-05-25T02:38:00+00:00, run_start_date=2024-05-25 02:39:00.619267+00:00, run_end_date=2024-05-25 02:39:02.147475+00:00, run_duration=1.528208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:38:00+00:00, data_interval_end=2024-05-25 02:39:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:39:02.164641549Z [2024-05-25T02:39:02.164+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:39:00+00:00, run_after=2024-05-25T02:40:00+00:00 2024-05-25T02:39:02.294269199Z [2024-05-25T02:39:02.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:38:00+00:00 exited with status success for try_number 1 2024-05-25T02:39:02.320089521Z [2024-05-25T02:39:02.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:38:00+00:00, map_index=-1, run_start_date=2024-05-25 02:39:01.564562+00:00, run_end_date=2024-05-25 02:39:01.944021+00:00, run_duration=0.379459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=971, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:39:00.692853+00:00, queued_by_job_id=1, pid=14289 2024-05-25T02:39:04.457937860Z [2024-05-25T02:39:04.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:39:04.458511133Z [2024-05-25T02:39:04.458+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:38:00+00:00, run_id=scheduled__2024-05-25T02:38:00+00:00, run_start_date=2024-05-25 02:39:00.620748+00:00, run_end_date=2024-05-25 02:39:04.457801+00:00, run_duration=3.837053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:38:00+00:00, data_interval_end=2024-05-25 02:39:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:39:04.479420388Z [2024-05-25T02:39:04.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:39:00+00:00, run_after=2024-05-25T02:40:00+00:00 2024-05-25T02:39:04.489467409Z [2024-05-25T02:39:04.488+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:39:04.489807653Z [2024-05-25T02:39:04.489+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:38:00+00:00, run_id=scheduled__2024-05-25T02:38:00+00:00, run_start_date=2024-05-25 02:39:00.622115+00:00, run_end_date=2024-05-25 02:39:04.489299+00:00, run_duration=3.867184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:38:00+00:00, data_interval_end=2024-05-25 02:39:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:39:04.500294598Z [2024-05-25T02:39:04.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:39:00+00:00, run_after=2024-05-25T02:40:00+00:00 2024-05-25T02:39:04.556858464Z [2024-05-25T02:39:04.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:38:00+00:00 exited with status success for try_number 1 2024-05-25T02:39:04.556882921Z [2024-05-25T02:39:04.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:38:00+00:00 exited with status success for try_number 1 2024-05-25T02:39:04.562566795Z [2024-05-25T02:39:04.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:38:00+00:00, map_index=-1, run_start_date=2024-05-25 02:39:02.535499+00:00, run_end_date=2024-05-25 02:39:03.750336+00:00, run_duration=1.214837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=973, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:39:00.692853+00:00, queued_by_job_id=1, pid=14308 2024-05-25T02:39:04.562591946Z [2024-05-25T02:39:04.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:38:00+00:00, map_index=-1, run_start_date=2024-05-25 02:39:02.413113+00:00, run_end_date=2024-05-25 02:39:03.950063+00:00, run_duration=1.53695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=972, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:39:00.692853+00:00, queued_by_job_id=1, pid=14307 2024-05-25T02:40:01.012414562Z [2024-05-25T02:40:01.011+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:40:00+00:00, run_after=2024-05-25T02:41:00+00:00 2024-05-25T02:40:01.027540032Z [2024-05-25T02:40:01.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:40:00+00:00, run_after=2024-05-25T02:41:00+00:00 2024-05-25T02:40:01.042221370Z [2024-05-25T02:40:01.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:40:00+00:00, run_after=2024-05-25T02:45:00+00:00 2024-05-25T02:40:01.050991889Z [2024-05-25T02:40:01.050+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:40:01.059174053Z [2024-05-25T02:40:01.058+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:40:01.180518099Z [2024-05-25T02:40:01.180+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T02:40:01.180545404Z 2024-05-25T02:40:01.180550062Z 2024-05-25T02:40:01.180554934Z 2024-05-25T02:40:01.180583757Z 2024-05-25T02:40:01.180588391Z 2024-05-25T02:40:01.180899826Z [2024-05-25T02:40:01.180+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:40:01.181196601Z [2024-05-25T02:40:01.180+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:40:01.181687332Z [2024-05-25T02:40:01.181+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:40:01.182041480Z [2024-05-25T02:40:01.181+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:40:01.182498756Z [2024-05-25T02:40:01.182+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:40:01.185720073Z [2024-05-25T02:40:01.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:40:01.185749879Z 2024-05-25T02:40:01.185753929Z 2024-05-25T02:40:01.185757830Z 2024-05-25T02:40:01.185760944Z 2024-05-25T02:40:01.185763964Z 2024-05-25T02:40:01.191067074Z [2024-05-25T02:40:01.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T02:40:01.191444149Z [2024-05-25T02:40:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:40:01.191797141Z [2024-05-25T02:40:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:40:01.192022153Z [2024-05-25T02:40:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:40:01.192365017Z [2024-05-25T02:40:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:40:01.192572815Z [2024-05-25T02:40:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:40:01.192951606Z [2024-05-25T02:40:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:40:01.193148840Z [2024-05-25T02:40:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:40:01.193524819Z [2024-05-25T02:40:01.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:40:01.193702762Z [2024-05-25T02:40:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:40:01.848319369Z [2024-05-25T02:40:01.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status queued for try_number 1 2024-05-25T02:40:01.848510074Z [2024-05-25T02:40:01.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:38:00+00:00 exited with status queued for try_number 1 2024-05-25T02:40:01.849650493Z [2024-05-25T02:40:01.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:39:00+00:00 exited with status queued for try_number 1 2024-05-25T02:40:01.849782055Z [2024-05-25T02:40:01.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:39:00+00:00 exited with status queued for try_number 1 2024-05-25T02:40:01.849898333Z [2024-05-25T02:40:01.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:39:00+00:00 exited with status queued for try_number 1 2024-05-25T02:40:01.863272483Z [2024-05-25T02:40:01.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to 003b3773-be6c-4415-b494-06de4efe5c19 2024-05-25T02:40:01.863401172Z [2024-05-25T02:40:01.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27c64032-1435-46fd-a7d1-cb8c7355465a 2024-05-25T02:40:01.863563370Z [2024-05-25T02:40:01.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3000422c-7bcd-44f0-9199-3ce7433fbb60 2024-05-25T02:40:01.863730139Z [2024-05-25T02:40:01.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0437ddec-f6a7-42ed-8081-6ce3c26c1aef 2024-05-25T02:40:01.863876293Z [2024-05-25T02:40:01.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to 767ca9bd-ac84-4e44-b2e6-2be427f4f9ba 2024-05-25T02:40:03.052671578Z [2024-05-25T02:40:03.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:40:03.052903464Z [2024-05-25T02:40:03.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:38:00+00:00, run_id=scheduled__2024-05-25T02:38:00+00:00, run_start_date=2024-05-25 02:40:01.074472+00:00, run_end_date=2024-05-25 02:40:03.052570+00:00, run_duration=1.978098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:38:00+00:00, data_interval_end=2024-05-25 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:40:03.061362514Z [2024-05-25T02:40:03.061+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:40:00+00:00, run_after=2024-05-25T02:42:00+00:00 2024-05-25T02:40:03.078383494Z [2024-05-25T02:40:03.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:40:03.078648929Z [2024-05-25T02:40:03.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:39:00+00:00, run_id=scheduled__2024-05-25T02:39:00+00:00, run_start_date=2024-05-25 02:40:01.075812+00:00, run_end_date=2024-05-25 02:40:03.078280+00:00, run_duration=2.002468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:39:00+00:00, data_interval_end=2024-05-25 02:40:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:40:03.090681962Z [2024-05-25T02:40:03.090+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:40:00+00:00, run_after=2024-05-25T02:41:00+00:00 2024-05-25T02:40:03.139024432Z [2024-05-25T02:40:03.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:38:00+00:00 exited with status success for try_number 1 2024-05-25T02:40:03.139065343Z [2024-05-25T02:40:03.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:39:00+00:00 exited with status success for try_number 1 2024-05-25T02:40:03.145708047Z [2024-05-25T02:40:03.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:38:00+00:00, map_index=-1, run_start_date=2024-05-25 02:40:02.073539+00:00, run_end_date=2024-05-25 02:40:02.609116+00:00, run_duration=0.535577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=974, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:40:01.186773+00:00, queued_by_job_id=1, pid=14337 2024-05-25T02:40:03.145813128Z [2024-05-25T02:40:03.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:39:00+00:00, map_index=-1, run_start_date=2024-05-25 02:40:02.507636+00:00, run_end_date=2024-05-25 02:40:02.875456+00:00, run_duration=0.36782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=975, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:40:01.186773+00:00, queued_by_job_id=1, pid=14343 2024-05-25T02:40:04.259945467Z [2024-05-25T02:40:04.259+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:40:04.259993240Z 2024-05-25T02:40:04.260229662Z [2024-05-25T02:40:04.259+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:40:04.261084262Z [2024-05-25T02:40:04.260+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:40:04.261123767Z 2024-05-25T02:40:04.264704807Z [2024-05-25T02:40:04.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T02:40:04.264906994Z [2024-05-25T02:40:04.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:40:04.331711984Z [2024-05-25T02:40:04.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status queued for try_number 1 2024-05-25T02:40:04.332906641Z [2024-05-25T02:40:04.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status success for try_number 1 2024-05-25T02:40:04.348333222Z [2024-05-25T02:40:04.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdca2304-9287-484c-b1e7-7489aef2deaf 2024-05-25T02:40:04.350283637Z [2024-05-25T02:40:04.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T02:35:00+00:00, map_index=-1, run_start_date=2024-05-25 02:40:03.485131+00:00, run_end_date=2024-05-25 02:40:03.908559+00:00, run_duration=0.423428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=976, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:40:01.186773+00:00, queued_by_job_id=1, pid=14372 2024-05-25T02:40:05.510592166Z [2024-05-25T02:40:05.510+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:40:05.510999721Z [2024-05-25T02:40:05.510+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:39:00+00:00, run_id=scheduled__2024-05-25T02:39:00+00:00, run_start_date=2024-05-25 02:40:01.077134+00:00, run_end_date=2024-05-25 02:40:05.510664+00:00, run_duration=4.43353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:39:00+00:00, data_interval_end=2024-05-25 02:40:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:40:05.522917782Z [2024-05-25T02:40:05.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:40:00+00:00, run_after=2024-05-25T02:41:00+00:00 2024-05-25T02:40:05.530729352Z [2024-05-25T02:40:05.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:40:05.531323330Z [2024-05-25T02:40:05.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:39:00+00:00, run_id=scheduled__2024-05-25T02:39:00+00:00, run_start_date=2024-05-25 02:40:01.078578+00:00, run_end_date=2024-05-25 02:40:05.530573+00:00, run_duration=4.451995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:39:00+00:00, data_interval_end=2024-05-25 02:40:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:40:05.547838546Z [2024-05-25T02:40:05.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:40:00+00:00, run_after=2024-05-25T02:41:00+00:00 2024-05-25T02:40:05.615353396Z [2024-05-25T02:40:05.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:39:00+00:00 exited with status success for try_number 1 2024-05-25T02:40:05.615905614Z [2024-05-25T02:40:05.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:39:00+00:00 exited with status success for try_number 1 2024-05-25T02:40:05.626635656Z [2024-05-25T02:40:05.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:39:00+00:00, map_index=-1, run_start_date=2024-05-25 02:40:03.552497+00:00, run_end_date=2024-05-25 02:40:04.895026+00:00, run_duration=1.342529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=978, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:40:01.186773+00:00, queued_by_job_id=1, pid=14374 2024-05-25T02:40:05.627183540Z [2024-05-25T02:40:05.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:39:00+00:00, map_index=-1, run_start_date=2024-05-25 02:40:03.534389+00:00, run_end_date=2024-05-25 02:40:05.170247+00:00, run_duration=1.635858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=977, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:40:01.186773+00:00, queued_by_job_id=1, pid=14373 2024-05-25T02:40:06.719874847Z [2024-05-25T02:40:06.719+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:40:06.719913934Z 2024-05-25T02:40:06.720541809Z [2024-05-25T02:40:06.720+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:40:06.722155993Z [2024-05-25T02:40:06.721+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:40:06.722175113Z 2024-05-25T02:40:06.725540807Z [2024-05-25T02:40:06.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T02:40:06.725843333Z [2024-05-25T02:40:06.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:40:06.774141194Z [2024-05-25T02:40:06.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status queued for try_number 1 2024-05-25T02:40:06.774209792Z [2024-05-25T02:40:06.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status success for try_number 1 2024-05-25T02:40:06.783284942Z [2024-05-25T02:40:06.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b196632-8895-4331-a5d2-6390fd046c11 2024-05-25T02:40:06.783488278Z [2024-05-25T02:40:06.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T02:35:00+00:00, map_index=-1, run_start_date=2024-05-25 02:40:05.993627+00:00, run_end_date=2024-05-25 02:40:06.376946+00:00, run_duration=0.383319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=979, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:40:04.261541+00:00, queued_by_job_id=1, pid=14397 2024-05-25T02:40:10.086849367Z [2024-05-25T02:40:10.085+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:40:10.086891358Z 2024-05-25T02:40:10.087222667Z [2024-05-25T02:40:10.086+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:40:10.088707142Z [2024-05-25T02:40:10.088+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:40:10.088730654Z 2024-05-25T02:40:10.092635793Z [2024-05-25T02:40:10.092+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:40:10.093019437Z [2024-05-25T02:40:10.092+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:40:10.160188055Z [2024-05-25T02:40:10.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status queued for try_number 1 2024-05-25T02:40:10.160434241Z [2024-05-25T02:40:10.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status success for try_number 1 2024-05-25T02:40:10.167969604Z [2024-05-25T02:40:10.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07cd20e1-9be0-4e80-8bdc-cfcb69f0a3cb 2024-05-25T02:40:10.168500625Z [2024-05-25T02:40:10.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T02:35:00+00:00, map_index=0, run_start_date=2024-05-25 02:40:08.375132+00:00, run_end_date=2024-05-25 02:40:09.648475+00:00, run_duration=1.273343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=980, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:40:06.722818+00:00, queued_by_job_id=1, pid=14418 2024-05-25T02:40:12.029459826Z [2024-05-25T02:40:12.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:40:12.029918952Z [2024-05-25T02:40:12.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:35:00+00:00, run_id=scheduled__2024-05-25T02:35:00+00:00, run_start_date=2024-05-25 02:40:01.072915+00:00, run_end_date=2024-05-25 02:40:12.029180+00:00, run_duration=10.956265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:35:00+00:00, data_interval_end=2024-05-25 02:40:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T02:40:12.038686493Z [2024-05-25T02:40:12.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:40:00+00:00, run_after=2024-05-25T02:45:00+00:00 2024-05-25T02:40:13.166110349Z [2024-05-25T02:40:13.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:35:00+00:00 exited with status success for try_number 1 2024-05-25T02:40:13.172988649Z [2024-05-25T02:40:13.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T02:35:00+00:00, map_index=-1, run_start_date=2024-05-25 02:40:11.646813+00:00, run_end_date=2024-05-25 02:40:12.009606+00:00, run_duration=0.362793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=981, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:40:10.089542+00:00, queued_by_job_id=1, pid=14431 2024-05-25T02:40:30.318677207Z [2024-05-25T02:40:30.318+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T02:41:00.429238779Z [2024-05-25T02:41:00.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:41:00+00:00, run_after=2024-05-25T02:42:00+00:00 2024-05-25T02:41:00.436477859Z [2024-05-25T02:41:00.436+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:41:00.448796404Z [2024-05-25T02:41:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:41:00+00:00, run_after=2024-05-25T02:42:00+00:00 2024-05-25T02:41:00.506909268Z [2024-05-25T02:41:00.506+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:41:00.506942848Z 2024-05-25T02:41:00.506948658Z 2024-05-25T02:41:00.506953866Z 2024-05-25T02:41:00.507186340Z [2024-05-25T02:41:00.506+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:41:00.507371587Z [2024-05-25T02:41:00.507+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:41:00.507630630Z [2024-05-25T02:41:00.507+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:41:00.508535759Z [2024-05-25T02:41:00.508+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:41:00.508550959Z 2024-05-25T02:41:00.508556703Z 2024-05-25T02:41:00.508561514Z 2024-05-25T02:41:00.511502106Z [2024-05-25T02:41:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:41:00.511779052Z [2024-05-25T02:41:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:41:00.512127872Z [2024-05-25T02:41:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:41:00.512446303Z [2024-05-25T02:41:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:41:00.512758612Z [2024-05-25T02:41:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:41:00.512987137Z [2024-05-25T02:41:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:41:00.706110476Z [2024-05-25T02:41:00.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status queued for try_number 1 2024-05-25T02:41:00.706352598Z [2024-05-25T02:41:00.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status queued for try_number 1 2024-05-25T02:41:00.706517519Z [2024-05-25T02:41:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status queued for try_number 1 2024-05-25T02:41:00.715511269Z [2024-05-25T02:41:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 359a6d2c-c6b6-4c40-817a-b4299f383c47 2024-05-25T02:41:00.715905485Z [2024-05-25T02:41:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to a93c7f89-2633-43f0-8135-ac15b0f8ad00 2024-05-25T02:41:00.716272502Z [2024-05-25T02:41:00.716+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40583891-ab18-466c-802e-51f4fc9cfaab 2024-05-25T02:41:01.852894996Z [2024-05-25T02:41:01.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:41:01.853420883Z [2024-05-25T02:41:01.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:40:00+00:00, run_id=scheduled__2024-05-25T02:40:00+00:00, run_start_date=2024-05-25 02:41:00.458852+00:00, run_end_date=2024-05-25 02:41:01.852797+00:00, run_duration=1.393945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:40:00+00:00, data_interval_end=2024-05-25 02:41:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:41:01.862074305Z [2024-05-25T02:41:01.861+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:41:00+00:00, run_after=2024-05-25T02:42:00+00:00 2024-05-25T02:41:01.916441357Z [2024-05-25T02:41:01.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status success for try_number 1 2024-05-25T02:41:01.922011392Z [2024-05-25T02:41:01.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:40:00+00:00, map_index=-1, run_start_date=2024-05-25 02:41:01.256101+00:00, run_end_date=2024-05-25 02:41:01.663111+00:00, run_duration=0.40701, state=success, executor_state=success, try_number=1, max_tries=1, job_id=982, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:41:00.509271+00:00, queued_by_job_id=1, pid=14440 2024-05-25T02:41:03.994768874Z [2024-05-25T02:41:03.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:41:03.995225526Z [2024-05-25T02:41:03.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:40:00+00:00, run_id=scheduled__2024-05-25T02:40:00+00:00, run_start_date=2024-05-25 02:41:00.460080+00:00, run_end_date=2024-05-25 02:41:03.994519+00:00, run_duration=3.534439, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:40:00+00:00, data_interval_end=2024-05-25 02:41:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:41:04.008657088Z [2024-05-25T02:41:04.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:41:00+00:00, run_after=2024-05-25T02:42:00+00:00 2024-05-25T02:41:04.023073881Z [2024-05-25T02:41:04.018+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:41:04.023146755Z [2024-05-25T02:41:04.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:40:00+00:00, run_id=scheduled__2024-05-25T02:40:00+00:00, run_start_date=2024-05-25 02:41:00.461225+00:00, run_end_date=2024-05-25 02:41:04.018639+00:00, run_duration=3.557414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:40:00+00:00, data_interval_end=2024-05-25 02:41:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:41:04.031538563Z [2024-05-25T02:41:04.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:41:00+00:00, run_after=2024-05-25T02:42:00+00:00 2024-05-25T02:41:04.070152757Z [2024-05-25T02:41:04.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status success for try_number 1 2024-05-25T02:41:04.070363088Z [2024-05-25T02:41:04.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status success for try_number 1 2024-05-25T02:41:04.076197946Z [2024-05-25T02:41:04.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:40:00+00:00, map_index=-1, run_start_date=2024-05-25 02:41:02.147313+00:00, run_end_date=2024-05-25 02:41:03.762134+00:00, run_duration=1.614821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=983, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:41:00.509271+00:00, queued_by_job_id=1, pid=14458 2024-05-25T02:41:04.076562073Z [2024-05-25T02:41:04.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:40:00+00:00, map_index=-1, run_start_date=2024-05-25 02:41:02.365110+00:00, run_end_date=2024-05-25 02:41:03.633259+00:00, run_duration=1.268149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=984, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:41:00.509271+00:00, queued_by_job_id=1, pid=14459 2024-05-25T02:42:00.841963616Z [2024-05-25T02:42:00.841+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:42:00.863613659Z [2024-05-25T02:42:00.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:42:00+00:00, run_after=2024-05-25T02:43:00+00:00 2024-05-25T02:42:00.873731542Z [2024-05-25T02:42:00.873+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:42:00.888268086Z [2024-05-25T02:42:00.887+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:42:00+00:00, run_after=2024-05-25T02:43:00+00:00 2024-05-25T02:42:00.975914707Z [2024-05-25T02:42:00.975+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:42:00.975943049Z 2024-05-25T02:42:00.975948145Z 2024-05-25T02:42:00.975952142Z 2024-05-25T02:42:00.975984463Z 2024-05-25T02:42:00.976124409Z [2024-05-25T02:42:00.975+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:42:00.976207385Z [2024-05-25T02:42:00.975+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:42:00.976259415Z [2024-05-25T02:42:00.975+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:42:00.976271217Z [2024-05-25T02:42:00.976+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:42:00.976848570Z [2024-05-25T02:42:00.976+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:42:00.976868971Z 2024-05-25T02:42:00.976878064Z 2024-05-25T02:42:00.976891774Z 2024-05-25T02:42:00.976900197Z 2024-05-25T02:42:00.980314728Z [2024-05-25T02:42:00.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:42:00.980487836Z [2024-05-25T02:42:00.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:42:00.980843979Z [2024-05-25T02:42:00.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:42:00.980958730Z [2024-05-25T02:42:00.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:42:00.981286607Z [2024-05-25T02:42:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:42:00.981422667Z [2024-05-25T02:42:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:42:00.981812023Z [2024-05-25T02:42:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:42:00.981972075Z [2024-05-25T02:42:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:42:01.465766709Z [2024-05-25T02:42:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status queued for try_number 1 2024-05-25T02:42:01.466082491Z [2024-05-25T02:42:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:41:00+00:00 exited with status queued for try_number 1 2024-05-25T02:42:01.466397403Z [2024-05-25T02:42:01.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:41:00+00:00 exited with status queued for try_number 1 2024-05-25T02:42:01.467654127Z [2024-05-25T02:42:01.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:41:00+00:00 exited with status queued for try_number 1 2024-05-25T02:42:01.482591584Z [2024-05-25T02:42:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11cf07e0-8a62-415a-8bef-a48ac1139c4b 2024-05-25T02:42:01.483004926Z [2024-05-25T02:42:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 363d5061-07e3-45f8-8d20-fd955a480274 2024-05-25T02:42:01.483403098Z [2024-05-25T02:42:01.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5effa40b-8bf9-48cf-b857-e183a1bd5a5c 2024-05-25T02:42:01.483797230Z [2024-05-25T02:42:01.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e05b1fc-a520-45b9-ae96-ce66c66023dc 2024-05-25T02:42:02.653154256Z [2024-05-25T02:42:02.652+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:42:02.653455767Z [2024-05-25T02:42:02.653+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:40:00+00:00, run_id=scheduled__2024-05-25T02:40:00+00:00, run_start_date=2024-05-25 02:42:00.901397+00:00, run_end_date=2024-05-25 02:42:02.653088+00:00, run_duration=1.751691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:40:00+00:00, data_interval_end=2024-05-25 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:42:02.661067283Z [2024-05-25T02:42:02.660+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:42:00+00:00, run_after=2024-05-25T02:44:00+00:00 2024-05-25T02:42:02.668940401Z [2024-05-25T02:42:02.668+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:42:02.669185848Z [2024-05-25T02:42:02.668+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:41:00+00:00, run_id=scheduled__2024-05-25T02:41:00+00:00, run_start_date=2024-05-25 02:42:00.902889+00:00, run_end_date=2024-05-25 02:42:02.668881+00:00, run_duration=1.765992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:41:00+00:00, data_interval_end=2024-05-25 02:42:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:42:02.679571331Z [2024-05-25T02:42:02.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:42:00+00:00, run_after=2024-05-25T02:43:00+00:00 2024-05-25T02:42:02.742170285Z [2024-05-25T02:42:02.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status success for try_number 1 2024-05-25T02:42:02.742788798Z [2024-05-25T02:42:02.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:41:00+00:00 exited with status success for try_number 1 2024-05-25T02:42:02.758235908Z [2024-05-25T02:42:02.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:41:00+00:00, map_index=-1, run_start_date=2024-05-25 02:42:01.913942+00:00, run_end_date=2024-05-25 02:42:02.321034+00:00, run_duration=0.407092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=986, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:42:00.977598+00:00, queued_by_job_id=1, pid=14493 2024-05-25T02:42:02.759295564Z [2024-05-25T02:42:02.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:40:00+00:00, map_index=-1, run_start_date=2024-05-25 02:42:01.798337+00:00, run_end_date=2024-05-25 02:42:02.123605+00:00, run_duration=0.325268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=985, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:42:00.977598+00:00, queued_by_job_id=1, pid=14492 2024-05-25T02:42:04.989920224Z [2024-05-25T02:42:04.989+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:42:04.990038583Z [2024-05-25T02:42:04.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:41:00+00:00, run_id=scheduled__2024-05-25T02:41:00+00:00, run_start_date=2024-05-25 02:42:00.904112+00:00, run_end_date=2024-05-25 02:42:04.989529+00:00, run_duration=4.085417, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:41:00+00:00, data_interval_end=2024-05-25 02:42:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:42:04.998619247Z [2024-05-25T02:42:04.998+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:42:00+00:00, run_after=2024-05-25T02:43:00+00:00 2024-05-25T02:42:05.005050123Z [2024-05-25T02:42:05.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:42:05.005340216Z [2024-05-25T02:42:05.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:41:00+00:00, run_id=scheduled__2024-05-25T02:41:00+00:00, run_start_date=2024-05-25 02:42:00.905270+00:00, run_end_date=2024-05-25 02:42:05.004879+00:00, run_duration=4.099609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:41:00+00:00, data_interval_end=2024-05-25 02:42:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:42:05.014030591Z [2024-05-25T02:42:05.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:42:00+00:00, run_after=2024-05-25T02:43:00+00:00 2024-05-25T02:42:05.060455275Z [2024-05-25T02:42:05.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:41:00+00:00 exited with status success for try_number 1 2024-05-25T02:42:05.061032187Z [2024-05-25T02:42:05.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:41:00+00:00 exited with status success for try_number 1 2024-05-25T02:42:05.071669551Z [2024-05-25T02:42:05.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:41:00+00:00, map_index=-1, run_start_date=2024-05-25 02:42:03.179439+00:00, run_end_date=2024-05-25 02:42:04.822674+00:00, run_duration=1.643235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=988, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:42:00.977598+00:00, queued_by_job_id=1, pid=14517 2024-05-25T02:42:05.071958721Z [2024-05-25T02:42:05.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:41:00+00:00, map_index=-1, run_start_date=2024-05-25 02:42:02.930705+00:00, run_end_date=2024-05-25 02:42:04.404814+00:00, run_duration=1.474109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=987, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:42:00.977598+00:00, queued_by_job_id=1, pid=14513 2024-05-25T02:43:00.224469486Z [2024-05-25T02:43:00.223+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:43:00+00:00, run_after=2024-05-25T02:44:00+00:00 2024-05-25T02:43:00.254891091Z [2024-05-25T02:43:00.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:43:00+00:00, run_after=2024-05-25T02:44:00+00:00 2024-05-25T02:43:00.266897766Z [2024-05-25T02:43:00.266+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:43:00.363011841Z [2024-05-25T02:43:00.362+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:43:00.363078744Z 2024-05-25T02:43:00.363086053Z 2024-05-25T02:43:00.363092093Z 2024-05-25T02:43:00.363506715Z [2024-05-25T02:43:00.362+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:43:00.363988071Z [2024-05-25T02:43:00.363+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:43:00.364424063Z [2024-05-25T02:43:00.364+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:43:00.365918327Z [2024-05-25T02:43:00.365+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:43:00.365947397Z 2024-05-25T02:43:00.365954374Z 2024-05-25T02:43:00.365960206Z 2024-05-25T02:43:00.372816984Z [2024-05-25T02:43:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:43:00.373321042Z [2024-05-25T02:43:00.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:43:00.373868120Z [2024-05-25T02:43:00.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:43:00.374239528Z [2024-05-25T02:43:00.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:43:00.374801263Z [2024-05-25T02:43:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:43:00.375126414Z [2024-05-25T02:43:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:43:00.668282532Z [2024-05-25T02:43:00.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:42:00+00:00 exited with status queued for try_number 1 2024-05-25T02:43:00.668313210Z [2024-05-25T02:43:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:42:00+00:00 exited with status queued for try_number 1 2024-05-25T02:43:00.668462211Z [2024-05-25T02:43:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:42:00+00:00 exited with status queued for try_number 1 2024-05-25T02:43:00.680204635Z [2024-05-25T02:43:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0dc8554e-8965-4b6b-a74f-9e83ac4aa09b 2024-05-25T02:43:00.680473035Z [2024-05-25T02:43:00.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to a72897e8-0ba2-42b6-bc94-8371fe1e6c39 2024-05-25T02:43:00.680739855Z [2024-05-25T02:43:00.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8679a9c-1a1f-40ad-a932-147191a0cba5 2024-05-25T02:43:01.844193918Z [2024-05-25T02:43:01.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:43:01.844501483Z [2024-05-25T02:43:01.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:42:00+00:00, run_id=scheduled__2024-05-25T02:42:00+00:00, run_start_date=2024-05-25 02:43:00.281027+00:00, run_end_date=2024-05-25 02:43:01.844062+00:00, run_duration=1.563035, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:42:00+00:00, data_interval_end=2024-05-25 02:43:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:43:01.857361857Z [2024-05-25T02:43:01.856+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:43:00+00:00, run_after=2024-05-25T02:44:00+00:00 2024-05-25T02:43:01.923869496Z [2024-05-25T02:43:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:42:00+00:00 exited with status success for try_number 1 2024-05-25T02:43:01.929975294Z [2024-05-25T02:43:01.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:42:00+00:00, map_index=-1, run_start_date=2024-05-25 02:43:01.138072+00:00, run_end_date=2024-05-25 02:43:01.528086+00:00, run_duration=0.390014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=989, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:43:00.367432+00:00, queued_by_job_id=1, pid=14549 2024-05-25T02:43:04.097625509Z [2024-05-25T02:43:04.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:43:04.097997701Z [2024-05-25T02:43:04.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:42:00+00:00, run_id=scheduled__2024-05-25T02:42:00+00:00, run_start_date=2024-05-25 02:43:00.284639+00:00, run_end_date=2024-05-25 02:43:04.097584+00:00, run_duration=3.812945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:42:00+00:00, data_interval_end=2024-05-25 02:43:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:43:04.124255297Z [2024-05-25T02:43:04.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:43:00+00:00, run_after=2024-05-25T02:44:00+00:00 2024-05-25T02:43:04.200336537Z [2024-05-25T02:43:04.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:42:00+00:00 exited with status success for try_number 1 2024-05-25T02:43:04.210575366Z [2024-05-25T02:43:04.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:42:00+00:00, map_index=-1, run_start_date=2024-05-25 02:43:02.183823+00:00, run_end_date=2024-05-25 02:43:03.959717+00:00, run_duration=1.775894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=990, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:43:00.367432+00:00, queued_by_job_id=1, pid=14562 2024-05-25T02:43:04.898128761Z [2024-05-25T02:43:04.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:43:04.898602294Z [2024-05-25T02:43:04.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:42:00+00:00, run_id=scheduled__2024-05-25T02:42:00+00:00, run_start_date=2024-05-25 02:43:00.282794+00:00, run_end_date=2024-05-25 02:43:04.897952+00:00, run_duration=4.615158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:42:00+00:00, data_interval_end=2024-05-25 02:43:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:43:04.910165243Z [2024-05-25T02:43:04.909+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:43:00+00:00, run_after=2024-05-25T02:44:00+00:00 2024-05-25T02:43:04.973279598Z [2024-05-25T02:43:04.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:42:00+00:00 exited with status success for try_number 1 2024-05-25T02:43:04.980251080Z [2024-05-25T02:43:04.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:42:00+00:00, map_index=-1, run_start_date=2024-05-25 02:43:02.497455+00:00, run_end_date=2024-05-25 02:43:04.352993+00:00, run_duration=1.855538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=991, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:43:00.367432+00:00, queued_by_job_id=1, pid=14573 2024-05-25T02:44:00.837098529Z [2024-05-25T02:44:00.836+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:44:00.862040056Z [2024-05-25T02:44:00.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:44:00+00:00, run_after=2024-05-25T02:45:00+00:00 2024-05-25T02:44:00.870839208Z [2024-05-25T02:44:00.870+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:44:00.883151680Z [2024-05-25T02:44:00.882+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:44:00+00:00, run_after=2024-05-25T02:45:00+00:00 2024-05-25T02:44:00.973913018Z [2024-05-25T02:44:00.973+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:44:00.973943787Z 2024-05-25T02:44:00.973954502Z 2024-05-25T02:44:00.973959163Z 2024-05-25T02:44:00.973963501Z 2024-05-25T02:44:00.974105744Z [2024-05-25T02:44:00.973+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:44:00.974411948Z [2024-05-25T02:44:00.974+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:44:00.974630974Z [2024-05-25T02:44:00.974+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:44:00.974882087Z [2024-05-25T02:44:00.974+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:44:00.975823488Z [2024-05-25T02:44:00.975+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:44:00.975835760Z 2024-05-25T02:44:00.975868607Z 2024-05-25T02:44:00.975873216Z 2024-05-25T02:44:00.975877806Z 2024-05-25T02:44:00.980880928Z [2024-05-25T02:44:00.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:44:00.981046128Z [2024-05-25T02:44:00.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:44:00.981378573Z [2024-05-25T02:44:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:44:00.981540512Z [2024-05-25T02:44:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:44:00.981813719Z [2024-05-25T02:44:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:44:00.981936904Z [2024-05-25T02:44:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:44:00.982228221Z [2024-05-25T02:44:00.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:44:00.982375656Z [2024-05-25T02:44:00.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:44:01.299938580Z [2024-05-25T02:44:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:42:00+00:00 exited with status queued for try_number 1 2024-05-25T02:44:01.300004460Z [2024-05-25T02:44:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:43:00+00:00 exited with status queued for try_number 1 2024-05-25T02:44:01.300751107Z [2024-05-25T02:44:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:43:00+00:00 exited with status queued for try_number 1 2024-05-25T02:44:01.300885999Z [2024-05-25T02:44:01.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:43:00+00:00 exited with status queued for try_number 1 2024-05-25T02:44:01.314520600Z [2024-05-25T02:44:01.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98e8b682-4291-4dbf-9d4a-df2429bd750c 2024-05-25T02:44:01.314875877Z [2024-05-25T02:44:01.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21973d4c-4a76-497d-8ebf-e1fb74accfe1 2024-05-25T02:44:01.315140611Z [2024-05-25T02:44:01.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to 458118ee-05f8-4032-a983-ac7787256af4 2024-05-25T02:44:01.315452814Z [2024-05-25T02:44:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to 542ac28b-78ca-4d6d-9af3-0970a5ac8f8c 2024-05-25T02:44:02.628839415Z [2024-05-25T02:44:02.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:44:02.629347518Z [2024-05-25T02:44:02.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:42:00+00:00, run_id=scheduled__2024-05-25T02:42:00+00:00, run_start_date=2024-05-25 02:44:00.892855+00:00, run_end_date=2024-05-25 02:44:02.628710+00:00, run_duration=1.735855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:42:00+00:00, data_interval_end=2024-05-25 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:44:02.638617823Z [2024-05-25T02:44:02.638+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:44:00+00:00, run_after=2024-05-25T02:46:00+00:00 2024-05-25T02:44:02.644903565Z [2024-05-25T02:44:02.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:44:02.645134966Z [2024-05-25T02:44:02.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:43:00+00:00, run_id=scheduled__2024-05-25T02:43:00+00:00, run_start_date=2024-05-25 02:44:00.893997+00:00, run_end_date=2024-05-25 02:44:02.644771+00:00, run_duration=1.750774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:43:00+00:00, data_interval_end=2024-05-25 02:44:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:44:02.655632552Z [2024-05-25T02:44:02.655+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:44:00+00:00, run_after=2024-05-25T02:45:00+00:00 2024-05-25T02:44:02.713549363Z [2024-05-25T02:44:02.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:42:00+00:00 exited with status success for try_number 1 2024-05-25T02:44:02.713837696Z [2024-05-25T02:44:02.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:43:00+00:00 exited with status success for try_number 1 2024-05-25T02:44:02.729421105Z [2024-05-25T02:44:02.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:43:00+00:00, map_index=-1, run_start_date=2024-05-25 02:44:01.858860+00:00, run_end_date=2024-05-25 02:44:02.286503+00:00, run_duration=0.427643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=993, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:44:00.977250+00:00, queued_by_job_id=1, pid=14602 2024-05-25T02:44:02.729751571Z [2024-05-25T02:44:02.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:42:00+00:00, map_index=-1, run_start_date=2024-05-25 02:44:01.847570+00:00, run_end_date=2024-05-25 02:44:02.229822+00:00, run_duration=0.382252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=992, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:44:00.977250+00:00, queued_by_job_id=1, pid=14601 2024-05-25T02:44:04.904780547Z [2024-05-25T02:44:04.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:44:04.905136556Z [2024-05-25T02:44:04.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:43:00+00:00, run_id=scheduled__2024-05-25T02:43:00+00:00, run_start_date=2024-05-25 02:44:00.894900+00:00, run_end_date=2024-05-25 02:44:04.904602+00:00, run_duration=4.009702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:43:00+00:00, data_interval_end=2024-05-25 02:44:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:44:04.920028425Z [2024-05-25T02:44:04.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:44:00+00:00, run_after=2024-05-25T02:45:00+00:00 2024-05-25T02:44:04.980166730Z [2024-05-25T02:44:04.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:43:00+00:00 exited with status success for try_number 1 2024-05-25T02:44:04.989245577Z [2024-05-25T02:44:04.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:43:00+00:00, map_index=-1, run_start_date=2024-05-25 02:44:03.128951+00:00, run_end_date=2024-05-25 02:44:04.527109+00:00, run_duration=1.398158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=995, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:44:00.977250+00:00, queued_by_job_id=1, pid=14626 2024-05-25T02:44:06.046381782Z [2024-05-25T02:44:06.045+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:44:06.046490213Z [2024-05-25T02:44:06.046+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:43:00+00:00, run_id=scheduled__2024-05-25T02:43:00+00:00, run_start_date=2024-05-25 02:44:00.895836+00:00, run_end_date=2024-05-25 02:44:06.046150+00:00, run_duration=5.150314, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:43:00+00:00, data_interval_end=2024-05-25 02:44:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:44:06.058541712Z [2024-05-25T02:44:06.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:44:00+00:00, run_after=2024-05-25T02:45:00+00:00 2024-05-25T02:44:06.090448344Z [2024-05-25T02:44:06.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:43:00+00:00 exited with status success for try_number 1 2024-05-25T02:44:06.096802263Z [2024-05-25T02:44:06.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:43:00+00:00, map_index=-1, run_start_date=2024-05-25 02:44:03.037964+00:00, run_end_date=2024-05-25 02:44:05.302611+00:00, run_duration=2.264647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=994, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:44:00.977250+00:00, queued_by_job_id=1, pid=14625 2024-05-25T02:45:00.343931319Z [2024-05-25T02:45:00.343+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:45:00+00:00, run_after=2024-05-25T02:46:00+00:00 2024-05-25T02:45:00.350557473Z [2024-05-25T02:45:00.350+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:45:00.362189412Z [2024-05-25T02:45:00.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:45:00+00:00, run_after=2024-05-25T02:50:00+00:00 2024-05-25T02:45:00.374776263Z [2024-05-25T02:45:00.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:45:00+00:00, run_after=2024-05-25T02:46:00+00:00 2024-05-25T02:45:00.484834701Z [2024-05-25T02:45:00.484+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:45:00.484865621Z 2024-05-25T02:45:00.484876944Z 2024-05-25T02:45:00.484881884Z 2024-05-25T02:45:00.484886803Z 2024-05-25T02:45:00.485292475Z [2024-05-25T02:45:00.484+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:45:00.485642756Z [2024-05-25T02:45:00.485+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:45:00.485923503Z [2024-05-25T02:45:00.485+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:45:00.486206842Z [2024-05-25T02:45:00.486+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:45:00.487159297Z [2024-05-25T02:45:00.486+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:45:00.487223357Z 2024-05-25T02:45:00.487231124Z 2024-05-25T02:45:00.487236969Z 2024-05-25T02:45:00.487242633Z 2024-05-25T02:45:00.492551176Z [2024-05-25T02:45:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T02:45:00.492929002Z [2024-05-25T02:45:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:45:00.493416237Z [2024-05-25T02:45:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:45:00.493711447Z [2024-05-25T02:45:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:45:00.494040138Z [2024-05-25T02:45:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:45:00.494382249Z [2024-05-25T02:45:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:45:00.494750616Z [2024-05-25T02:45:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:45:00.495011465Z [2024-05-25T02:45:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:45:00.830924733Z [2024-05-25T02:45:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status queued for try_number 1 2024-05-25T02:45:00.830979415Z [2024-05-25T02:45:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:44:00+00:00 exited with status queued for try_number 1 2024-05-25T02:45:00.831055630Z [2024-05-25T02:45:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:44:00+00:00 exited with status queued for try_number 1 2024-05-25T02:45:00.831119264Z [2024-05-25T02:45:00.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:44:00+00:00 exited with status queued for try_number 1 2024-05-25T02:45:00.854561921Z [2024-05-25T02:45:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to 739130e7-d72a-4277-996d-03036f6b1531 2024-05-25T02:45:00.854626278Z [2024-05-25T02:45:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to feb62643-45bd-4e7f-9a36-674de92b2734 2024-05-25T02:45:00.854725855Z [2024-05-25T02:45:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2dd05a4-01dc-4957-8d29-918533ea1511 2024-05-25T02:45:00.854820532Z [2024-05-25T02:45:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf622cb1-9135-4274-bc08-a360795b1e3f 2024-05-25T02:45:01.965072274Z [2024-05-25T02:45:01.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:45:01.966497658Z [2024-05-25T02:45:01.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:44:00+00:00, run_id=scheduled__2024-05-25T02:44:00+00:00, run_start_date=2024-05-25 02:45:00.403712+00:00, run_end_date=2024-05-25 02:45:01.966029+00:00, run_duration=1.562317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:44:00+00:00, data_interval_end=2024-05-25 02:45:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:45:01.980337069Z [2024-05-25T02:45:01.979+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:45:00+00:00, run_after=2024-05-25T02:46:00+00:00 2024-05-25T02:45:02.040331410Z [2024-05-25T02:45:02.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:44:00+00:00 exited with status success for try_number 1 2024-05-25T02:45:02.045607671Z [2024-05-25T02:45:02.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:44:00+00:00, map_index=-1, run_start_date=2024-05-25 02:45:01.449548+00:00, run_end_date=2024-05-25 02:45:01.832614+00:00, run_duration=0.383066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=996, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:45:00.488553+00:00, queued_by_job_id=1, pid=14659 2024-05-25T02:45:03.500109941Z [2024-05-25T02:45:03.499+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:45:03.500141985Z 2024-05-25T02:45:03.500417879Z [2024-05-25T02:45:03.500+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:45:03.501542104Z [2024-05-25T02:45:03.501+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:45:03.501607581Z 2024-05-25T02:45:03.505288591Z [2024-05-25T02:45:03.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T02:45:03.505340798Z [2024-05-25T02:45:03.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:45:03.573339337Z [2024-05-25T02:45:03.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status queued for try_number 1 2024-05-25T02:45:03.573670567Z [2024-05-25T02:45:03.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status success for try_number 1 2024-05-25T02:45:03.584162158Z [2024-05-25T02:45:03.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c8f7bea-a008-4323-be42-650342f3aed1 2024-05-25T02:45:03.584926101Z [2024-05-25T02:45:03.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T02:40:00+00:00, map_index=-1, run_start_date=2024-05-25 02:45:02.664798+00:00, run_end_date=2024-05-25 02:45:03.060235+00:00, run_duration=0.395437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=999, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:45:00.488553+00:00, queued_by_job_id=1, pid=14685 2024-05-25T02:45:04.747732587Z [2024-05-25T02:45:04.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:45:04.748515664Z [2024-05-25T02:45:04.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:44:00+00:00, run_id=scheduled__2024-05-25T02:44:00+00:00, run_start_date=2024-05-25 02:45:00.404951+00:00, run_end_date=2024-05-25 02:45:04.747626+00:00, run_duration=4.342675, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:44:00+00:00, data_interval_end=2024-05-25 02:45:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:45:04.772361812Z [2024-05-25T02:45:04.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:45:00+00:00, run_after=2024-05-25T02:46:00+00:00 2024-05-25T02:45:04.789560350Z [2024-05-25T02:45:04.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:45:04.789809049Z [2024-05-25T02:45:04.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:44:00+00:00, run_id=scheduled__2024-05-25T02:44:00+00:00, run_start_date=2024-05-25 02:45:00.406501+00:00, run_end_date=2024-05-25 02:45:04.789530+00:00, run_duration=4.383029, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:44:00+00:00, data_interval_end=2024-05-25 02:45:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:45:04.803655927Z [2024-05-25T02:45:04.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:45:00+00:00, run_after=2024-05-25T02:46:00+00:00 2024-05-25T02:45:04.870608815Z [2024-05-25T02:45:04.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:44:00+00:00 exited with status success for try_number 1 2024-05-25T02:45:04.870665648Z [2024-05-25T02:45:04.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:44:00+00:00 exited with status success for try_number 1 2024-05-25T02:45:04.877060130Z [2024-05-25T02:45:04.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:44:00+00:00, map_index=-1, run_start_date=2024-05-25 02:45:02.568369+00:00, run_end_date=2024-05-25 02:45:03.937644+00:00, run_duration=1.369275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=997, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:45:00.488553+00:00, queued_by_job_id=1, pid=14683 2024-05-25T02:45:04.877178035Z [2024-05-25T02:45:04.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:44:00+00:00, map_index=-1, run_start_date=2024-05-25 02:45:02.607841+00:00, run_end_date=2024-05-25 02:45:04.211905+00:00, run_duration=1.604064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=998, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:45:00.488553+00:00, queued_by_job_id=1, pid=14684 2024-05-25T02:45:07.011580877Z [2024-05-25T02:45:07.011+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:45:07.011623251Z 2024-05-25T02:45:07.012175529Z [2024-05-25T02:45:07.011+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:45:07.012489397Z [2024-05-25T02:45:07.012+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:45:07.012503836Z 2024-05-25T02:45:07.015398782Z [2024-05-25T02:45:07.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T02:45:07.015663397Z [2024-05-25T02:45:07.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:45:07.076376650Z [2024-05-25T02:45:07.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status queued for try_number 1 2024-05-25T02:45:07.076760365Z [2024-05-25T02:45:07.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status success for try_number 1 2024-05-25T02:45:07.086123312Z [2024-05-25T02:45:07.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc0efbf3-93fb-4ec0-9643-6586a08f44a9 2024-05-25T02:45:07.086547081Z [2024-05-25T02:45:07.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T02:40:00+00:00, map_index=-1, run_start_date=2024-05-25 02:45:05.376959+00:00, run_end_date=2024-05-25 02:45:05.758330+00:00, run_duration=0.381371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1000, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:45:03.502023+00:00, queued_by_job_id=1, pid=14708 2024-05-25T02:45:10.428722999Z [2024-05-25T02:45:10.427+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:45:10.428751950Z 2024-05-25T02:45:10.428800735Z [2024-05-25T02:45:10.428+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:45:10.430114390Z [2024-05-25T02:45:10.429+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:45:10.430150974Z 2024-05-25T02:45:10.435239617Z [2024-05-25T02:45:10.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:45:10.435303521Z [2024-05-25T02:45:10.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:45:10.512102871Z [2024-05-25T02:45:10.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status queued for try_number 1 2024-05-25T02:45:10.512129514Z [2024-05-25T02:45:10.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status success for try_number 1 2024-05-25T02:45:10.518894290Z [2024-05-25T02:45:10.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9207305-d1ac-41c0-970f-7754e6ed4047 2024-05-25T02:45:10.519077757Z [2024-05-25T02:45:10.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T02:40:00+00:00, map_index=0, run_start_date=2024-05-25 02:45:08.634970+00:00, run_end_date=2024-05-25 02:45:09.977931+00:00, run_duration=1.342961, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1001, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:45:07.012905+00:00, queued_by_job_id=1, pid=14729 2024-05-25T02:45:12.529995239Z [2024-05-25T02:45:12.529+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:45:12.530437157Z [2024-05-25T02:45:12.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:40:00+00:00, run_id=scheduled__2024-05-25T02:40:00+00:00, run_start_date=2024-05-25 02:45:00.401925+00:00, run_end_date=2024-05-25 02:45:12.529951+00:00, run_duration=12.128026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:40:00+00:00, data_interval_end=2024-05-25 02:45:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T02:45:12.538197301Z [2024-05-25T02:45:12.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:45:00+00:00, run_after=2024-05-25T02:50:00+00:00 2024-05-25T02:45:12.576233067Z [2024-05-25T02:45:12.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:40:00+00:00 exited with status success for try_number 1 2024-05-25T02:45:12.582181275Z [2024-05-25T02:45:12.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T02:40:00+00:00, map_index=-1, run_start_date=2024-05-25 02:45:11.972509+00:00, run_end_date=2024-05-25 02:45:12.383878+00:00, run_duration=0.411369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1002, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:45:10.431097+00:00, queued_by_job_id=1, pid=14742 2024-05-25T02:45:30.393043183Z [2024-05-25T02:45:30.392+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T02:46:00.334783703Z [2024-05-25T02:46:00.334+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:46:00+00:00, run_after=2024-05-25T02:47:00+00:00 2024-05-25T02:46:00.353259477Z [2024-05-25T02:46:00.352+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:46:00.371007022Z [2024-05-25T02:46:00.370+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:46:00.405497182Z [2024-05-25T02:46:00.404+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:46:00+00:00, run_after=2024-05-25T02:47:00+00:00 2024-05-25T02:46:00.510150404Z [2024-05-25T02:46:00.509+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:46:00.510203484Z 2024-05-25T02:46:00.510207686Z 2024-05-25T02:46:00.510210720Z 2024-05-25T02:46:00.510213740Z 2024-05-25T02:46:00.510225421Z [2024-05-25T02:46:00.510+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:46:00.510329626Z [2024-05-25T02:46:00.510+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:46:00.510578354Z [2024-05-25T02:46:00.510+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:46:00.510698844Z [2024-05-25T02:46:00.510+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:46:00.511354519Z [2024-05-25T02:46:00.511+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:46:00.511360882Z 2024-05-25T02:46:00.511364148Z 2024-05-25T02:46:00.511367379Z 2024-05-25T02:46:00.511370630Z 2024-05-25T02:46:00.516643495Z [2024-05-25T02:46:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:46:00.516736143Z [2024-05-25T02:46:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:46:00.517009672Z [2024-05-25T02:46:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:46:00.517101920Z [2024-05-25T02:46:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:46:00.517334998Z [2024-05-25T02:46:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:46:00.517418363Z [2024-05-25T02:46:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:46:00.517572174Z [2024-05-25T02:46:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:46:00.517654196Z [2024-05-25T02:46:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:46:00.946284822Z [2024-05-25T02:46:00.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:44:00+00:00 exited with status queued for try_number 1 2024-05-25T02:46:00.946344127Z [2024-05-25T02:46:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status queued for try_number 1 2024-05-25T02:46:00.946383540Z [2024-05-25T02:46:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status queued for try_number 1 2024-05-25T02:46:00.946412837Z [2024-05-25T02:46:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status queued for try_number 1 2024-05-25T02:46:00.976000958Z [2024-05-25T02:46:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9269f5b9-a9b2-4e97-8c27-af3dc33a84ec 2024-05-25T02:46:00.976068632Z [2024-05-25T02:46:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 912fa330-ac43-4ec3-acc3-c09c0b038da9 2024-05-25T02:46:00.976153239Z [2024-05-25T02:46:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to be0e4b40-2f1f-4e83-bbae-0755661a4aa6 2024-05-25T02:46:00.976257200Z [2024-05-25T02:46:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to c341aff7-249c-4df2-8962-80db77cc3531 2024-05-25T02:46:02.273913862Z [2024-05-25T02:46:02.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:46:02.274280216Z [2024-05-25T02:46:02.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:44:00+00:00, run_id=scheduled__2024-05-25T02:44:00+00:00, run_start_date=2024-05-25 02:46:00.422686+00:00, run_end_date=2024-05-25 02:46:02.273870+00:00, run_duration=1.851184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:44:00+00:00, data_interval_end=2024-05-25 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:46:02.295264835Z [2024-05-25T02:46:02.294+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:46:00+00:00, run_after=2024-05-25T02:48:00+00:00 2024-05-25T02:46:03.283852000Z [2024-05-25T02:46:03.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:46:03.284180909Z [2024-05-25T02:46:03.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:45:00+00:00, run_id=scheduled__2024-05-25T02:45:00+00:00, run_start_date=2024-05-25 02:46:00.424465+00:00, run_end_date=2024-05-25 02:46:03.283736+00:00, run_duration=2.859271, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:45:00+00:00, data_interval_end=2024-05-25 02:46:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:46:03.293256235Z [2024-05-25T02:46:03.292+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:46:00+00:00, run_after=2024-05-25T02:47:00+00:00 2024-05-25T02:46:03.345821509Z [2024-05-25T02:46:03.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:44:00+00:00 exited with status success for try_number 1 2024-05-25T02:46:03.345845157Z [2024-05-25T02:46:03.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status success for try_number 1 2024-05-25T02:46:03.354742215Z [2024-05-25T02:46:03.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:45:00+00:00, map_index=-1, run_start_date=2024-05-25 02:46:01.808587+00:00, run_end_date=2024-05-25 02:46:02.495215+00:00, run_duration=0.686628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1004, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:46:00.512356+00:00, queued_by_job_id=1, pid=14753 2024-05-25T02:46:03.354878924Z [2024-05-25T02:46:03.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:44:00+00:00, map_index=-1, run_start_date=2024-05-25 02:46:01.515446+00:00, run_end_date=2024-05-25 02:46:02.206593+00:00, run_duration=0.691147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1003, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:46:00.512356+00:00, queued_by_job_id=1, pid=14752 2024-05-25T02:46:05.542815208Z [2024-05-25T02:46:05.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:46:05.543102024Z [2024-05-25T02:46:05.542+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:45:00+00:00, run_id=scheduled__2024-05-25T02:45:00+00:00, run_start_date=2024-05-25 02:46:00.426121+00:00, run_end_date=2024-05-25 02:46:05.542585+00:00, run_duration=5.116464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:45:00+00:00, data_interval_end=2024-05-25 02:46:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:46:05.554341228Z [2024-05-25T02:46:05.553+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:46:00+00:00, run_after=2024-05-25T02:47:00+00:00 2024-05-25T02:46:05.561269031Z [2024-05-25T02:46:05.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:46:05.561585336Z [2024-05-25T02:46:05.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:45:00+00:00, run_id=scheduled__2024-05-25T02:45:00+00:00, run_start_date=2024-05-25 02:46:00.427497+00:00, run_end_date=2024-05-25 02:46:05.561203+00:00, run_duration=5.133706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:45:00+00:00, data_interval_end=2024-05-25 02:46:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:46:05.571657560Z [2024-05-25T02:46:05.571+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:46:00+00:00, run_after=2024-05-25T02:47:00+00:00 2024-05-25T02:46:05.612667387Z [2024-05-25T02:46:05.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status success for try_number 1 2024-05-25T02:46:05.612899763Z [2024-05-25T02:46:05.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status success for try_number 1 2024-05-25T02:46:05.623292172Z [2024-05-25T02:46:05.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:45:00+00:00, map_index=-1, run_start_date=2024-05-25 02:46:02.912919+00:00, run_end_date=2024-05-25 02:46:04.858005+00:00, run_duration=1.945086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1005, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:46:00.512356+00:00, queued_by_job_id=1, pid=14771 2024-05-25T02:46:05.623446801Z [2024-05-25T02:46:05.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:45:00+00:00, map_index=-1, run_start_date=2024-05-25 02:46:03.373533+00:00, run_end_date=2024-05-25 02:46:04.847350+00:00, run_duration=1.473817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1006, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:46:00.512356+00:00, queued_by_job_id=1, pid=14782 2024-05-25T02:46:57.178354145Z [2024-05-25T02:46:57.177+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:46:57.178384350Z 2024-05-25T02:46:57.178401834Z [2024-05-25T02:46:57.178+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-05-25T02:46:57.178827914Z [2024-05-25T02:46:57.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:46:57.178833554Z 2024-05-25T02:46:57.181744559Z [2024-05-25T02:46:57.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240525024655_004455', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:46:57.181811467Z [2024-05-25T02:46:57.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240525024655_004455', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-25T02:46:57.239687097Z [2024-05-25T02:46:57.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240525024655_004455 exited with status queued for try_number 1 2024-05-25T02:46:57.256949791Z [2024-05-25T02:46:57.256+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f17a5d3-12b2-4f32-8e52-437b5ea4da3c 2024-05-25T02:46:59.072335418Z [2024-05-25T02:46:59.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:46:59.072941694Z [2024-05-25T02:46:59.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-05-25 02:46:56.261355+00:00, run_id=scaleout_vdu_20240525024655_004455, run_start_date=2024-05-25 02:46:57.150010+00:00, run_end_date=2024-05-25 02:46:59.072035+00:00, run_duration=1.922025, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-25 02:46:56.261355+00:00, data_interval_end=2024-05-25 02:46:56.261355+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-05-25T02:46:59.081683672Z [2024-05-25T02:46:59.079+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-05-25T02:46:59.133350780Z [2024-05-25T02:46:59.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240525024655_004455 exited with status success for try_number 1 2024-05-25T02:46:59.143813257Z [2024-05-25T02:46:59.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240525024655_004455, map_index=-1, run_start_date=2024-05-25 02:46:58.097692+00:00, run_end_date=2024-05-25 02:46:58.518292+00:00, run_duration=0.4206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1007, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:46:57.179067+00:00, queued_by_job_id=1, pid=14801 2024-05-25T02:47:00.210002769Z [2024-05-25T02:47:00.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:47:00+00:00, run_after=2024-05-25T02:48:00+00:00 2024-05-25T02:47:00.229589752Z [2024-05-25T02:47:00.229+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:47:00+00:00, run_after=2024-05-25T02:48:00+00:00 2024-05-25T02:47:00.240821718Z [2024-05-25T02:47:00.240+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:47:00.343267428Z [2024-05-25T02:47:00.342+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:47:00.343299709Z 2024-05-25T02:47:00.343306162Z 2024-05-25T02:47:00.343312178Z 2024-05-25T02:47:00.343605260Z [2024-05-25T02:47:00.343+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:47:00.343876350Z [2024-05-25T02:47:00.343+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:47:00.344178430Z [2024-05-25T02:47:00.343+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:47:00.345149976Z [2024-05-25T02:47:00.344+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:47:00.345188587Z 2024-05-25T02:47:00.345194857Z 2024-05-25T02:47:00.345203889Z 2024-05-25T02:47:00.349810387Z [2024-05-25T02:47:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:47:00.349890944Z [2024-05-25T02:47:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:47:00.350241576Z [2024-05-25T02:47:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:47:00.350385904Z [2024-05-25T02:47:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:47:00.350751303Z [2024-05-25T02:47:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:47:00.351003800Z [2024-05-25T02:47:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:47:00.623623835Z [2024-05-25T02:47:00.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:46:00+00:00 exited with status queued for try_number 1 2024-05-25T02:47:00.625988192Z [2024-05-25T02:47:00.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:46:00+00:00 exited with status queued for try_number 1 2024-05-25T02:47:00.626261022Z [2024-05-25T02:47:00.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:46:00+00:00 exited with status queued for try_number 1 2024-05-25T02:47:00.634067208Z [2024-05-25T02:47:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bb92754-7ef8-49f7-9990-89dfa908a87c 2024-05-25T02:47:00.634231407Z [2024-05-25T02:47:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to a69155e1-b8d5-4925-9f81-5866dbe86ecc 2024-05-25T02:47:00.634397165Z [2024-05-25T02:47:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e000dde-4e96-4d1b-b267-a4ee56b2deeb 2024-05-25T02:47:01.766571117Z [2024-05-25T02:47:01.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:47:01.767158317Z [2024-05-25T02:47:01.766+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:46:00+00:00, run_id=scheduled__2024-05-25T02:46:00+00:00, run_start_date=2024-05-25 02:47:00.253629+00:00, run_end_date=2024-05-25 02:47:01.766801+00:00, run_duration=1.513172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:46:00+00:00, data_interval_end=2024-05-25 02:47:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:47:01.775606668Z [2024-05-25T02:47:01.775+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:47:00+00:00, run_after=2024-05-25T02:48:00+00:00 2024-05-25T02:47:01.823656371Z [2024-05-25T02:47:01.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:46:00+00:00 exited with status success for try_number 1 2024-05-25T02:47:01.837642544Z [2024-05-25T02:47:01.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:46:00+00:00, map_index=-1, run_start_date=2024-05-25 02:47:01.158253+00:00, run_end_date=2024-05-25 02:47:01.555833+00:00, run_duration=0.39758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1008, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:47:00.346708+00:00, queued_by_job_id=1, pid=14816 2024-05-25T02:47:03.938696387Z [2024-05-25T02:47:03.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:47:03.946084307Z [2024-05-25T02:47:03.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:46:00+00:00, run_id=scheduled__2024-05-25T02:46:00+00:00, run_start_date=2024-05-25 02:47:00.255125+00:00, run_end_date=2024-05-25 02:47:03.938638+00:00, run_duration=3.683513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:46:00+00:00, data_interval_end=2024-05-25 02:47:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:47:03.957678058Z [2024-05-25T02:47:03.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:47:00+00:00, run_after=2024-05-25T02:48:00+00:00 2024-05-25T02:47:03.979542440Z [2024-05-25T02:47:03.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:47:03.979985957Z [2024-05-25T02:47:03.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:46:00+00:00, run_id=scheduled__2024-05-25T02:46:00+00:00, run_start_date=2024-05-25 02:47:00.256491+00:00, run_end_date=2024-05-25 02:47:03.979408+00:00, run_duration=3.722917, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:46:00+00:00, data_interval_end=2024-05-25 02:47:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:47:04.005893006Z [2024-05-25T02:47:04.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:47:00+00:00, run_after=2024-05-25T02:48:00+00:00 2024-05-25T02:47:04.047598727Z [2024-05-25T02:47:04.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:46:00+00:00 exited with status success for try_number 1 2024-05-25T02:47:04.056327258Z [2024-05-25T02:47:04.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:46:00+00:00, map_index=-1, run_start_date=2024-05-25 02:47:02.081750+00:00, run_end_date=2024-05-25 02:47:03.421647+00:00, run_duration=1.339897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1009, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:47:00.346708+00:00, queued_by_job_id=1, pid=14834 2024-05-25T02:47:04.255626324Z [2024-05-25T02:47:04.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:46:00+00:00 exited with status success for try_number 1 2024-05-25T02:47:04.265532926Z [2024-05-25T02:47:04.265+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:46:00+00:00, map_index=-1, run_start_date=2024-05-25 02:47:02.228061+00:00, run_end_date=2024-05-25 02:47:03.850362+00:00, run_duration=1.622301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1010, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:47:00.346708+00:00, queued_by_job_id=1, pid=14835 2024-05-25T02:48:00.123290659Z [2024-05-25T02:48:00.122+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:48:00.132191357Z [2024-05-25T02:48:00.131+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:48:00.148276135Z [2024-05-25T02:48:00.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:48:00+00:00, run_after=2024-05-25T02:49:00+00:00 2024-05-25T02:48:00.160767981Z [2024-05-25T02:48:00.160+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:48:00+00:00, run_after=2024-05-25T02:49:00+00:00 2024-05-25T02:48:00.276863747Z [2024-05-25T02:48:00.276+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:48:00.276893468Z 2024-05-25T02:48:00.276923539Z 2024-05-25T02:48:00.276929006Z 2024-05-25T02:48:00.276933561Z 2024-05-25T02:48:00.277102046Z [2024-05-25T02:48:00.276+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:48:00.277534315Z [2024-05-25T02:48:00.277+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:48:00.277827812Z [2024-05-25T02:48:00.277+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:48:00.278119445Z [2024-05-25T02:48:00.277+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:48:00.279479115Z [2024-05-25T02:48:00.278+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:48:00.279496387Z 2024-05-25T02:48:00.279502643Z 2024-05-25T02:48:00.279521045Z 2024-05-25T02:48:00.279528031Z 2024-05-25T02:48:00.286396216Z [2024-05-25T02:48:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:48:00.286654610Z [2024-05-25T02:48:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:48:00.287114518Z [2024-05-25T02:48:00.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:48:00.287318370Z [2024-05-25T02:48:00.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:48:00.287988143Z [2024-05-25T02:48:00.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:48:00.288383523Z [2024-05-25T02:48:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:48:00.288857925Z [2024-05-25T02:48:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:48:00.289056908Z [2024-05-25T02:48:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:48:00.547462410Z [2024-05-25T02:48:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:46:00+00:00 exited with status queued for try_number 1 2024-05-25T02:48:00.547540203Z [2024-05-25T02:48:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:47:00+00:00 exited with status queued for try_number 1 2024-05-25T02:48:00.547661351Z [2024-05-25T02:48:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:47:00+00:00 exited with status queued for try_number 1 2024-05-25T02:48:00.547826621Z [2024-05-25T02:48:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:47:00+00:00 exited with status queued for try_number 1 2024-05-25T02:48:00.557582630Z [2024-05-25T02:48:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd942f91-ed55-425e-bbff-17e9c26e5224 2024-05-25T02:48:00.557948754Z [2024-05-25T02:48:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0eed2d5c-6d0d-4b65-a9c3-b39c53c0bd32 2024-05-25T02:48:00.558179243Z [2024-05-25T02:48:00.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0469628-db60-4146-9185-4af4c7371dcd 2024-05-25T02:48:00.558416478Z [2024-05-25T02:48:00.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21db0ed4-b2e5-41d1-a299-18a5780a5d74 2024-05-25T02:48:01.807132609Z [2024-05-25T02:48:01.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:48:01.807976509Z [2024-05-25T02:48:01.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:46:00+00:00, run_id=scheduled__2024-05-25T02:46:00+00:00, run_start_date=2024-05-25 02:48:00.173878+00:00, run_end_date=2024-05-25 02:48:01.807057+00:00, run_duration=1.633179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:46:00+00:00, data_interval_end=2024-05-25 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:48:01.815757934Z [2024-05-25T02:48:01.815+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:48:00+00:00, run_after=2024-05-25T02:50:00+00:00 2024-05-25T02:48:01.822428717Z [2024-05-25T02:48:01.822+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:48:01.822905964Z [2024-05-25T02:48:01.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:47:00+00:00, run_id=scheduled__2024-05-25T02:47:00+00:00, run_start_date=2024-05-25 02:48:00.176702+00:00, run_end_date=2024-05-25 02:48:01.822327+00:00, run_duration=1.645625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:47:00+00:00, data_interval_end=2024-05-25 02:48:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:48:01.832836628Z [2024-05-25T02:48:01.832+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:48:00+00:00, run_after=2024-05-25T02:49:00+00:00 2024-05-25T02:48:01.879492592Z [2024-05-25T02:48:01.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:46:00+00:00 exited with status success for try_number 1 2024-05-25T02:48:01.879911825Z [2024-05-25T02:48:01.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:47:00+00:00 exited with status success for try_number 1 2024-05-25T02:48:01.887584875Z [2024-05-25T02:48:01.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:46:00+00:00, map_index=-1, run_start_date=2024-05-25 02:48:01.043233+00:00, run_end_date=2024-05-25 02:48:01.467981+00:00, run_duration=0.424748, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1011, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:48:00.281360+00:00, queued_by_job_id=1, pid=14868 2024-05-25T02:48:01.888610679Z [2024-05-25T02:48:01.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:47:00+00:00, map_index=-1, run_start_date=2024-05-25 02:48:01.164299+00:00, run_end_date=2024-05-25 02:48:01.657762+00:00, run_duration=0.493463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1012, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:48:00.281360+00:00, queued_by_job_id=1, pid=14869 2024-05-25T02:48:04.410099937Z [2024-05-25T02:48:04.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:48:04.410130029Z [2024-05-25T02:48:04.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:47:00+00:00, run_id=scheduled__2024-05-25T02:47:00+00:00, run_start_date=2024-05-25 02:48:00.180228+00:00, run_end_date=2024-05-25 02:48:04.409579+00:00, run_duration=4.229351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:47:00+00:00, data_interval_end=2024-05-25 02:48:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:48:04.419145389Z [2024-05-25T02:48:04.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:48:00+00:00, run_after=2024-05-25T02:49:00+00:00 2024-05-25T02:48:04.426148150Z [2024-05-25T02:48:04.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:48:04.426592241Z [2024-05-25T02:48:04.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:47:00+00:00, run_id=scheduled__2024-05-25T02:47:00+00:00, run_start_date=2024-05-25 02:48:00.183244+00:00, run_end_date=2024-05-25 02:48:04.426036+00:00, run_duration=4.242792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:47:00+00:00, data_interval_end=2024-05-25 02:48:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:48:04.436967238Z [2024-05-25T02:48:04.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:48:00+00:00, run_after=2024-05-25T02:49:00+00:00 2024-05-25T02:48:04.473476863Z [2024-05-25T02:48:04.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:47:00+00:00 exited with status success for try_number 1 2024-05-25T02:48:04.473873185Z [2024-05-25T02:48:04.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:47:00+00:00 exited with status success for try_number 1 2024-05-25T02:48:04.486130049Z [2024-05-25T02:48:04.485+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:47:00+00:00, map_index=-1, run_start_date=2024-05-25 02:48:02.340847+00:00, run_end_date=2024-05-25 02:48:04.053618+00:00, run_duration=1.712771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1013, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:48:00.281360+00:00, queued_by_job_id=1, pid=14892 2024-05-25T02:48:04.486816400Z [2024-05-25T02:48:04.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:47:00+00:00, map_index=-1, run_start_date=2024-05-25 02:48:02.518724+00:00, run_end_date=2024-05-25 02:48:03.784277+00:00, run_duration=1.265553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1014, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:48:00.281360+00:00, queued_by_job_id=1, pid=14893 2024-05-25T02:49:00.773660268Z [2024-05-25T02:49:00.773+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:49:00+00:00, run_after=2024-05-25T02:50:00+00:00 2024-05-25T02:49:00.791314378Z [2024-05-25T02:49:00.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:49:00+00:00, run_after=2024-05-25T02:50:00+00:00 2024-05-25T02:49:00.801576946Z [2024-05-25T02:49:00.801+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:49:00.886748889Z [2024-05-25T02:49:00.886+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:49:00.886774359Z 2024-05-25T02:49:00.886793599Z 2024-05-25T02:49:00.886796647Z 2024-05-25T02:49:00.886951023Z [2024-05-25T02:49:00.886+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:49:00.887173093Z [2024-05-25T02:49:00.887+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:49:00.887330437Z [2024-05-25T02:49:00.887+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:49:00.888018437Z [2024-05-25T02:49:00.887+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:49:00.888033794Z 2024-05-25T02:49:00.888038832Z 2024-05-25T02:49:00.888043351Z 2024-05-25T02:49:00.891138143Z [2024-05-25T02:49:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:49:00.891422068Z [2024-05-25T02:49:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:49:00.891972265Z [2024-05-25T02:49:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:49:00.892035246Z [2024-05-25T02:49:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:49:00.892379044Z [2024-05-25T02:49:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:49:00.892720112Z [2024-05-25T02:49:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:49:01.139285976Z [2024-05-25T02:49:01.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:48:00+00:00 exited with status queued for try_number 1 2024-05-25T02:49:01.139833916Z [2024-05-25T02:49:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:48:00+00:00 exited with status queued for try_number 1 2024-05-25T02:49:01.140037517Z [2024-05-25T02:49:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:48:00+00:00 exited with status queued for try_number 1 2024-05-25T02:49:01.148964907Z [2024-05-25T02:49:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d4d8cba-e4c6-41c6-891f-587b2bf98ef3 2024-05-25T02:49:01.149224298Z [2024-05-25T02:49:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to 152fb430-f311-4db6-8d90-3a8a6e12ad68 2024-05-25T02:49:01.149475354Z [2024-05-25T02:49:01.149+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78e2f005-1827-4445-9575-11453f396452 2024-05-25T02:49:02.706920009Z [2024-05-25T02:49:02.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:49:02.707599427Z [2024-05-25T02:49:02.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:48:00+00:00, run_id=scheduled__2024-05-25T02:48:00+00:00, run_start_date=2024-05-25 02:49:00.815786+00:00, run_end_date=2024-05-25 02:49:02.706823+00:00, run_duration=1.891037, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:48:00+00:00, data_interval_end=2024-05-25 02:49:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:49:02.718012267Z [2024-05-25T02:49:02.717+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:49:00+00:00, run_after=2024-05-25T02:50:00+00:00 2024-05-25T02:49:02.817094512Z [2024-05-25T02:49:02.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:48:00+00:00 exited with status success for try_number 1 2024-05-25T02:49:02.829108835Z [2024-05-25T02:49:02.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:48:00+00:00, map_index=-1, run_start_date=2024-05-25 02:49:01.805160+00:00, run_end_date=2024-05-25 02:49:02.291106+00:00, run_duration=0.485946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1015, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:49:00.888781+00:00, queued_by_job_id=1, pid=14926 2024-05-25T02:49:04.854324834Z [2024-05-25T02:49:04.853+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:49:04.854634147Z [2024-05-25T02:49:04.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:48:00+00:00, run_id=scheduled__2024-05-25T02:48:00+00:00, run_start_date=2024-05-25 02:49:00.819378+00:00, run_end_date=2024-05-25 02:49:04.854223+00:00, run_duration=4.034845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:48:00+00:00, data_interval_end=2024-05-25 02:49:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:49:04.865965634Z [2024-05-25T02:49:04.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:49:00+00:00, run_after=2024-05-25T02:50:00+00:00 2024-05-25T02:49:04.873648849Z [2024-05-25T02:49:04.873+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:49:04.874629506Z [2024-05-25T02:49:04.874+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:48:00+00:00, run_id=scheduled__2024-05-25T02:48:00+00:00, run_start_date=2024-05-25 02:49:00.820855+00:00, run_end_date=2024-05-25 02:49:04.874212+00:00, run_duration=4.053357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:48:00+00:00, data_interval_end=2024-05-25 02:49:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:49:04.885423726Z [2024-05-25T02:49:04.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:49:00+00:00, run_after=2024-05-25T02:50:00+00:00 2024-05-25T02:49:04.929560647Z [2024-05-25T02:49:04.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:48:00+00:00 exited with status success for try_number 1 2024-05-25T02:49:04.935285987Z [2024-05-25T02:49:04.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:48:00+00:00, map_index=-1, run_start_date=2024-05-25 02:49:02.749750+00:00, run_end_date=2024-05-25 02:49:04.231644+00:00, run_duration=1.481894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1016, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:49:00.888781+00:00, queued_by_job_id=1, pid=14944 2024-05-25T02:49:06.029787445Z [2024-05-25T02:49:06.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:48:00+00:00 exited with status success for try_number 1 2024-05-25T02:49:06.036012000Z [2024-05-25T02:49:06.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:48:00+00:00, map_index=-1, run_start_date=2024-05-25 02:49:02.911374+00:00, run_end_date=2024-05-25 02:49:04.806429+00:00, run_duration=1.895055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1017, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:49:00.888781+00:00, queued_by_job_id=1, pid=14945 2024-05-25T02:50:00.683478306Z [2024-05-25T02:50:00.682+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:50:00+00:00, run_after=2024-05-25T02:51:00+00:00 2024-05-25T02:50:00.692252608Z [2024-05-25T02:50:00.691+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:50:00.709310340Z [2024-05-25T02:50:00.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:50:00+00:00, run_after=2024-05-25T02:55:00+00:00 2024-05-25T02:50:00.718693247Z [2024-05-25T02:50:00.718+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:50:00.733776630Z [2024-05-25T02:50:00.733+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:50:00+00:00, run_after=2024-05-25T02:51:00+00:00 2024-05-25T02:50:00.851512861Z [2024-05-25T02:50:00.851+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T02:50:00.851550422Z 2024-05-25T02:50:00.851554465Z 2024-05-25T02:50:00.851558809Z 2024-05-25T02:50:00.851562526Z 2024-05-25T02:50:00.851565784Z 2024-05-25T02:50:00.851715488Z [2024-05-25T02:50:00.851+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:50:00.851890269Z [2024-05-25T02:50:00.851+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:50:00.852029303Z [2024-05-25T02:50:00.851+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:50:00.852651855Z [2024-05-25T02:50:00.852+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:50:00.853088820Z [2024-05-25T02:50:00.852+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:50:00.854006815Z [2024-05-25T02:50:00.853+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:50:00.854018456Z 2024-05-25T02:50:00.854022572Z 2024-05-25T02:50:00.854026641Z 2024-05-25T02:50:00.854030037Z 2024-05-25T02:50:00.854033234Z 2024-05-25T02:50:00.859159072Z [2024-05-25T02:50:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T02:50:00.859471402Z [2024-05-25T02:50:00.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:50:00.859744582Z [2024-05-25T02:50:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:50:00.859761086Z [2024-05-25T02:50:00.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:50:00.860084389Z [2024-05-25T02:50:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:50:00.860182150Z [2024-05-25T02:50:00.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:50:00.860271317Z [2024-05-25T02:50:00.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:50:00.860368463Z [2024-05-25T02:50:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:50:00.860583825Z [2024-05-25T02:50:00.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:50:00.860698425Z [2024-05-25T02:50:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:50:01.288088502Z [2024-05-25T02:50:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status queued for try_number 1 2024-05-25T02:50:01.288378052Z [2024-05-25T02:50:01.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:48:00+00:00 exited with status queued for try_number 1 2024-05-25T02:50:01.288583886Z [2024-05-25T02:50:01.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:49:00+00:00 exited with status queued for try_number 1 2024-05-25T02:50:01.288940610Z [2024-05-25T02:50:01.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:49:00+00:00 exited with status queued for try_number 1 2024-05-25T02:50:01.289161058Z [2024-05-25T02:50:01.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:49:00+00:00 exited with status queued for try_number 1 2024-05-25T02:50:01.302791281Z [2024-05-25T02:50:01.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45df96d5-8103-4af1-ae34-29581393b6b0 2024-05-25T02:50:01.303056081Z [2024-05-25T02:50:01.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d9dcbf6-4f80-4f19-9444-6e30fcb30872 2024-05-25T02:50:01.303225622Z [2024-05-25T02:50:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e06b1c3-7db8-4cf8-acf4-3971940d07ae 2024-05-25T02:50:01.303349654Z [2024-05-25T02:50:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14adcbab-0b3a-4274-8364-982a4430de08 2024-05-25T02:50:01.303478410Z [2024-05-25T02:50:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd792d42-ff6e-4617-b6c2-4547b09a1244 2024-05-25T02:50:02.627632787Z [2024-05-25T02:50:02.627+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:50:02.628026862Z [2024-05-25T02:50:02.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:48:00+00:00, run_id=scheduled__2024-05-25T02:48:00+00:00, run_start_date=2024-05-25 02:50:00.750911+00:00, run_end_date=2024-05-25 02:50:02.627682+00:00, run_duration=1.876771, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:48:00+00:00, data_interval_end=2024-05-25 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:50:02.635976761Z [2024-05-25T02:50:02.635+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:50:00+00:00, run_after=2024-05-25T02:52:00+00:00 2024-05-25T02:50:02.778104928Z [2024-05-25T02:50:02.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:48:00+00:00 exited with status success for try_number 1 2024-05-25T02:50:02.794652942Z [2024-05-25T02:50:02.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:48:00+00:00, map_index=-1, run_start_date=2024-05-25 02:50:01.806673+00:00, run_end_date=2024-05-25 02:50:02.244128+00:00, run_duration=0.437455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1018, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:50:00.855389+00:00, queued_by_job_id=1, pid=14979 2024-05-25T02:50:03.991136664Z [2024-05-25T02:50:03.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:50:03.991550853Z [2024-05-25T02:50:03.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:49:00+00:00, run_id=scheduled__2024-05-25T02:49:00+00:00, run_start_date=2024-05-25 02:50:00.751989+00:00, run_end_date=2024-05-25 02:50:03.991004+00:00, run_duration=3.239015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:49:00+00:00, data_interval_end=2024-05-25 02:50:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:50:04.005484731Z [2024-05-25T02:50:04.005+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:50:00+00:00, run_after=2024-05-25T02:51:00+00:00 2024-05-25T02:50:04.118663007Z [2024-05-25T02:50:04.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:49:00+00:00 exited with status success for try_number 1 2024-05-25T02:50:04.123600245Z [2024-05-25T02:50:04.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:49:00+00:00, map_index=-1, run_start_date=2024-05-25 02:50:01.998717+00:00, run_end_date=2024-05-25 02:50:02.765162+00:00, run_duration=0.766445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1019, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:50:00.855389+00:00, queued_by_job_id=1, pid=14980 2024-05-25T02:50:04.320286270Z [2024-05-25T02:50:04.319+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:50:04.320331771Z 2024-05-25T02:50:04.320941355Z [2024-05-25T02:50:04.320+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:50:04.322465150Z [2024-05-25T02:50:04.322+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:50:04.322481362Z 2024-05-25T02:50:04.327702104Z [2024-05-25T02:50:04.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T02:50:04.327915220Z [2024-05-25T02:50:04.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:50:04.409717165Z [2024-05-25T02:50:04.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status queued for try_number 1 2024-05-25T02:50:04.410102880Z [2024-05-25T02:50:04.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status success for try_number 1 2024-05-25T02:50:04.417246781Z [2024-05-25T02:50:04.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9aa55453-623b-4c0c-847b-e43586d262a3 2024-05-25T02:50:04.417715293Z [2024-05-25T02:50:04.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T02:45:00+00:00, map_index=-1, run_start_date=2024-05-25 02:50:03.515906+00:00, run_end_date=2024-05-25 02:50:04.083738+00:00, run_duration=0.567832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1021, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:50:00.855389+00:00, queued_by_job_id=1, pid=15010 2024-05-25T02:50:05.610028339Z [2024-05-25T02:50:05.609+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:50:05.610376583Z [2024-05-25T02:50:05.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:49:00+00:00, run_id=scheduled__2024-05-25T02:49:00+00:00, run_start_date=2024-05-25 02:50:00.753084+00:00, run_end_date=2024-05-25 02:50:05.609996+00:00, run_duration=4.856912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:49:00+00:00, data_interval_end=2024-05-25 02:50:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:50:05.632707347Z [2024-05-25T02:50:05.632+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:50:00+00:00, run_after=2024-05-25T02:51:00+00:00 2024-05-25T02:50:05.719759763Z [2024-05-25T02:50:05.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:49:00+00:00 exited with status success for try_number 1 2024-05-25T02:50:05.727278535Z [2024-05-25T02:50:05.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:49:00+00:00, map_index=-1, run_start_date=2024-05-25 02:50:03.405799+00:00, run_end_date=2024-05-25 02:50:04.972945+00:00, run_duration=1.567146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1020, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:50:00.855389+00:00, queued_by_job_id=1, pid=15009 2024-05-25T02:50:06.773791282Z [2024-05-25T02:50:06.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:50:06.774141768Z [2024-05-25T02:50:06.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:49:00+00:00, run_id=scheduled__2024-05-25T02:49:00+00:00, run_start_date=2024-05-25 02:50:00.754128+00:00, run_end_date=2024-05-25 02:50:06.773664+00:00, run_duration=6.019536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:49:00+00:00, data_interval_end=2024-05-25 02:50:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:50:06.787584179Z [2024-05-25T02:50:06.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:50:00+00:00, run_after=2024-05-25T02:51:00+00:00 2024-05-25T02:50:06.822580323Z [2024-05-25T02:50:06.822+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:50:06.822613801Z 2024-05-25T02:50:06.822978733Z [2024-05-25T02:50:06.822+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:50:06.823864580Z [2024-05-25T02:50:06.823+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:50:06.823876981Z 2024-05-25T02:50:06.827982597Z [2024-05-25T02:50:06.827+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T02:50:06.828415685Z [2024-05-25T02:50:06.828+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:50:06.879452550Z [2024-05-25T02:50:06.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status queued for try_number 1 2024-05-25T02:50:06.881116955Z [2024-05-25T02:50:06.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:49:00+00:00 exited with status success for try_number 1 2024-05-25T02:50:06.881423687Z [2024-05-25T02:50:06.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status success for try_number 1 2024-05-25T02:50:06.892642027Z [2024-05-25T02:50:06.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:49:00+00:00, map_index=-1, run_start_date=2024-05-25 02:50:03.562719+00:00, run_end_date=2024-05-25 02:50:05.859773+00:00, run_duration=2.297054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1022, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:50:00.855389+00:00, queued_by_job_id=1, pid=15011 2024-05-25T02:50:06.893113056Z [2024-05-25T02:50:06.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ced45da-c796-4e6f-a428-3d69387bbbbb 2024-05-25T02:50:06.893566635Z [2024-05-25T02:50:06.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T02:45:00+00:00, map_index=-1, run_start_date=2024-05-25 02:50:05.933374+00:00, run_end_date=2024-05-25 02:50:06.415711+00:00, run_duration=0.482337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1023, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:50:04.323168+00:00, queued_by_job_id=1, pid=15034 2024-05-25T02:50:10.736323728Z [2024-05-25T02:50:10.735+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:50:10.736355340Z 2024-05-25T02:50:10.736516515Z [2024-05-25T02:50:10.736+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:50:10.737303386Z [2024-05-25T02:50:10.736+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:50:10.737324834Z 2024-05-25T02:50:10.740293695Z [2024-05-25T02:50:10.739+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:50:10.740552731Z [2024-05-25T02:50:10.740+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:50:10.800042561Z [2024-05-25T02:50:10.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status queued for try_number 1 2024-05-25T02:50:10.800077337Z [2024-05-25T02:50:10.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status success for try_number 1 2024-05-25T02:50:10.806085169Z [2024-05-25T02:50:10.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3804883-72be-4b25-b0b3-a79a5d4afa64 2024-05-25T02:50:10.806177954Z [2024-05-25T02:50:10.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T02:45:00+00:00, map_index=0, run_start_date=2024-05-25 02:50:08.508778+00:00, run_end_date=2024-05-25 02:50:10.212625+00:00, run_duration=1.703847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1024, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:50:06.824284+00:00, queued_by_job_id=1, pid=15055 2024-05-25T02:50:13.031095446Z [2024-05-25T02:50:13.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:50:13.033065826Z [2024-05-25T02:50:13.032+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:45:00+00:00, run_id=scheduled__2024-05-25T02:45:00+00:00, run_start_date=2024-05-25 02:50:00.749163+00:00, run_end_date=2024-05-25 02:50:13.030901+00:00, run_duration=12.281738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:45:00+00:00, data_interval_end=2024-05-25 02:50:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T02:50:13.040757369Z [2024-05-25T02:50:13.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:50:00+00:00, run_after=2024-05-25T02:55:00+00:00 2024-05-25T02:50:13.079996427Z [2024-05-25T02:50:13.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:45:00+00:00 exited with status success for try_number 1 2024-05-25T02:50:13.090969992Z [2024-05-25T02:50:13.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T02:45:00+00:00, map_index=-1, run_start_date=2024-05-25 02:50:12.280866+00:00, run_end_date=2024-05-25 02:50:12.625807+00:00, run_duration=0.344941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1025, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:50:10.737774+00:00, queued_by_job_id=1, pid=15068 2024-05-25T02:50:30.424701405Z [2024-05-25T02:50:30.424+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T02:51:00.904479662Z [2024-05-25T02:51:00.904+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:51:00+00:00, run_after=2024-05-25T02:52:00+00:00 2024-05-25T02:51:00.917184931Z [2024-05-25T02:51:00.916+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:51:00+00:00, run_after=2024-05-25T02:52:00+00:00 2024-05-25T02:51:00.924788306Z [2024-05-25T02:51:00.924+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:51:00.986815741Z [2024-05-25T02:51:00.986+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:51:00.986853607Z 2024-05-25T02:51:00.986860252Z 2024-05-25T02:51:00.986865902Z 2024-05-25T02:51:00.986882370Z [2024-05-25T02:51:00.986+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:51:00.987107672Z [2024-05-25T02:51:00.986+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:51:00.987235912Z [2024-05-25T02:51:00.987+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:51:00.988350945Z [2024-05-25T02:51:00.988+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:51:00.988363553Z 2024-05-25T02:51:00.988369311Z 2024-05-25T02:51:00.988374677Z 2024-05-25T02:51:00.991026678Z [2024-05-25T02:51:00.990+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:51:00.991175369Z [2024-05-25T02:51:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:51:00.991472232Z [2024-05-25T02:51:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:51:00.991647352Z [2024-05-25T02:51:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:51:00.991868308Z [2024-05-25T02:51:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:51:00.991997194Z [2024-05-25T02:51:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:51:01.217470202Z [2024-05-25T02:51:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status queued for try_number 1 2024-05-25T02:51:01.217646619Z [2024-05-25T02:51:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status queued for try_number 1 2024-05-25T02:51:01.217812056Z [2024-05-25T02:51:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status queued for try_number 1 2024-05-25T02:51:01.226315236Z [2024-05-25T02:51:01.225+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20836c13-3571-4223-bfc9-234a038b662c 2024-05-25T02:51:01.226551551Z [2024-05-25T02:51:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to 991bb6dd-3896-43be-a97b-aefef0753c82 2024-05-25T02:51:01.226746572Z [2024-05-25T02:51:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to 264d2336-9f37-4570-accf-3472095f2642 2024-05-25T02:51:02.447194810Z [2024-05-25T02:51:02.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status success for try_number 1 2024-05-25T02:51:02.451772878Z [2024-05-25T02:51:02.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:50:00+00:00, map_index=-1, run_start_date=2024-05-25 02:51:01.786597+00:00, run_end_date=2024-05-25 02:51:02.235809+00:00, run_duration=0.449212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1026, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:51:00.988980+00:00, queued_by_job_id=1, pid=15077 2024-05-25T02:51:03.511954521Z [2024-05-25T02:51:03.511+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:51:03.512852290Z [2024-05-25T02:51:03.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:50:00+00:00, run_id=scheduled__2024-05-25T02:50:00+00:00, run_start_date=2024-05-25 02:51:00.937283+00:00, run_end_date=2024-05-25 02:51:03.511737+00:00, run_duration=2.574454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:50:00+00:00, data_interval_end=2024-05-25 02:51:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:51:03.527753241Z [2024-05-25T02:51:03.527+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:51:00+00:00, run_after=2024-05-25T02:52:00+00:00 2024-05-25T02:51:04.829701750Z [2024-05-25T02:51:04.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:51:04.829975135Z [2024-05-25T02:51:04.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:50:00+00:00, run_id=scheduled__2024-05-25T02:50:00+00:00, run_start_date=2024-05-25 02:51:00.938378+00:00, run_end_date=2024-05-25 02:51:04.829499+00:00, run_duration=3.891121, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:50:00+00:00, data_interval_end=2024-05-25 02:51:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:51:04.843874442Z [2024-05-25T02:51:04.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:51:00+00:00, run_after=2024-05-25T02:52:00+00:00 2024-05-25T02:51:04.897994286Z [2024-05-25T02:51:04.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status success for try_number 1 2024-05-25T02:51:04.907763607Z [2024-05-25T02:51:04.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:50:00+00:00, map_index=-1, run_start_date=2024-05-25 02:51:02.798103+00:00, run_end_date=2024-05-25 02:51:04.435681+00:00, run_duration=1.637578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1027, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:51:00.988980+00:00, queued_by_job_id=1, pid=15095 2024-05-25T02:51:05.960886760Z [2024-05-25T02:51:05.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:51:05.961790305Z [2024-05-25T02:51:05.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:50:00+00:00, run_id=scheduled__2024-05-25T02:50:00+00:00, run_start_date=2024-05-25 02:51:00.939367+00:00, run_end_date=2024-05-25 02:51:05.960663+00:00, run_duration=5.021296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:50:00+00:00, data_interval_end=2024-05-25 02:51:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:51:05.980352407Z [2024-05-25T02:51:05.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:51:00+00:00, run_after=2024-05-25T02:52:00+00:00 2024-05-25T02:51:06.056341331Z [2024-05-25T02:51:06.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status success for try_number 1 2024-05-25T02:51:06.056372920Z [2024-05-25T02:51:06.046+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:50:00+00:00, map_index=-1, run_start_date=2024-05-25 02:51:02.853599+00:00, run_end_date=2024-05-25 02:51:05.125348+00:00, run_duration=2.271749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1028, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:51:00.988980+00:00, queued_by_job_id=1, pid=15096 2024-05-25T02:52:00.783892029Z [2024-05-25T02:52:00.783+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:52:00+00:00, run_after=2024-05-25T02:53:00+00:00 2024-05-25T02:52:00.793828918Z [2024-05-25T02:52:00.793+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:52:00.817350016Z [2024-05-25T02:52:00.816+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:52:00+00:00, run_after=2024-05-25T02:53:00+00:00 2024-05-25T02:52:00.832040121Z [2024-05-25T02:52:00.831+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:52:00.938078890Z [2024-05-25T02:52:00.937+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:52:00.938127047Z 2024-05-25T02:52:00.938133776Z 2024-05-25T02:52:00.938138517Z 2024-05-25T02:52:00.938143149Z 2024-05-25T02:52:00.938410933Z [2024-05-25T02:52:00.938+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:52:00.938810226Z [2024-05-25T02:52:00.938+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:52:00.939162213Z [2024-05-25T02:52:00.938+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:52:00.939466276Z [2024-05-25T02:52:00.939+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:52:00.940609184Z [2024-05-25T02:52:00.940+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:52:00.940622582Z 2024-05-25T02:52:00.940644997Z 2024-05-25T02:52:00.940649830Z 2024-05-25T02:52:00.940681351Z 2024-05-25T02:52:00.946253806Z [2024-05-25T02:52:00.945+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:52:00.946440010Z [2024-05-25T02:52:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:52:00.946774703Z [2024-05-25T02:52:00.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:52:00.946953535Z [2024-05-25T02:52:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:52:00.947221054Z [2024-05-25T02:52:00.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:52:00.947418265Z [2024-05-25T02:52:00.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:52:00.947746800Z [2024-05-25T02:52:00.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:52:00.947883240Z [2024-05-25T02:52:00.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:52:01.239429007Z [2024-05-25T02:52:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status queued for try_number 1 2024-05-25T02:52:01.239782794Z [2024-05-25T02:52:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:51:00+00:00 exited with status queued for try_number 1 2024-05-25T02:52:01.240043259Z [2024-05-25T02:52:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:51:00+00:00 exited with status queued for try_number 1 2024-05-25T02:52:01.240327192Z [2024-05-25T02:52:01.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:51:00+00:00 exited with status queued for try_number 1 2024-05-25T02:52:01.252016712Z [2024-05-25T02:52:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77e276e8-229a-4ff9-8c0a-09c990c3bb37 2024-05-25T02:52:01.252316278Z [2024-05-25T02:52:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6d3fef6-080e-426c-8c4c-fc78b0f436b4 2024-05-25T02:52:01.252606570Z [2024-05-25T02:52:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37a15f4a-1edf-47e2-a0a7-0380405247b9 2024-05-25T02:52:01.252865199Z [2024-05-25T02:52:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52667242-8bff-405d-852f-62fb3f810775 2024-05-25T02:52:02.463418150Z [2024-05-25T02:52:02.462+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:52:02.464032142Z [2024-05-25T02:52:02.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:50:00+00:00, run_id=scheduled__2024-05-25T02:50:00+00:00, run_start_date=2024-05-25 02:52:00.844419+00:00, run_end_date=2024-05-25 02:52:02.463315+00:00, run_duration=1.618896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:50:00+00:00, data_interval_end=2024-05-25 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:52:02.474124552Z [2024-05-25T02:52:02.473+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:52:00+00:00, run_after=2024-05-25T02:54:00+00:00 2024-05-25T02:52:02.481774524Z [2024-05-25T02:52:02.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:52:02.481799545Z [2024-05-25T02:52:02.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:51:00+00:00, run_id=scheduled__2024-05-25T02:51:00+00:00, run_start_date=2024-05-25 02:52:00.845721+00:00, run_end_date=2024-05-25 02:52:02.481097+00:00, run_duration=1.635376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:51:00+00:00, data_interval_end=2024-05-25 02:52:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:52:02.491855996Z [2024-05-25T02:52:02.491+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:52:00+00:00, run_after=2024-05-25T02:53:00+00:00 2024-05-25T02:52:02.557441091Z [2024-05-25T02:52:02.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status success for try_number 1 2024-05-25T02:52:02.557567903Z [2024-05-25T02:52:02.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:51:00+00:00 exited with status success for try_number 1 2024-05-25T02:52:02.563979190Z [2024-05-25T02:52:02.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:50:00+00:00, map_index=-1, run_start_date=2024-05-25 02:52:01.885060+00:00, run_end_date=2024-05-25 02:52:02.354942+00:00, run_duration=0.469882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1030, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:52:00.942354+00:00, queued_by_job_id=1, pid=15130 2024-05-25T02:52:02.564153589Z [2024-05-25T02:52:02.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:51:00+00:00, map_index=-1, run_start_date=2024-05-25 02:52:01.775627+00:00, run_end_date=2024-05-25 02:52:02.182887+00:00, run_duration=0.40726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1029, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:52:00.942354+00:00, queued_by_job_id=1, pid=15129 2024-05-25T02:52:04.704547757Z [2024-05-25T02:52:04.703+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:52:04.705150513Z [2024-05-25T02:52:04.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:51:00+00:00, run_id=scheduled__2024-05-25T02:51:00+00:00, run_start_date=2024-05-25 02:52:00.846826+00:00, run_end_date=2024-05-25 02:52:04.704401+00:00, run_duration=3.857575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:51:00+00:00, data_interval_end=2024-05-25 02:52:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:52:04.717020734Z [2024-05-25T02:52:04.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:52:00+00:00, run_after=2024-05-25T02:53:00+00:00 2024-05-25T02:52:04.769624944Z [2024-05-25T02:52:04.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:51:00+00:00 exited with status success for try_number 1 2024-05-25T02:52:04.778906804Z [2024-05-25T02:52:04.778+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:51:00+00:00, map_index=-1, run_start_date=2024-05-25 02:52:02.916388+00:00, run_end_date=2024-05-25 02:52:04.179626+00:00, run_duration=1.263238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1031, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:52:00.942354+00:00, queued_by_job_id=1, pid=15153 2024-05-25T02:52:05.305035925Z [2024-05-25T02:52:05.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:52:05.305377374Z [2024-05-25T02:52:05.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:51:00+00:00, run_id=scheduled__2024-05-25T02:51:00+00:00, run_start_date=2024-05-25 02:52:00.847937+00:00, run_end_date=2024-05-25 02:52:05.304772+00:00, run_duration=4.456835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:51:00+00:00, data_interval_end=2024-05-25 02:52:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:52:05.318654359Z [2024-05-25T02:52:05.318+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:52:00+00:00, run_after=2024-05-25T02:53:00+00:00 2024-05-25T02:52:05.357267932Z [2024-05-25T02:52:05.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:51:00+00:00 exited with status success for try_number 1 2024-05-25T02:52:05.364266687Z [2024-05-25T02:52:05.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:51:00+00:00, map_index=-1, run_start_date=2024-05-25 02:52:03.034961+00:00, run_end_date=2024-05-25 02:52:04.910007+00:00, run_duration=1.875046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1032, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:52:00.942354+00:00, queued_by_job_id=1, pid=15154 2024-05-25T02:52:56.764177368Z [2024-05-25T02:52:56.763+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:52:56.764227975Z 2024-05-25T02:52:56.764322043Z [2024-05-25T02:52:56.764+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-05-25T02:52:56.765012521Z [2024-05-25T02:52:56.764+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:52:56.765033150Z 2024-05-25T02:52:56.767181974Z [2024-05-25T02:52:56.766+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240525025255_561983', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:52:56.767468106Z [2024-05-25T02:52:56.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240525025255_561983', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-25T02:52:56.814889183Z [2024-05-25T02:52:56.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240525025255_561983 exited with status queued for try_number 1 2024-05-25T02:52:56.821155832Z [2024-05-25T02:52:56.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc14dc31-83e6-4d48-b0f0-c5a87b9dcba8 2024-05-25T02:52:57.950535836Z [2024-05-25T02:52:57.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:52:57.950701192Z [2024-05-25T02:52:57.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-05-25 02:52:56.201946+00:00, run_id=scaleout_vdu_20240525025255_561983, run_start_date=2024-05-25 02:52:56.733351+00:00, run_end_date=2024-05-25 02:52:57.950457+00:00, run_duration=1.217106, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-25 02:52:56.201946+00:00, data_interval_end=2024-05-25 02:52:56.201946+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-05-25T02:52:57.954111112Z [2024-05-25T02:52:57.953+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-05-25T02:52:57.980773023Z [2024-05-25T02:52:57.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240525025255_561983 exited with status success for try_number 1 2024-05-25T02:52:57.986273243Z [2024-05-25T02:52:57.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240525025255_561983, map_index=-1, run_start_date=2024-05-25 02:52:57.434896+00:00, run_end_date=2024-05-25 02:52:57.820290+00:00, run_duration=0.385394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1033, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:52:56.765308+00:00, queued_by_job_id=1, pid=15179 2024-05-25T02:53:00.099540957Z [2024-05-25T02:53:00.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:53:00+00:00, run_after=2024-05-25T02:54:00+00:00 2024-05-25T02:53:00.113097390Z [2024-05-25T02:53:00.112+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:53:00+00:00, run_after=2024-05-25T02:54:00+00:00 2024-05-25T02:53:00.120644665Z [2024-05-25T02:53:00.120+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:53:00.202478153Z [2024-05-25T02:53:00.202+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:53:00.202512084Z 2024-05-25T02:53:00.202516369Z 2024-05-25T02:53:00.202519431Z 2024-05-25T02:53:00.202616130Z [2024-05-25T02:53:00.202+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:53:00.202669439Z [2024-05-25T02:53:00.202+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:53:00.202813368Z [2024-05-25T02:53:00.202+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:53:00.203559892Z [2024-05-25T02:53:00.203+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:53:00.203565680Z 2024-05-25T02:53:00.203568954Z 2024-05-25T02:53:00.203572491Z 2024-05-25T02:53:00.207856347Z [2024-05-25T02:53:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:53:00.207983728Z [2024-05-25T02:53:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:53:00.208296458Z [2024-05-25T02:53:00.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:53:00.208412269Z [2024-05-25T02:53:00.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:53:00.208690286Z [2024-05-25T02:53:00.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:53:00.208822633Z [2024-05-25T02:53:00.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:53:00.451987561Z [2024-05-25T02:53:00.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:52:00+00:00 exited with status queued for try_number 1 2024-05-25T02:53:00.452021646Z [2024-05-25T02:53:00.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:52:00+00:00 exited with status queued for try_number 1 2024-05-25T02:53:00.452065070Z [2024-05-25T02:53:00.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:52:00+00:00 exited with status queued for try_number 1 2024-05-25T02:53:00.458795424Z [2024-05-25T02:53:00.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f7d4ee6-7a08-4db8-948b-446399308683 2024-05-25T02:53:00.458828634Z [2024-05-25T02:53:00.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28766f9c-2531-4ed5-bedd-b737a50dffe3 2024-05-25T02:53:00.458955534Z [2024-05-25T02:53:00.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c5b7260-df73-41fb-8039-83d48ad7e153 2024-05-25T02:53:01.761342098Z [2024-05-25T02:53:01.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:53:01.762045280Z [2024-05-25T02:53:01.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:52:00+00:00, run_id=scheduled__2024-05-25T02:52:00+00:00, run_start_date=2024-05-25 02:53:00.132029+00:00, run_end_date=2024-05-25 02:53:01.761252+00:00, run_duration=1.629223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:52:00+00:00, data_interval_end=2024-05-25 02:53:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:53:01.777293944Z [2024-05-25T02:53:01.776+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:53:00+00:00, run_after=2024-05-25T02:54:00+00:00 2024-05-25T02:53:01.837157145Z [2024-05-25T02:53:01.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:52:00+00:00 exited with status success for try_number 1 2024-05-25T02:53:01.843123351Z [2024-05-25T02:53:01.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:52:00+00:00, map_index=-1, run_start_date=2024-05-25 02:53:00.953718+00:00, run_end_date=2024-05-25 02:53:01.320444+00:00, run_duration=0.366726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1034, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:53:00.204621+00:00, queued_by_job_id=1, pid=15193 2024-05-25T02:53:04.021056634Z [2024-05-25T02:53:04.020+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:53:04.021366731Z [2024-05-25T02:53:04.020+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:52:00+00:00, run_id=scheduled__2024-05-25T02:52:00+00:00, run_start_date=2024-05-25 02:53:00.133354+00:00, run_end_date=2024-05-25 02:53:04.020747+00:00, run_duration=3.887393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:52:00+00:00, data_interval_end=2024-05-25 02:53:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:53:04.041414857Z [2024-05-25T02:53:04.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:53:00+00:00, run_after=2024-05-25T02:54:00+00:00 2024-05-25T02:53:04.098708084Z [2024-05-25T02:53:04.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:52:00+00:00 exited with status success for try_number 1 2024-05-25T02:53:04.104126535Z [2024-05-25T02:53:04.103+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:52:00+00:00, map_index=-1, run_start_date=2024-05-25 02:53:02.047713+00:00, run_end_date=2024-05-25 02:53:03.260286+00:00, run_duration=1.212573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1036, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:53:00.204621+00:00, queued_by_job_id=1, pid=15212 2024-05-25T02:53:05.746032826Z [2024-05-25T02:53:05.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:53:05.746285776Z [2024-05-25T02:53:05.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:52:00+00:00, run_id=scheduled__2024-05-25T02:52:00+00:00, run_start_date=2024-05-25 02:53:00.134467+00:00, run_end_date=2024-05-25 02:53:05.745889+00:00, run_duration=5.611422, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:52:00+00:00, data_interval_end=2024-05-25 02:53:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:53:05.758782193Z [2024-05-25T02:53:05.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:53:00+00:00, run_after=2024-05-25T02:54:00+00:00 2024-05-25T02:53:05.802270318Z [2024-05-25T02:53:05.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:52:00+00:00 exited with status success for try_number 1 2024-05-25T02:53:05.809549659Z [2024-05-25T02:53:05.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:52:00+00:00, map_index=-1, run_start_date=2024-05-25 02:53:01.957690+00:00, run_end_date=2024-05-25 02:53:05.129111+00:00, run_duration=3.171421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1035, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:53:00.204621+00:00, queued_by_job_id=1, pid=15211 2024-05-25T02:54:00.802919349Z [2024-05-25T02:54:00.802+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:54:00+00:00, run_after=2024-05-25T02:55:00+00:00 2024-05-25T02:54:00.809944229Z [2024-05-25T02:54:00.809+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:54:00.821233450Z [2024-05-25T02:54:00.820+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:54:00+00:00, run_after=2024-05-25T02:55:00+00:00 2024-05-25T02:54:00.827721521Z [2024-05-25T02:54:00.827+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:54:00.908068131Z [2024-05-25T02:54:00.907+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:54:00.908100729Z 2024-05-25T02:54:00.908107686Z 2024-05-25T02:54:00.908113369Z 2024-05-25T02:54:00.908119445Z 2024-05-25T02:54:00.908235416Z [2024-05-25T02:54:00.908+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:54:00.908462534Z [2024-05-25T02:54:00.908+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:54:00.908695660Z [2024-05-25T02:54:00.908+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:54:00.908981759Z [2024-05-25T02:54:00.908+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:54:00.909832337Z [2024-05-25T02:54:00.909+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:54:00.909859642Z 2024-05-25T02:54:00.909877731Z 2024-05-25T02:54:00.909881553Z 2024-05-25T02:54:00.909884507Z 2024-05-25T02:54:00.914273716Z [2024-05-25T02:54:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:54:00.914566728Z [2024-05-25T02:54:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:54:00.914994942Z [2024-05-25T02:54:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:54:00.915153352Z [2024-05-25T02:54:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:54:00.915497385Z [2024-05-25T02:54:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:54:00.915811623Z [2024-05-25T02:54:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:54:00.916139201Z [2024-05-25T02:54:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:54:00.916349249Z [2024-05-25T02:54:00.916+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:54:01.198315489Z [2024-05-25T02:54:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:52:00+00:00 exited with status queued for try_number 1 2024-05-25T02:54:01.198512012Z [2024-05-25T02:54:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:53:00+00:00 exited with status queued for try_number 1 2024-05-25T02:54:01.198642049Z [2024-05-25T02:54:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:53:00+00:00 exited with status queued for try_number 1 2024-05-25T02:54:01.198667715Z [2024-05-25T02:54:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:53:00+00:00 exited with status queued for try_number 1 2024-05-25T02:54:01.206401580Z [2024-05-25T02:54:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85993d25-012e-461c-a870-7f4d4c0ad0a3 2024-05-25T02:54:01.206528088Z [2024-05-25T02:54:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b317e55-557f-4ff6-95f5-4584bcbc448b 2024-05-25T02:54:01.206642807Z [2024-05-25T02:54:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9a5b123-dbf6-4317-9585-7c15681f9f9f 2024-05-25T02:54:01.206764139Z [2024-05-25T02:54:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed47707e-0296-4fae-a15c-832e4812ec59 2024-05-25T02:54:02.776178058Z [2024-05-25T02:54:02.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:54:02.776503276Z [2024-05-25T02:54:02.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:52:00+00:00, run_id=scheduled__2024-05-25T02:52:00+00:00, run_start_date=2024-05-25 02:54:00.837356+00:00, run_end_date=2024-05-25 02:54:02.776095+00:00, run_duration=1.938739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:52:00+00:00, data_interval_end=2024-05-25 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:54:02.783532712Z [2024-05-25T02:54:02.783+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:54:00+00:00, run_after=2024-05-25T02:56:00+00:00 2024-05-25T02:54:02.791088989Z [2024-05-25T02:54:02.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:54:02.791359327Z [2024-05-25T02:54:02.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:53:00+00:00, run_id=scheduled__2024-05-25T02:53:00+00:00, run_start_date=2024-05-25 02:54:00.839194+00:00, run_end_date=2024-05-25 02:54:02.790989+00:00, run_duration=1.951795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:53:00+00:00, data_interval_end=2024-05-25 02:54:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:54:02.805742670Z [2024-05-25T02:54:02.805+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:54:00+00:00, run_after=2024-05-25T02:55:00+00:00 2024-05-25T02:54:02.870955171Z [2024-05-25T02:54:02.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:52:00+00:00 exited with status success for try_number 1 2024-05-25T02:54:02.873660819Z [2024-05-25T02:54:02.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:53:00+00:00 exited with status success for try_number 1 2024-05-25T02:54:02.882999778Z [2024-05-25T02:54:02.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:53:00+00:00, map_index=-1, run_start_date=2024-05-25 02:54:01.943271+00:00, run_end_date=2024-05-25 02:54:02.340103+00:00, run_duration=0.396832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1038, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:54:00.910743+00:00, queued_by_job_id=1, pid=15251 2024-05-25T02:54:02.883364601Z [2024-05-25T02:54:02.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:52:00+00:00, map_index=-1, run_start_date=2024-05-25 02:54:01.624452+00:00, run_end_date=2024-05-25 02:54:01.975828+00:00, run_duration=0.351376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1037, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:54:00.910743+00:00, queued_by_job_id=1, pid=15240 2024-05-25T02:54:05.047745520Z [2024-05-25T02:54:05.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:54:05.047975385Z [2024-05-25T02:54:05.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:53:00+00:00, run_id=scheduled__2024-05-25T02:53:00+00:00, run_start_date=2024-05-25 02:54:00.840316+00:00, run_end_date=2024-05-25 02:54:05.047483+00:00, run_duration=4.207167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:53:00+00:00, data_interval_end=2024-05-25 02:54:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:54:05.066082425Z [2024-05-25T02:54:05.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:54:00+00:00, run_after=2024-05-25T02:55:00+00:00 2024-05-25T02:54:05.077625320Z [2024-05-25T02:54:05.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:54:05.077904093Z [2024-05-25T02:54:05.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:53:00+00:00, run_id=scheduled__2024-05-25T02:53:00+00:00, run_start_date=2024-05-25 02:54:00.841330+00:00, run_end_date=2024-05-25 02:54:05.077443+00:00, run_duration=4.236113, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:53:00+00:00, data_interval_end=2024-05-25 02:54:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:54:05.097998939Z [2024-05-25T02:54:05.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:54:00+00:00, run_after=2024-05-25T02:55:00+00:00 2024-05-25T02:54:05.145010230Z [2024-05-25T02:54:05.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:53:00+00:00 exited with status success for try_number 1 2024-05-25T02:54:05.145133247Z [2024-05-25T02:54:05.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:53:00+00:00 exited with status success for try_number 1 2024-05-25T02:54:05.154927138Z [2024-05-25T02:54:05.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:53:00+00:00, map_index=-1, run_start_date=2024-05-25 02:54:02.930057+00:00, run_end_date=2024-05-25 02:54:04.342658+00:00, run_duration=1.412601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1040, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:54:00.910743+00:00, queued_by_job_id=1, pid=15270 2024-05-25T02:54:05.155146131Z [2024-05-25T02:54:05.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:53:00+00:00, map_index=-1, run_start_date=2024-05-25 02:54:02.840617+00:00, run_end_date=2024-05-25 02:54:04.647880+00:00, run_duration=1.807263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1039, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:54:00.910743+00:00, queued_by_job_id=1, pid=15269 2024-05-25T02:54:56.609788412Z [2024-05-25T02:54:56.609+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:54:56.609816849Z 2024-05-25T02:54:56.610064908Z [2024-05-25T02:54:56.609+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-05-25T02:54:56.610701879Z [2024-05-25T02:54:56.610+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:54:56.610713895Z 2024-05-25T02:54:56.613496847Z [2024-05-25T02:54:56.613+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240525025455_333497', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:54:56.613706641Z [2024-05-25T02:54:56.613+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240525025455_333497', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-25T02:54:56.676357093Z [2024-05-25T02:54:56.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240525025455_333497 exited with status queued for try_number 1 2024-05-25T02:54:56.690051588Z [2024-05-25T02:54:56.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2033053-d809-4977-9a9d-e202ad60dca4 2024-05-25T02:54:58.608627917Z [2024-05-25T02:54:58.608+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:54:58.609227320Z [2024-05-25T02:54:58.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-05-25 02:54:56.279026+00:00, run_id=scaleout_vdu_20240525025455_333497, run_start_date=2024-05-25 02:54:56.579079+00:00, run_end_date=2024-05-25 02:54:58.608806+00:00, run_duration=2.029727, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-25 02:54:56.279026+00:00, data_interval_end=2024-05-25 02:54:56.279026+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-05-25T02:54:58.612798543Z [2024-05-25T02:54:58.612+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-05-25T02:54:58.642922527Z [2024-05-25T02:54:58.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240525025455_333497 exited with status success for try_number 1 2024-05-25T02:54:58.648763541Z [2024-05-25T02:54:58.648+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240525025455_333497, map_index=-1, run_start_date=2024-05-25 02:54:57.352364+00:00, run_end_date=2024-05-25 02:54:57.930332+00:00, run_duration=0.577968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1041, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:54:56.611077+00:00, queued_by_job_id=1, pid=15295 2024-05-25T02:55:00.752279710Z [2024-05-25T02:55:00.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:55:00+00:00, run_after=2024-05-25T02:56:00+00:00 2024-05-25T02:55:00.766814637Z [2024-05-25T02:55:00.766+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:55:00+00:00, run_after=2024-05-25T02:56:00+00:00 2024-05-25T02:55:00.780237499Z [2024-05-25T02:55:00.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:55:00+00:00, run_after=2024-05-25T03:00:00+00:00 2024-05-25T02:55:00.787994616Z [2024-05-25T02:55:00.787+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:55:00.915862487Z [2024-05-25T02:55:00.915+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:55:00.915905447Z 2024-05-25T02:55:00.915915267Z 2024-05-25T02:55:00.915923570Z 2024-05-25T02:55:00.915931616Z 2024-05-25T02:55:00.916076510Z [2024-05-25T02:55:00.915+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:55:00.916380492Z [2024-05-25T02:55:00.916+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:55:00.916622406Z [2024-05-25T02:55:00.916+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:55:00.916853249Z [2024-05-25T02:55:00.916+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:55:00.917827329Z [2024-05-25T02:55:00.917+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:55:00.917855242Z 2024-05-25T02:55:00.917867921Z 2024-05-25T02:55:00.917908332Z 2024-05-25T02:55:00.917915879Z 2024-05-25T02:55:00.926896199Z [2024-05-25T02:55:00.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T02:55:00.927032105Z [2024-05-25T02:55:00.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:55:00.927492928Z [2024-05-25T02:55:00.927+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:55:00.927781731Z [2024-05-25T02:55:00.927+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:55:00.928275990Z [2024-05-25T02:55:00.927+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:55:00.928519106Z [2024-05-25T02:55:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:55:00.929045798Z [2024-05-25T02:55:00.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:55:00.931646125Z [2024-05-25T02:55:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:55:01.276811286Z [2024-05-25T02:55:01.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status queued for try_number 1 2024-05-25T02:55:01.277139682Z [2024-05-25T02:55:01.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:54:00+00:00 exited with status queued for try_number 1 2024-05-25T02:55:01.277370975Z [2024-05-25T02:55:01.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:54:00+00:00 exited with status queued for try_number 1 2024-05-25T02:55:01.277529814Z [2024-05-25T02:55:01.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:54:00+00:00 exited with status queued for try_number 1 2024-05-25T02:55:01.299579684Z [2024-05-25T02:55:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to 831b9d69-8630-4bfe-955d-eed693332329 2024-05-25T02:55:01.299641635Z [2024-05-25T02:55:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2e3eb67-1286-4168-aff7-690dc553468f 2024-05-25T02:55:01.299744452Z [2024-05-25T02:55:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6a4efb9-60c7-4a9b-af13-5ed8b0f2915c 2024-05-25T02:55:01.299848214Z [2024-05-25T02:55:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85463d98-acc0-4016-a088-5f3f9355e44f 2024-05-25T02:55:02.603556174Z [2024-05-25T02:55:02.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:55:02.603807950Z [2024-05-25T02:55:02.603+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:54:00+00:00, run_id=scheduled__2024-05-25T02:54:00+00:00, run_start_date=2024-05-25 02:55:00.807051+00:00, run_end_date=2024-05-25 02:55:02.603471+00:00, run_duration=1.79642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:54:00+00:00, data_interval_end=2024-05-25 02:55:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:55:02.614317368Z [2024-05-25T02:55:02.613+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:55:00+00:00, run_after=2024-05-25T02:56:00+00:00 2024-05-25T02:55:02.683241034Z [2024-05-25T02:55:02.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:54:00+00:00 exited with status success for try_number 1 2024-05-25T02:55:02.691057706Z [2024-05-25T02:55:02.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:54:00+00:00, map_index=-1, run_start_date=2024-05-25 02:55:01.969776+00:00, run_end_date=2024-05-25 02:55:02.454372+00:00, run_duration=0.484596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1042, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:55:00.919411+00:00, queued_by_job_id=1, pid=15310 2024-05-25T02:55:03.822991385Z [2024-05-25T02:55:03.822+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:55:03.823059308Z 2024-05-25T02:55:03.823690421Z [2024-05-25T02:55:03.823+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:55:03.825463371Z [2024-05-25T02:55:03.824+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:55:03.825495046Z 2024-05-25T02:55:03.831613040Z [2024-05-25T02:55:03.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T02:55:03.832079570Z [2024-05-25T02:55:03.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:55:03.961719928Z [2024-05-25T02:55:03.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status queued for try_number 1 2024-05-25T02:55:03.961767603Z [2024-05-25T02:55:03.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status success for try_number 1 2024-05-25T02:55:03.970661584Z [2024-05-25T02:55:03.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to 157ad611-52a0-4636-9c88-3ed261cabbc0 2024-05-25T02:55:03.970701736Z [2024-05-25T02:55:03.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T02:50:00+00:00, map_index=-1, run_start_date=2024-05-25 02:55:03.217858+00:00, run_end_date=2024-05-25 02:55:03.613387+00:00, run_duration=0.395529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1044, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:55:00.919411+00:00, queued_by_job_id=1, pid=15335 2024-05-25T02:55:05.170911896Z [2024-05-25T02:55:05.170+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:55:05.171152257Z [2024-05-25T02:55:05.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:54:00+00:00, run_id=scheduled__2024-05-25T02:54:00+00:00, run_start_date=2024-05-25 02:55:00.814138+00:00, run_end_date=2024-05-25 02:55:05.170771+00:00, run_duration=4.356633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:54:00+00:00, data_interval_end=2024-05-25 02:55:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:55:05.179531887Z [2024-05-25T02:55:05.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:55:00+00:00, run_after=2024-05-25T02:56:00+00:00 2024-05-25T02:55:05.187036519Z [2024-05-25T02:55:05.186+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:55:05.187095278Z [2024-05-25T02:55:05.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:54:00+00:00, run_id=scheduled__2024-05-25T02:54:00+00:00, run_start_date=2024-05-25 02:55:00.815736+00:00, run_end_date=2024-05-25 02:55:05.186868+00:00, run_duration=4.371132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:54:00+00:00, data_interval_end=2024-05-25 02:55:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:55:05.198457213Z [2024-05-25T02:55:05.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:55:00+00:00, run_after=2024-05-25T02:56:00+00:00 2024-05-25T02:55:05.245692274Z [2024-05-25T02:55:05.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:54:00+00:00 exited with status success for try_number 1 2024-05-25T02:55:05.246279753Z [2024-05-25T02:55:05.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:54:00+00:00 exited with status success for try_number 1 2024-05-25T02:55:05.257794029Z [2024-05-25T02:55:05.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:54:00+00:00, map_index=-1, run_start_date=2024-05-25 02:55:03.236279+00:00, run_end_date=2024-05-25 02:55:04.739407+00:00, run_duration=1.503128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1045, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:55:00.919411+00:00, queued_by_job_id=1, pid=15336 2024-05-25T02:55:05.258462835Z [2024-05-25T02:55:05.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:54:00+00:00, map_index=-1, run_start_date=2024-05-25 02:55:03.000210+00:00, run_end_date=2024-05-25 02:55:04.200507+00:00, run_duration=1.200297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1043, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:55:00.919411+00:00, queued_by_job_id=1, pid=15329 2024-05-25T02:55:06.352524750Z [2024-05-25T02:55:06.351+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:55:06.352575309Z 2024-05-25T02:55:06.352585334Z [2024-05-25T02:55:06.352+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:55:06.353617473Z [2024-05-25T02:55:06.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:55:06.353659040Z 2024-05-25T02:55:06.357517376Z [2024-05-25T02:55:06.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T02:55:06.357672165Z [2024-05-25T02:55:06.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:55:06.424272144Z [2024-05-25T02:55:06.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status queued for try_number 1 2024-05-25T02:55:06.424752388Z [2024-05-25T02:55:06.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status success for try_number 1 2024-05-25T02:55:06.433066913Z [2024-05-25T02:55:06.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4edbc521-5a84-49f5-91aa-91543d11dccc 2024-05-25T02:55:06.433352021Z [2024-05-25T02:55:06.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T02:50:00+00:00, map_index=-1, run_start_date=2024-05-25 02:55:05.630983+00:00, run_end_date=2024-05-25 02:55:05.979260+00:00, run_duration=0.348277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1046, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:55:03.826588+00:00, queued_by_job_id=1, pid=15359 2024-05-25T02:55:10.022486724Z [2024-05-25T02:55:10.021+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:55:10.022528421Z 2024-05-25T02:55:10.022618195Z [2024-05-25T02:55:10.022+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:55:10.023443907Z [2024-05-25T02:55:10.023+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:55:10.023484971Z 2024-05-25T02:55:10.027255464Z [2024-05-25T02:55:10.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:55:10.028668566Z [2024-05-25T02:55:10.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:55:10.081930394Z [2024-05-25T02:55:10.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status queued for try_number 1 2024-05-25T02:55:10.082027307Z [2024-05-25T02:55:10.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status success for try_number 1 2024-05-25T02:55:10.100960984Z [2024-05-25T02:55:10.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bd573fd-45e7-4cb8-b897-85414662873c 2024-05-25T02:55:10.101256740Z [2024-05-25T02:55:10.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T02:50:00+00:00, map_index=0, run_start_date=2024-05-25 02:55:07.971367+00:00, run_end_date=2024-05-25 02:55:09.119082+00:00, run_duration=1.147715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1047, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:55:06.354116+00:00, queued_by_job_id=1, pid=15380 2024-05-25T02:55:12.089020913Z [2024-05-25T02:55:12.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:55:12.089432205Z [2024-05-25T02:55:12.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:50:00+00:00, run_id=scheduled__2024-05-25T02:50:00+00:00, run_start_date=2024-05-25 02:55:00.803010+00:00, run_end_date=2024-05-25 02:55:12.088951+00:00, run_duration=11.285941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:50:00+00:00, data_interval_end=2024-05-25 02:55:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T02:55:12.099724866Z [2024-05-25T02:55:12.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:55:00+00:00, run_after=2024-05-25T03:00:00+00:00 2024-05-25T02:55:12.132861887Z [2024-05-25T02:55:12.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:50:00+00:00 exited with status success for try_number 1 2024-05-25T02:55:12.138504443Z [2024-05-25T02:55:12.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T02:50:00+00:00, map_index=-1, run_start_date=2024-05-25 02:55:11.525804+00:00, run_end_date=2024-05-25 02:55:11.914935+00:00, run_duration=0.389131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1048, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:55:10.023945+00:00, queued_by_job_id=1, pid=15393 2024-05-25T02:55:30.485901914Z [2024-05-25T02:55:30.485+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T02:56:00.631669585Z [2024-05-25T02:56:00.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:56:00+00:00, run_after=2024-05-25T02:57:00+00:00 2024-05-25T02:56:00.643195502Z [2024-05-25T02:56:00.642+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:56:00.652310898Z [2024-05-25T02:56:00.651+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:56:00.664118069Z [2024-05-25T02:56:00.663+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:56:00+00:00, run_after=2024-05-25T02:57:00+00:00 2024-05-25T02:56:00.782535603Z [2024-05-25T02:56:00.781+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:56:00.782589554Z 2024-05-25T02:56:00.782599990Z 2024-05-25T02:56:00.782609313Z 2024-05-25T02:56:00.782651489Z 2024-05-25T02:56:00.782661625Z [2024-05-25T02:56:00.782+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:56:00.782934052Z [2024-05-25T02:56:00.782+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:56:00.783473962Z [2024-05-25T02:56:00.783+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:56:00.783858527Z [2024-05-25T02:56:00.783+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:56:00.784886958Z [2024-05-25T02:56:00.784+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:56:00.784917735Z 2024-05-25T02:56:00.784928162Z 2024-05-25T02:56:00.784937459Z 2024-05-25T02:56:00.784945936Z 2024-05-25T02:56:00.790876272Z [2024-05-25T02:56:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:56:00.791310937Z [2024-05-25T02:56:00.790+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:56:00.791879771Z [2024-05-25T02:56:00.791+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:56:00.792341339Z [2024-05-25T02:56:00.791+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:56:00.792747764Z [2024-05-25T02:56:00.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:56:00.792985939Z [2024-05-25T02:56:00.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:56:00.793485773Z [2024-05-25T02:56:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:56:00.793724403Z [2024-05-25T02:56:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:56:01.212314076Z [2024-05-25T02:56:01.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:54:00+00:00 exited with status queued for try_number 1 2024-05-25T02:56:01.212481114Z [2024-05-25T02:56:01.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status queued for try_number 1 2024-05-25T02:56:01.212655823Z [2024-05-25T02:56:01.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status queued for try_number 1 2024-05-25T02:56:01.212775119Z [2024-05-25T02:56:01.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status queued for try_number 1 2024-05-25T02:56:01.224680366Z [2024-05-25T02:56:01.224+0000] {scheduler_job.py:635} INFO - Setting external_id for to a93e26a6-8eb8-4611-9d09-af183e0e0cd0 2024-05-25T02:56:01.224996971Z [2024-05-25T02:56:01.224+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6bd20bb-fee3-4d2d-af08-13b787398fae 2024-05-25T02:56:01.225341954Z [2024-05-25T02:56:01.225+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c5242d5-dc4a-4cd7-ba91-702cedaf863a 2024-05-25T02:56:01.225614831Z [2024-05-25T02:56:01.225+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49c3a2f6-49a6-469e-b574-40742da9ca6a 2024-05-25T02:56:02.438169596Z [2024-05-25T02:56:02.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:56:02.438203847Z [2024-05-25T02:56:02.435+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:54:00+00:00, run_id=scheduled__2024-05-25T02:54:00+00:00, run_start_date=2024-05-25 02:56:00.679077+00:00, run_end_date=2024-05-25 02:56:02.435592+00:00, run_duration=1.756515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:54:00+00:00, data_interval_end=2024-05-25 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:56:02.453647190Z [2024-05-25T02:56:02.453+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:56:00+00:00, run_after=2024-05-25T02:58:00+00:00 2024-05-25T02:56:02.600463091Z [2024-05-25T02:56:02.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:54:00+00:00 exited with status success for try_number 1 2024-05-25T02:56:02.611314772Z [2024-05-25T02:56:02.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:54:00+00:00, map_index=-1, run_start_date=2024-05-25 02:56:01.585448+00:00, run_end_date=2024-05-25 02:56:02.071488+00:00, run_duration=0.48604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1049, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:56:00.786539+00:00, queued_by_job_id=1, pid=15398 2024-05-25T02:56:03.570817220Z [2024-05-25T02:56:03.570+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:56:03.571062328Z [2024-05-25T02:56:03.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:55:00+00:00, run_id=scheduled__2024-05-25T02:55:00+00:00, run_start_date=2024-05-25 02:56:00.681664+00:00, run_end_date=2024-05-25 02:56:03.570799+00:00, run_duration=2.889135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:55:00+00:00, data_interval_end=2024-05-25 02:56:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:56:03.595351246Z [2024-05-25T02:56:03.594+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:56:00+00:00, run_after=2024-05-25T02:57:00+00:00 2024-05-25T02:56:03.671325507Z [2024-05-25T02:56:03.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status success for try_number 1 2024-05-25T02:56:03.681070519Z [2024-05-25T02:56:03.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:55:00+00:00, map_index=-1, run_start_date=2024-05-25 02:56:02.295835+00:00, run_end_date=2024-05-25 02:56:02.873030+00:00, run_duration=0.577195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1050, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:56:00.786539+00:00, queued_by_job_id=1, pid=15410 2024-05-25T02:56:04.742212654Z [2024-05-25T02:56:04.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:56:04.742527107Z [2024-05-25T02:56:04.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:55:00+00:00, run_id=scheduled__2024-05-25T02:55:00+00:00, run_start_date=2024-05-25 02:56:00.683534+00:00, run_end_date=2024-05-25 02:56:04.742085+00:00, run_duration=4.058551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:55:00+00:00, data_interval_end=2024-05-25 02:56:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:56:04.751479885Z [2024-05-25T02:56:04.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:56:00+00:00, run_after=2024-05-25T02:57:00+00:00 2024-05-25T02:56:04.792421568Z [2024-05-25T02:56:04.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status success for try_number 1 2024-05-25T02:56:04.797155964Z [2024-05-25T02:56:04.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:55:00+00:00, map_index=-1, run_start_date=2024-05-25 02:56:03.144346+00:00, run_end_date=2024-05-25 02:56:04.627282+00:00, run_duration=1.482936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1051, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:56:00.786539+00:00, queued_by_job_id=1, pid=15422 2024-05-25T02:56:05.857509726Z [2024-05-25T02:56:05.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:56:05.857998444Z [2024-05-25T02:56:05.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:55:00+00:00, run_id=scheduled__2024-05-25T02:55:00+00:00, run_start_date=2024-05-25 02:56:00.685267+00:00, run_end_date=2024-05-25 02:56:05.857466+00:00, run_duration=5.172199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:55:00+00:00, data_interval_end=2024-05-25 02:56:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:56:05.872747211Z [2024-05-25T02:56:05.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:56:00+00:00, run_after=2024-05-25T02:57:00+00:00 2024-05-25T02:56:05.919639376Z [2024-05-25T02:56:05.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status success for try_number 1 2024-05-25T02:56:05.928366944Z [2024-05-25T02:56:05.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:55:00+00:00, map_index=-1, run_start_date=2024-05-25 02:56:03.957541+00:00, run_end_date=2024-05-25 02:56:05.561852+00:00, run_duration=1.604311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1052, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:56:00.786539+00:00, queued_by_job_id=1, pid=15433 2024-05-25T02:56:30.144713351Z [2024-05-25T02:56:30.144+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T02:56:30.144897512Z 2024-05-25T02:56:30.144918813Z [2024-05-25T02:56:30.144+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-05-25T02:56:30.145074188Z [2024-05-25T02:56:30.144+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:56:30.145127497Z 2024-05-25T02:56:30.148137391Z [2024-05-25T02:56:30.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240525025629_402011', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:56:30.148233527Z [2024-05-25T02:56:30.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240525025629_402011', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-25T02:56:30.239670016Z [2024-05-25T02:56:30.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240525025629_402011 exited with status queued for try_number 1 2024-05-25T02:56:30.246440735Z [2024-05-25T02:56:30.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cba1957-b509-4bb8-904d-959b7291a625 2024-05-25T02:56:31.371733457Z [2024-05-25T02:56:31.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:56:31.372401761Z [2024-05-25T02:56:31.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-05-25 02:56:29.953292+00:00, run_id=vdu_alarm_20240525025629_402011, run_start_date=2024-05-25 02:56:30.106074+00:00, run_end_date=2024-05-25 02:56:31.371990+00:00, run_duration=1.265916, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-25 02:56:29.953292+00:00, data_interval_end=2024-05-25 02:56:29.953292+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-05-25T02:56:31.379063252Z [2024-05-25T02:56:31.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-05-25T02:56:31.429068715Z [2024-05-25T02:56:31.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240525025629_402011 exited with status success for try_number 1 2024-05-25T02:56:31.441315210Z [2024-05-25T02:56:31.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240525025629_402011, map_index=-1, run_start_date=2024-05-25 02:56:30.879958+00:00, run_end_date=2024-05-25 02:56:31.250632+00:00, run_duration=0.370674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1053, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:56:30.145420+00:00, queued_by_job_id=1, pid=15453 2024-05-25T02:57:00.548272745Z [2024-05-25T02:57:00.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:57:00+00:00, run_after=2024-05-25T02:58:00+00:00 2024-05-25T02:57:00.562042675Z [2024-05-25T02:57:00.561+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:57:00+00:00, run_after=2024-05-25T02:58:00+00:00 2024-05-25T02:57:00.570454390Z [2024-05-25T02:57:00.570+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:57:00.651282276Z [2024-05-25T02:57:00.650+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:57:00.651315554Z 2024-05-25T02:57:00.651321174Z 2024-05-25T02:57:00.651326021Z 2024-05-25T02:57:00.651723992Z [2024-05-25T02:57:00.651+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:57:00.652086891Z [2024-05-25T02:57:00.651+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:57:00.652433391Z [2024-05-25T02:57:00.652+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:57:00.653700436Z [2024-05-25T02:57:00.653+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:57:00.653789133Z 2024-05-25T02:57:00.653806335Z 2024-05-25T02:57:00.653815847Z 2024-05-25T02:57:00.658981083Z [2024-05-25T02:57:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:57:00.659291329Z [2024-05-25T02:57:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:57:00.659821689Z [2024-05-25T02:57:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:57:00.660139448Z [2024-05-25T02:57:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:57:00.660743742Z [2024-05-25T02:57:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:57:00.660998746Z [2024-05-25T02:57:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:57:00.862161251Z [2024-05-25T02:57:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:56:00+00:00 exited with status queued for try_number 1 2024-05-25T02:57:00.862311199Z [2024-05-25T02:57:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:56:00+00:00 exited with status queued for try_number 1 2024-05-25T02:57:00.862447547Z [2024-05-25T02:57:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:56:00+00:00 exited with status queued for try_number 1 2024-05-25T02:57:00.870140703Z [2024-05-25T02:57:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to cde4b01e-a96f-4816-8bdc-a8a67adf432d 2024-05-25T02:57:00.870414806Z [2024-05-25T02:57:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 231c53bd-0c14-4ac6-bf8b-a85a829a07cb 2024-05-25T02:57:00.870607318Z [2024-05-25T02:57:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to e59fd4fc-4298-48b1-9df7-8d26429dddf5 2024-05-25T02:57:01.997163486Z [2024-05-25T02:57:01.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:57:01.997601660Z [2024-05-25T02:57:01.997+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:56:00+00:00, run_id=scheduled__2024-05-25T02:56:00+00:00, run_start_date=2024-05-25 02:57:00.582794+00:00, run_end_date=2024-05-25 02:57:01.997240+00:00, run_duration=1.414446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:56:00+00:00, data_interval_end=2024-05-25 02:57:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:57:02.009520079Z [2024-05-25T02:57:02.009+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:57:00+00:00, run_after=2024-05-25T02:58:00+00:00 2024-05-25T02:57:02.057049946Z [2024-05-25T02:57:02.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:56:00+00:00 exited with status success for try_number 1 2024-05-25T02:57:02.064437268Z [2024-05-25T02:57:02.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:56:00+00:00, map_index=-1, run_start_date=2024-05-25 02:57:01.378351+00:00, run_end_date=2024-05-25 02:57:01.795024+00:00, run_duration=0.416673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1054, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:57:00.654830+00:00, queued_by_job_id=1, pid=15467 2024-05-25T02:57:04.574241536Z [2024-05-25T02:57:04.573+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:57:04.574837218Z [2024-05-25T02:57:04.574+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:56:00+00:00, run_id=scheduled__2024-05-25T02:56:00+00:00, run_start_date=2024-05-25 02:57:00.585253+00:00, run_end_date=2024-05-25 02:57:04.574301+00:00, run_duration=3.989048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:56:00+00:00, data_interval_end=2024-05-25 02:57:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:57:04.587221961Z [2024-05-25T02:57:04.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:57:00+00:00, run_after=2024-05-25T02:58:00+00:00 2024-05-25T02:57:04.638442820Z [2024-05-25T02:57:04.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:56:00+00:00 exited with status success for try_number 1 2024-05-25T02:57:04.648211980Z [2024-05-25T02:57:04.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:56:00+00:00, map_index=-1, run_start_date=2024-05-25 02:57:02.628661+00:00, run_end_date=2024-05-25 02:57:04.380923+00:00, run_duration=1.752262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1056, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:57:00.654830+00:00, queued_by_job_id=1, pid=15491 2024-05-25T02:57:05.714040013Z [2024-05-25T02:57:05.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:57:05.714716006Z [2024-05-25T02:57:05.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:56:00+00:00, run_id=scheduled__2024-05-25T02:56:00+00:00, run_start_date=2024-05-25 02:57:00.584107+00:00, run_end_date=2024-05-25 02:57:05.714166+00:00, run_duration=5.130059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:56:00+00:00, data_interval_end=2024-05-25 02:57:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:57:05.727285594Z [2024-05-25T02:57:05.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:57:00+00:00, run_after=2024-05-25T02:58:00+00:00 2024-05-25T02:57:05.762122983Z [2024-05-25T02:57:05.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:56:00+00:00 exited with status success for try_number 1 2024-05-25T02:57:05.768127372Z [2024-05-25T02:57:05.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:56:00+00:00, map_index=-1, run_start_date=2024-05-25 02:57:02.297058+00:00, run_end_date=2024-05-25 02:57:04.610253+00:00, run_duration=2.313195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1055, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:57:00.654830+00:00, queued_by_job_id=1, pid=15480 2024-05-25T02:58:00.032694957Z [2024-05-25T02:58:00.032+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:58:00.042415035Z [2024-05-25T02:58:00.041+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:58:00.072880702Z [2024-05-25T02:58:00.072+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:58:00+00:00, run_after=2024-05-25T02:59:00+00:00 2024-05-25T02:58:00.089493048Z [2024-05-25T02:58:00.089+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:58:00+00:00, run_after=2024-05-25T02:59:00+00:00 2024-05-25T02:58:00.183974518Z [2024-05-25T02:58:00.183+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T02:58:00.184016484Z 2024-05-25T02:58:00.184030391Z 2024-05-25T02:58:00.184039572Z 2024-05-25T02:58:00.184071388Z 2024-05-25T02:58:00.185289070Z [2024-05-25T02:58:00.184+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T02:58:00.185730497Z [2024-05-25T02:58:00.185+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:58:00.186264352Z [2024-05-25T02:58:00.185+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:58:00.186827312Z [2024-05-25T02:58:00.186+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:58:00.188061487Z [2024-05-25T02:58:00.187+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:58:00.188118671Z 2024-05-25T02:58:00.188128307Z 2024-05-25T02:58:00.188136489Z 2024-05-25T02:58:00.188144303Z 2024-05-25T02:58:00.194787269Z [2024-05-25T02:58:00.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:58:00.195440182Z [2024-05-25T02:58:00.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:58:00.196376667Z [2024-05-25T02:58:00.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:58:00.196992534Z [2024-05-25T02:58:00.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:58:00.197885835Z [2024-05-25T02:58:00.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:58:00.198440584Z [2024-05-25T02:58:00.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:58:00.199176098Z [2024-05-25T02:58:00.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:58:00.199643592Z [2024-05-25T02:58:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:58:00.666639157Z [2024-05-25T02:58:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:56:00+00:00 exited with status queued for try_number 1 2024-05-25T02:58:00.666660140Z [2024-05-25T02:58:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:57:00+00:00 exited with status queued for try_number 1 2024-05-25T02:58:00.667001559Z [2024-05-25T02:58:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:57:00+00:00 exited with status queued for try_number 1 2024-05-25T02:58:00.667157140Z [2024-05-25T02:58:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:57:00+00:00 exited with status queued for try_number 1 2024-05-25T02:58:00.684816428Z [2024-05-25T02:58:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to f50a92a8-18cb-40b5-ad47-8d1bc407bb0a 2024-05-25T02:58:00.685140885Z [2024-05-25T02:58:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25dfca24-84ae-4744-8573-5f5844867353 2024-05-25T02:58:00.685604938Z [2024-05-25T02:58:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 133869d6-613e-4f07-ad9c-caecd9300eec 2024-05-25T02:58:00.686271827Z [2024-05-25T02:58:00.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4b7dde7-d60d-4a72-b6c9-76cfa611e2fc 2024-05-25T02:58:02.005725899Z [2024-05-25T02:58:02.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:58:02.006220902Z [2024-05-25T02:58:02.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:57:00+00:00, run_id=scheduled__2024-05-25T02:57:00+00:00, run_start_date=2024-05-25 02:58:00.107099+00:00, run_end_date=2024-05-25 02:58:02.005636+00:00, run_duration=1.898537, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:57:00+00:00, data_interval_end=2024-05-25 02:58:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:58:02.014809268Z [2024-05-25T02:58:02.014+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:58:00+00:00, run_after=2024-05-25T02:59:00+00:00 2024-05-25T02:58:02.021373075Z [2024-05-25T02:58:02.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:58:02.021741374Z [2024-05-25T02:58:02.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:56:00+00:00, run_id=scheduled__2024-05-25T02:56:00+00:00, run_start_date=2024-05-25 02:58:00.104013+00:00, run_end_date=2024-05-25 02:58:02.021281+00:00, run_duration=1.917268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:56:00+00:00, data_interval_end=2024-05-25 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T02:58:02.029102303Z [2024-05-25T02:58:02.028+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T02:58:00+00:00, run_after=2024-05-25T03:00:00+00:00 2024-05-25T02:58:02.073689537Z [2024-05-25T02:58:02.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:56:00+00:00 exited with status success for try_number 1 2024-05-25T02:58:02.073920438Z [2024-05-25T02:58:02.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:57:00+00:00 exited with status success for try_number 1 2024-05-25T02:58:02.079939857Z [2024-05-25T02:58:02.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:56:00+00:00, map_index=-1, run_start_date=2024-05-25 02:58:01.022432+00:00, run_end_date=2024-05-25 02:58:01.392939+00:00, run_duration=0.370507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1058, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:58:00.189615+00:00, queued_by_job_id=1, pid=15519 2024-05-25T02:58:02.080298895Z [2024-05-25T02:58:02.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:57:00+00:00, map_index=-1, run_start_date=2024-05-25 02:58:00.990498+00:00, run_end_date=2024-05-25 02:58:01.419582+00:00, run_duration=0.429084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1057, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:58:00.189615+00:00, queued_by_job_id=1, pid=15518 2024-05-25T02:58:04.211527954Z [2024-05-25T02:58:04.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:58:04.211662962Z [2024-05-25T02:58:04.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:57:00+00:00, run_id=scheduled__2024-05-25T02:57:00+00:00, run_start_date=2024-05-25 02:58:00.109682+00:00, run_end_date=2024-05-25 02:58:04.207879+00:00, run_duration=4.098197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:57:00+00:00, data_interval_end=2024-05-25 02:58:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:58:04.240225293Z [2024-05-25T02:58:04.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:58:00+00:00, run_after=2024-05-25T02:59:00+00:00 2024-05-25T02:58:04.250217089Z [2024-05-25T02:58:04.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:58:04.250666609Z [2024-05-25T02:58:04.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:57:00+00:00, run_id=scheduled__2024-05-25T02:57:00+00:00, run_start_date=2024-05-25 02:58:00.108422+00:00, run_end_date=2024-05-25 02:58:04.250130+00:00, run_duration=4.141708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:57:00+00:00, data_interval_end=2024-05-25 02:58:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:58:04.263923077Z [2024-05-25T02:58:04.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:58:00+00:00, run_after=2024-05-25T02:59:00+00:00 2024-05-25T02:58:04.298379026Z [2024-05-25T02:58:04.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:57:00+00:00 exited with status success for try_number 1 2024-05-25T02:58:04.298433235Z [2024-05-25T02:58:04.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:57:00+00:00 exited with status success for try_number 1 2024-05-25T02:58:04.308016681Z [2024-05-25T02:58:04.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:57:00+00:00, map_index=-1, run_start_date=2024-05-25 02:58:02.026518+00:00, run_end_date=2024-05-25 02:58:03.325094+00:00, run_duration=1.298576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1059, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:58:00.189615+00:00, queued_by_job_id=1, pid=15542 2024-05-25T02:58:04.308584179Z [2024-05-25T02:58:04.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:57:00+00:00, map_index=-1, run_start_date=2024-05-25 02:58:02.153672+00:00, run_end_date=2024-05-25 02:58:03.823014+00:00, run_duration=1.669342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1060, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:58:00.189615+00:00, queued_by_job_id=1, pid=15543 2024-05-25T02:59:00.449041337Z [2024-05-25T02:59:00.448+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T02:59:00.466892994Z [2024-05-25T02:59:00.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:59:00+00:00, run_after=2024-05-25T03:00:00+00:00 2024-05-25T02:59:00.482615676Z [2024-05-25T02:59:00.482+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:59:00+00:00, run_after=2024-05-25T03:00:00+00:00 2024-05-25T02:59:00.595144461Z [2024-05-25T02:59:00.594+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T02:59:00.595167634Z 2024-05-25T02:59:00.595171424Z 2024-05-25T02:59:00.595174690Z 2024-05-25T02:59:00.595465476Z [2024-05-25T02:59:00.595+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:59:00.595753066Z [2024-05-25T02:59:00.595+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T02:59:00.595930626Z [2024-05-25T02:59:00.595+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T02:59:00.596545199Z [2024-05-25T02:59:00.596+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T02:59:00.596561550Z 2024-05-25T02:59:00.596565040Z 2024-05-25T02:59:00.596568208Z 2024-05-25T02:59:00.600315348Z [2024-05-25T02:59:00.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:59:00.600539525Z [2024-05-25T02:59:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:59:00.600847843Z [2024-05-25T02:59:00.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:59:00.601058840Z [2024-05-25T02:59:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:59:00.601375258Z [2024-05-25T02:59:00.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T02:59:00.601663581Z [2024-05-25T02:59:00.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:59:00.857638833Z [2024-05-25T02:59:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:58:00+00:00 exited with status queued for try_number 1 2024-05-25T02:59:00.857720994Z [2024-05-25T02:59:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:58:00+00:00 exited with status queued for try_number 1 2024-05-25T02:59:00.857836059Z [2024-05-25T02:59:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:58:00+00:00 exited with status queued for try_number 1 2024-05-25T02:59:00.866080595Z [2024-05-25T02:59:00.865+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa0cb69b-0aba-4e12-857a-9897940b9f17 2024-05-25T02:59:00.866215093Z [2024-05-25T02:59:00.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1dad88a-0df4-4ab0-ac4b-20ba58792d80 2024-05-25T02:59:00.866371345Z [2024-05-25T02:59:00.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e1ada11-a5e0-486b-9334-340bfe53d4a8 2024-05-25T02:59:02.801985778Z [2024-05-25T02:59:02.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:59:02.802457903Z [2024-05-25T02:59:02.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:58:00+00:00, run_id=scheduled__2024-05-25T02:58:00+00:00, run_start_date=2024-05-25 02:59:00.497806+00:00, run_end_date=2024-05-25 02:59:02.802001+00:00, run_duration=2.304195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:58:00+00:00, data_interval_end=2024-05-25 02:59:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T02:59:02.814465245Z [2024-05-25T02:59:02.814+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T02:59:00+00:00, run_after=2024-05-25T03:00:00+00:00 2024-05-25T02:59:02.884531665Z [2024-05-25T02:59:02.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:58:00+00:00 exited with status success for try_number 1 2024-05-25T02:59:02.891289659Z [2024-05-25T02:59:02.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:58:00+00:00, map_index=-1, run_start_date=2024-05-25 02:59:01.727867+00:00, run_end_date=2024-05-25 02:59:02.171575+00:00, run_duration=0.443708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1061, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:59:00.597356+00:00, queued_by_job_id=1, pid=15575 2024-05-25T02:59:05.041635549Z [2024-05-25T02:59:05.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:59:05.042127319Z [2024-05-25T02:59:05.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:58:00+00:00, run_id=scheduled__2024-05-25T02:58:00+00:00, run_start_date=2024-05-25 02:59:00.501139+00:00, run_end_date=2024-05-25 02:59:05.041690+00:00, run_duration=4.540551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:58:00+00:00, data_interval_end=2024-05-25 02:59:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T02:59:05.055192683Z [2024-05-25T02:59:05.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:59:00+00:00, run_after=2024-05-25T03:00:00+00:00 2024-05-25T02:59:05.065795643Z [2024-05-25T02:59:05.065+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T02:59:05.066234799Z [2024-05-25T02:59:05.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:58:00+00:00, run_id=scheduled__2024-05-25T02:58:00+00:00, run_start_date=2024-05-25 02:59:00.499925+00:00, run_end_date=2024-05-25 02:59:05.065898+00:00, run_duration=4.565973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:58:00+00:00, data_interval_end=2024-05-25 02:59:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T02:59:05.077949900Z [2024-05-25T02:59:05.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T02:59:00+00:00, run_after=2024-05-25T03:00:00+00:00 2024-05-25T02:59:05.122649931Z [2024-05-25T02:59:05.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:58:00+00:00 exited with status success for try_number 1 2024-05-25T02:59:05.122774147Z [2024-05-25T02:59:05.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:58:00+00:00 exited with status success for try_number 1 2024-05-25T02:59:05.132804878Z [2024-05-25T02:59:05.132+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:58:00+00:00, map_index=-1, run_start_date=2024-05-25 02:59:02.991028+00:00, run_end_date=2024-05-25 02:59:04.533541+00:00, run_duration=1.542513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1063, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:59:00.597356+00:00, queued_by_job_id=1, pid=15594 2024-05-25T02:59:05.133447233Z [2024-05-25T02:59:05.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:58:00+00:00, map_index=-1, run_start_date=2024-05-25 02:59:02.840242+00:00, run_end_date=2024-05-25 02:59:04.555210+00:00, run_duration=1.714968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1062, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 02:59:00.597356+00:00, queued_by_job_id=1, pid=15593 2024-05-25T03:00:00.897689148Z [2024-05-25T03:00:00.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:00:00+00:00, run_after=2024-05-25T03:01:00+00:00 2024-05-25T03:00:00.909773550Z [2024-05-25T03:00:00.909+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:00:00.922220880Z [2024-05-25T03:00:00.921+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:00:00.942155748Z [2024-05-25T03:00:00.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:00:00+00:00, run_after=2024-05-25T03:05:00+00:00 2024-05-25T03:00:00.966457193Z [2024-05-25T03:00:00.965+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:00:00+00:00, run_after=2024-05-25T03:01:00+00:00 2024-05-25T03:00:01.113331526Z [2024-05-25T03:00:01.112+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T03:00:01.113375514Z 2024-05-25T03:00:01.113417826Z 2024-05-25T03:00:01.113438318Z 2024-05-25T03:00:01.113447167Z 2024-05-25T03:00:01.113455568Z 2024-05-25T03:00:01.113467882Z [2024-05-25T03:00:01.113+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:00:01.113552104Z [2024-05-25T03:00:01.113+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T03:00:01.113564087Z [2024-05-25T03:00:01.113+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:00:01.113581752Z [2024-05-25T03:00:01.113+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:00:01.113681547Z [2024-05-25T03:00:01.113+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:00:01.114771148Z [2024-05-25T03:00:01.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:00:01.114795337Z 2024-05-25T03:00:01.114802637Z 2024-05-25T03:00:01.114809781Z 2024-05-25T03:00:01.114815566Z 2024-05-25T03:00:01.114820857Z 2024-05-25T03:00:01.119634052Z [2024-05-25T03:00:01.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T03:00:01.119805942Z [2024-05-25T03:00:01.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:00:01.120187754Z [2024-05-25T03:00:01.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:00:01.120414043Z [2024-05-25T03:00:01.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:00:01.120819427Z [2024-05-25T03:00:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:00:01.120932630Z [2024-05-25T03:00:01.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:00:01.121199787Z [2024-05-25T03:00:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:00:01.121455159Z [2024-05-25T03:00:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:00:01.121783988Z [2024-05-25T03:00:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:00:01.121998071Z [2024-05-25T03:00:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:00:01.813135205Z [2024-05-25T03:00:01.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status queued for try_number 1 2024-05-25T03:00:01.813455990Z [2024-05-25T03:00:01.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:58:00+00:00 exited with status queued for try_number 1 2024-05-25T03:00:01.813748491Z [2024-05-25T03:00:01.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:59:00+00:00 exited with status queued for try_number 1 2024-05-25T03:00:01.813952553Z [2024-05-25T03:00:01.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:59:00+00:00 exited with status queued for try_number 1 2024-05-25T03:00:01.814123151Z [2024-05-25T03:00:01.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:59:00+00:00 exited with status queued for try_number 1 2024-05-25T03:00:01.831442534Z [2024-05-25T03:00:01.831+0000] {scheduler_job.py:635} INFO - Setting external_id for to efaf5eb1-dc60-468a-bcad-4264f061f76c 2024-05-25T03:00:01.832582704Z [2024-05-25T03:00:01.832+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b3f5d91-e990-4b50-91a3-161621b141ad 2024-05-25T03:00:01.832973615Z [2024-05-25T03:00:01.832+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a3826ad-ebd2-4212-88c6-98fd1456c3e9 2024-05-25T03:00:01.833276259Z [2024-05-25T03:00:01.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e62ec4e-8b9c-439b-ab1c-cea432912e46 2024-05-25T03:00:01.833516397Z [2024-05-25T03:00:01.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f69237c-efce-484b-846a-6cbf69e724c4 2024-05-25T03:00:03.886692785Z [2024-05-25T03:00:03.880+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:00:03.886723760Z [2024-05-25T03:00:03.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 02:59:00+00:00, run_id=scheduled__2024-05-25T02:59:00+00:00, run_start_date=2024-05-25 03:00:00.996801+00:00, run_end_date=2024-05-25 03:00:03.880387+00:00, run_duration=2.883586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:59:00+00:00, data_interval_end=2024-05-25 03:00:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:00:03.935802798Z [2024-05-25T03:00:03.901+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:00:00+00:00, run_after=2024-05-25T03:01:00+00:00 2024-05-25T03:00:03.945378030Z [2024-05-25T03:00:03.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:00:03.945402366Z [2024-05-25T03:00:03.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 02:58:00+00:00, run_id=scheduled__2024-05-25T02:58:00+00:00, run_start_date=2024-05-25 03:00:00.993550+00:00, run_end_date=2024-05-25 03:00:03.942765+00:00, run_duration=2.949215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:58:00+00:00, data_interval_end=2024-05-25 03:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T03:00:03.964147826Z [2024-05-25T03:00:03.954+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T03:00:00+00:00, run_after=2024-05-25T03:02:00+00:00 2024-05-25T03:00:04.051819318Z [2024-05-25T03:00:04.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T02:58:00+00:00 exited with status success for try_number 1 2024-05-25T03:00:04.051860563Z [2024-05-25T03:00:04.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:59:00+00:00 exited with status success for try_number 1 2024-05-25T03:00:04.065265827Z [2024-05-25T03:00:04.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:59:00+00:00, map_index=-1, run_start_date=2024-05-25 03:00:02.182660+00:00, run_end_date=2024-05-25 03:00:03.014330+00:00, run_duration=0.83167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1064, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:00:01.116125+00:00, queued_by_job_id=1, pid=15629 2024-05-25T03:00:04.065467062Z [2024-05-25T03:00:04.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T02:58:00+00:00, map_index=-1, run_start_date=2024-05-25 03:00:02.578500+00:00, run_end_date=2024-05-25 03:00:03.108053+00:00, run_duration=0.529553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1065, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:00:01.116125+00:00, queued_by_job_id=1, pid=15631 2024-05-25T03:00:05.175407339Z [2024-05-25T03:00:05.174+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:00:05.175438501Z 2024-05-25T03:00:05.175759459Z [2024-05-25T03:00:05.175+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:00:05.176786301Z [2024-05-25T03:00:05.176+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:00:05.176800454Z 2024-05-25T03:00:05.182475054Z [2024-05-25T03:00:05.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T03:00:05.182798702Z [2024-05-25T03:00:05.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:00:05.260101256Z [2024-05-25T03:00:05.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status queued for try_number 1 2024-05-25T03:00:05.260154056Z [2024-05-25T03:00:05.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status success for try_number 1 2024-05-25T03:00:05.268118760Z [2024-05-25T03:00:05.267+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b11501e-19d4-4bbe-890e-bef5e8bbada5 2024-05-25T03:00:05.268221400Z [2024-05-25T03:00:05.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T02:55:00+00:00, map_index=-1, run_start_date=2024-05-25 03:00:03.372427+00:00, run_end_date=2024-05-25 03:00:03.844156+00:00, run_duration=0.471729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1066, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:00:01.116125+00:00, queued_by_job_id=1, pid=15654 2024-05-25T03:00:05.310954405Z [2024-05-25T03:00:05.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:00:05.311348500Z [2024-05-25T03:00:05.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:59:00+00:00, run_id=scheduled__2024-05-25T02:59:00+00:00, run_start_date=2024-05-25 03:00:00.998748+00:00, run_end_date=2024-05-25 03:00:05.310876+00:00, run_duration=4.312128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:59:00+00:00, data_interval_end=2024-05-25 03:00:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:00:05.322825201Z [2024-05-25T03:00:05.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:00:00+00:00, run_after=2024-05-25T03:01:00+00:00 2024-05-25T03:00:05.332015041Z [2024-05-25T03:00:05.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:00:05.332157091Z [2024-05-25T03:00:05.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:59:00+00:00, run_id=scheduled__2024-05-25T02:59:00+00:00, run_start_date=2024-05-25 03:00:01.004293+00:00, run_end_date=2024-05-25 03:00:05.331866+00:00, run_duration=4.327573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:59:00+00:00, data_interval_end=2024-05-25 03:00:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:00:05.340739109Z [2024-05-25T03:00:05.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:00:00+00:00, run_after=2024-05-25T03:01:00+00:00 2024-05-25T03:00:05.409829985Z [2024-05-25T03:00:05.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:59:00+00:00 exited with status success for try_number 1 2024-05-25T03:00:05.420936887Z [2024-05-25T03:00:05.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:59:00+00:00, map_index=-1, run_start_date=2024-05-25 03:00:03.509519+00:00, run_end_date=2024-05-25 03:00:05.132877+00:00, run_duration=1.623358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1067, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:00:01.116125+00:00, queued_by_job_id=1, pid=15655 2024-05-25T03:00:06.537910263Z [2024-05-25T03:00:06.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T02:59:00+00:00 exited with status success for try_number 1 2024-05-25T03:00:06.537935340Z [2024-05-25T03:00:06.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T02:59:00+00:00, map_index=-1, run_start_date=2024-05-25 03:00:04.075713+00:00, run_end_date=2024-05-25 03:00:05.273029+00:00, run_duration=1.197316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1068, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:00:01.116125+00:00, queued_by_job_id=1, pid=15671 2024-05-25T03:00:07.595947750Z [2024-05-25T03:00:07.595+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:00:07.595987451Z 2024-05-25T03:00:07.596095527Z [2024-05-25T03:00:07.595+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:00:07.596883299Z [2024-05-25T03:00:07.596+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:00:07.596920165Z 2024-05-25T03:00:07.599409331Z [2024-05-25T03:00:07.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T02:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T03:00:07.599607270Z [2024-05-25T03:00:07.599+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T03:00:07.669560116Z [2024-05-25T03:00:07.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status queued for try_number 1 2024-05-25T03:00:07.669783320Z [2024-05-25T03:00:07.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status success for try_number 1 2024-05-25T03:00:07.677736780Z [2024-05-25T03:00:07.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to c36aed55-4e0d-4f0b-a233-ae0dbf98d862 2024-05-25T03:00:07.678068418Z [2024-05-25T03:00:07.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T02:55:00+00:00, map_index=-1, run_start_date=2024-05-25 03:00:06.863804+00:00, run_end_date=2024-05-25 03:00:07.231299+00:00, run_duration=0.367495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1069, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:00:05.177429+00:00, queued_by_job_id=1, pid=15694 2024-05-25T03:00:09.936822795Z [2024-05-25T03:00:09.936+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:00:09.936876997Z 2024-05-25T03:00:09.937370237Z [2024-05-25T03:00:09.936+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:00:09.938147436Z [2024-05-25T03:00:09.937+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:00:09.938159974Z 2024-05-25T03:00:09.941482801Z [2024-05-25T03:00:09.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:00:09.941764658Z [2024-05-25T03:00:09.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:00:10.006344923Z [2024-05-25T03:00:10.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status queued for try_number 1 2024-05-25T03:00:10.006377866Z [2024-05-25T03:00:10.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status success for try_number 1 2024-05-25T03:00:10.016033919Z [2024-05-25T03:00:10.015+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2dde633a-1789-4af7-993b-6b5c748c199e 2024-05-25T03:00:10.016240363Z [2024-05-25T03:00:10.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T02:55:00+00:00, map_index=0, run_start_date=2024-05-25 03:00:09.398928+00:00, run_end_date=2024-05-25 03:00:09.772282+00:00, run_duration=0.373354, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1070, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:00:07.597046+00:00, queued_by_job_id=1, pid=15705 2024-05-25T03:00:12.262977493Z [2024-05-25T03:00:12.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:00:12.263299013Z [2024-05-25T03:00:12.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 02:55:00+00:00, run_id=scheduled__2024-05-25T02:55:00+00:00, run_start_date=2024-05-25 03:00:00.988451+00:00, run_end_date=2024-05-25 03:00:12.262885+00:00, run_duration=11.274434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 02:55:00+00:00, data_interval_end=2024-05-25 03:00:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T03:00:12.308631971Z [2024-05-25T03:00:12.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:00:00+00:00, run_after=2024-05-25T03:05:00+00:00 2024-05-25T03:00:12.359539256Z [2024-05-25T03:00:12.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T02:55:00+00:00 exited with status success for try_number 1 2024-05-25T03:00:12.366838633Z [2024-05-25T03:00:12.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T02:55:00+00:00, map_index=-1, run_start_date=2024-05-25 03:00:11.536852+00:00, run_end_date=2024-05-25 03:00:11.923482+00:00, run_duration=0.38663, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1071, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:00:09.938679+00:00, queued_by_job_id=1, pid=15713 2024-05-25T03:00:30.076969891Z [2024-05-25T03:00:30.076+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:00:30.077038148Z 2024-05-25T03:00:30.077048292Z [2024-05-25T03:00:30.076+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-05-25T03:00:30.077677843Z [2024-05-25T03:00:30.077+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:00:30.077734492Z 2024-05-25T03:00:30.080166413Z [2024-05-25T03:00:30.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240525030029_830642', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:00:30.080659888Z [2024-05-25T03:00:30.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240525030029_830642', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-25T03:00:30.152414267Z [2024-05-25T03:00:30.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240525030029_830642 exited with status queued for try_number 1 2024-05-25T03:00:30.159288038Z [2024-05-25T03:00:30.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93f0d34a-5db9-4107-ae36-4c3349a48efd 2024-05-25T03:00:30.586087781Z [2024-05-25T03:00:30.585+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T03:00:31.641563422Z [2024-05-25T03:00:31.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:00:31.641895920Z [2024-05-25T03:00:31.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-05-25 03:00:29.945727+00:00, run_id=vdu_alarm_20240525030029_830642, run_start_date=2024-05-25 03:00:30.043262+00:00, run_end_date=2024-05-25 03:00:31.641336+00:00, run_duration=1.598074, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-25 03:00:29.945727+00:00, data_interval_end=2024-05-25 03:00:29.945727+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-05-25T03:00:31.644797492Z [2024-05-25T03:00:31.644+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-05-25T03:00:31.677047743Z [2024-05-25T03:00:31.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240525030029_830642 exited with status success for try_number 1 2024-05-25T03:00:31.685490675Z [2024-05-25T03:00:31.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240525030029_830642, map_index=-1, run_start_date=2024-05-25 03:00:30.743754+00:00, run_end_date=2024-05-25 03:00:31.176252+00:00, run_duration=0.432498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1072, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:00:30.077989+00:00, queued_by_job_id=1, pid=15715 2024-05-25T03:01:00.273409444Z [2024-05-25T03:01:00.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:01:00+00:00, run_after=2024-05-25T03:02:00+00:00 2024-05-25T03:01:00.293462041Z [2024-05-25T03:01:00.293+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:01:00+00:00, run_after=2024-05-25T03:02:00+00:00 2024-05-25T03:01:00.303138885Z [2024-05-25T03:01:00.302+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:01:00.387469822Z [2024-05-25T03:01:00.386+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T03:01:00.387579349Z 2024-05-25T03:01:00.387595082Z 2024-05-25T03:01:00.387605210Z 2024-05-25T03:01:00.387614638Z [2024-05-25T03:01:00.387+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:01:00.387665799Z [2024-05-25T03:01:00.387+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:01:00.387752423Z [2024-05-25T03:01:00.387+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:01:00.388538251Z [2024-05-25T03:01:00.388+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:01:00.388560910Z 2024-05-25T03:01:00.388570635Z 2024-05-25T03:01:00.388579611Z 2024-05-25T03:01:00.392368865Z [2024-05-25T03:01:00.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:01:00.392466224Z [2024-05-25T03:01:00.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:01:00.392764082Z [2024-05-25T03:01:00.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:01:00.392836191Z [2024-05-25T03:01:00.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:01:00.393160151Z [2024-05-25T03:01:00.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:01:00.393233171Z [2024-05-25T03:01:00.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:01:00.616587409Z [2024-05-25T03:01:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status queued for try_number 1 2024-05-25T03:01:00.616760199Z [2024-05-25T03:01:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status queued for try_number 1 2024-05-25T03:01:00.616932453Z [2024-05-25T03:01:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status queued for try_number 1 2024-05-25T03:01:00.626469999Z [2024-05-25T03:01:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 878c9d06-b111-4457-9a7f-c1f9020d813c 2024-05-25T03:01:00.626848977Z [2024-05-25T03:01:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 096be35e-cdd0-407e-b036-9e4bc36770fb 2024-05-25T03:01:00.627050909Z [2024-05-25T03:01:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f6671c3-5eb7-486e-a9c6-826348c4f1ef 2024-05-25T03:01:01.762794771Z [2024-05-25T03:01:01.761+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:01:01.763311273Z [2024-05-25T03:01:01.763+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:00:00+00:00, run_id=scheduled__2024-05-25T03:00:00+00:00, run_start_date=2024-05-25 03:01:00.318736+00:00, run_end_date=2024-05-25 03:01:01.762894+00:00, run_duration=1.444158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:00:00+00:00, data_interval_end=2024-05-25 03:01:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:01:01.774641295Z [2024-05-25T03:01:01.774+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:01:00+00:00, run_after=2024-05-25T03:02:00+00:00 2024-05-25T03:01:01.828800413Z [2024-05-25T03:01:01.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status success for try_number 1 2024-05-25T03:01:01.834035138Z [2024-05-25T03:01:01.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:00:00+00:00, map_index=-1, run_start_date=2024-05-25 03:01:01.244614+00:00, run_end_date=2024-05-25 03:01:01.651693+00:00, run_duration=0.407079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1073, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:01:00.389322+00:00, queued_by_job_id=1, pid=15729 2024-05-25T03:01:03.675833719Z [2024-05-25T03:01:03.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:01:03.676130566Z [2024-05-25T03:01:03.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:00:00+00:00, run_id=scheduled__2024-05-25T03:00:00+00:00, run_start_date=2024-05-25 03:01:00.320598+00:00, run_end_date=2024-05-25 03:01:03.675646+00:00, run_duration=3.355048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:00:00+00:00, data_interval_end=2024-05-25 03:01:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:01:03.687321459Z [2024-05-25T03:01:03.686+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:01:00+00:00, run_after=2024-05-25T03:02:00+00:00 2024-05-25T03:01:03.734216602Z [2024-05-25T03:01:03.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status success for try_number 1 2024-05-25T03:01:03.740335911Z [2024-05-25T03:01:03.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:00:00+00:00, map_index=-1, run_start_date=2024-05-25 03:01:02.125758+00:00, run_end_date=2024-05-25 03:01:03.423896+00:00, run_duration=1.298138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1074, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:01:00.389322+00:00, queued_by_job_id=1, pid=15742 2024-05-25T03:01:04.810056646Z [2024-05-25T03:01:04.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:01:04.810441125Z [2024-05-25T03:01:04.810+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:00:00+00:00, run_id=scheduled__2024-05-25T03:00:00+00:00, run_start_date=2024-05-25 03:01:00.321906+00:00, run_end_date=2024-05-25 03:01:04.810136+00:00, run_duration=4.48823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:00:00+00:00, data_interval_end=2024-05-25 03:01:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:01:04.822019325Z [2024-05-25T03:01:04.821+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:01:00+00:00, run_after=2024-05-25T03:02:00+00:00 2024-05-25T03:01:04.860550600Z [2024-05-25T03:01:04.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status success for try_number 1 2024-05-25T03:01:04.868779111Z [2024-05-25T03:01:04.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:00:00+00:00, map_index=-1, run_start_date=2024-05-25 03:01:02.541719+00:00, run_end_date=2024-05-25 03:01:04.411017+00:00, run_duration=1.869298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1075, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:01:00.389322+00:00, queued_by_job_id=1, pid=15753 2024-05-25T03:02:00.684478611Z [2024-05-25T03:02:00.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:02:00+00:00, run_after=2024-05-25T03:03:00+00:00 2024-05-25T03:02:00.693617637Z [2024-05-25T03:02:00.693+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:02:00.707583284Z [2024-05-25T03:02:00.707+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:02:00+00:00, run_after=2024-05-25T03:03:00+00:00 2024-05-25T03:02:00.716853585Z [2024-05-25T03:02:00.716+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:02:00.841898369Z [2024-05-25T03:02:00.841+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T03:02:00.841958119Z 2024-05-25T03:02:00.841964602Z 2024-05-25T03:02:00.841969198Z 2024-05-25T03:02:00.841973516Z 2024-05-25T03:02:00.842186361Z [2024-05-25T03:02:00.841+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T03:02:00.842495175Z [2024-05-25T03:02:00.842+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:02:00.842825098Z [2024-05-25T03:02:00.842+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:02:00.843076010Z [2024-05-25T03:02:00.842+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:02:00.843993350Z [2024-05-25T03:02:00.843+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:02:00.844006450Z 2024-05-25T03:02:00.844014278Z 2024-05-25T03:02:00.844020347Z 2024-05-25T03:02:00.844026631Z 2024-05-25T03:02:00.850490401Z [2024-05-25T03:02:00.850+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:02:00.850919052Z [2024-05-25T03:02:00.850+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:02:00.851290134Z [2024-05-25T03:02:00.851+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:02:00.851506040Z [2024-05-25T03:02:00.851+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:02:00.851893795Z [2024-05-25T03:02:00.851+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:02:00.852033149Z [2024-05-25T03:02:00.851+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:02:00.852299004Z [2024-05-25T03:02:00.852+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:02:00.852428949Z [2024-05-25T03:02:00.852+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:02:01.190060107Z [2024-05-25T03:02:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status queued for try_number 1 2024-05-25T03:02:01.190162077Z [2024-05-25T03:02:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:01:00+00:00 exited with status queued for try_number 1 2024-05-25T03:02:01.190197291Z [2024-05-25T03:02:01.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:01:00+00:00 exited with status queued for try_number 1 2024-05-25T03:02:01.190205849Z [2024-05-25T03:02:01.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:01:00+00:00 exited with status queued for try_number 1 2024-05-25T03:02:01.214909445Z [2024-05-25T03:02:01.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53a5eeb6-e864-40f7-9bfe-c91daa0de531 2024-05-25T03:02:01.215041781Z [2024-05-25T03:02:01.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to 300825bf-a2c7-4690-bc07-96b0d2dd6250 2024-05-25T03:02:01.215112648Z [2024-05-25T03:02:01.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c709c7b-c07d-4059-8d36-295001b72f66 2024-05-25T03:02:01.215207443Z [2024-05-25T03:02:01.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to d71de4b4-1627-457f-921d-e337e67e12e4 2024-05-25T03:02:02.424002180Z [2024-05-25T03:02:02.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:02:02.425048930Z [2024-05-25T03:02:02.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 03:00:00+00:00, run_id=scheduled__2024-05-25T03:00:00+00:00, run_start_date=2024-05-25 03:02:00.732560+00:00, run_end_date=2024-05-25 03:02:02.424648+00:00, run_duration=1.692088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:00:00+00:00, data_interval_end=2024-05-25 03:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T03:02:02.435128442Z [2024-05-25T03:02:02.434+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T03:02:00+00:00, run_after=2024-05-25T03:04:00+00:00 2024-05-25T03:02:02.488789431Z [2024-05-25T03:02:02.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status success for try_number 1 2024-05-25T03:02:02.495313285Z [2024-05-25T03:02:02.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T03:00:00+00:00, map_index=-1, run_start_date=2024-05-25 03:02:01.682001+00:00, run_end_date=2024-05-25 03:02:02.138905+00:00, run_duration=0.456904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1076, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:02:00.845782+00:00, queued_by_job_id=1, pid=15782 2024-05-25T03:02:03.536718522Z [2024-05-25T03:02:03.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:02:03.537179196Z [2024-05-25T03:02:03.536+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:01:00+00:00, run_id=scheduled__2024-05-25T03:01:00+00:00, run_start_date=2024-05-25 03:02:00.734570+00:00, run_end_date=2024-05-25 03:02:03.536846+00:00, run_duration=2.802276, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:01:00+00:00, data_interval_end=2024-05-25 03:02:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:02:03.546448556Z [2024-05-25T03:02:03.546+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:02:00+00:00, run_after=2024-05-25T03:03:00+00:00 2024-05-25T03:02:03.607457921Z [2024-05-25T03:02:03.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:01:00+00:00 exited with status success for try_number 1 2024-05-25T03:02:03.616438920Z [2024-05-25T03:02:03.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:01:00+00:00, map_index=-1, run_start_date=2024-05-25 03:02:01.820154+00:00, run_end_date=2024-05-25 03:02:02.498485+00:00, run_duration=0.678331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1077, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:02:00.845782+00:00, queued_by_job_id=1, pid=15783 2024-05-25T03:02:04.697799430Z [2024-05-25T03:02:04.696+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:02:04.698609162Z [2024-05-25T03:02:04.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:01:00+00:00, run_id=scheduled__2024-05-25T03:01:00+00:00, run_start_date=2024-05-25 03:02:00.736640+00:00, run_end_date=2024-05-25 03:02:04.697670+00:00, run_duration=3.96103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:01:00+00:00, data_interval_end=2024-05-25 03:02:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:02:04.719763024Z [2024-05-25T03:02:04.719+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:02:00+00:00, run_after=2024-05-25T03:03:00+00:00 2024-05-25T03:02:04.795923933Z [2024-05-25T03:02:04.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:01:00+00:00 exited with status success for try_number 1 2024-05-25T03:02:04.803712330Z [2024-05-25T03:02:04.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:01:00+00:00, map_index=-1, run_start_date=2024-05-25 03:02:03.034602+00:00, run_end_date=2024-05-25 03:02:04.337894+00:00, run_duration=1.303292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1078, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:02:00.845782+00:00, queued_by_job_id=1, pid=15806 2024-05-25T03:02:05.873491282Z [2024-05-25T03:02:05.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:02:05.873978116Z [2024-05-25T03:02:05.873+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:01:00+00:00, run_id=scheduled__2024-05-25T03:01:00+00:00, run_start_date=2024-05-25 03:02:00.738107+00:00, run_end_date=2024-05-25 03:02:05.873380+00:00, run_duration=5.135273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:01:00+00:00, data_interval_end=2024-05-25 03:02:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:02:05.892163474Z [2024-05-25T03:02:05.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:02:00+00:00, run_after=2024-05-25T03:03:00+00:00 2024-05-25T03:02:05.933333301Z [2024-05-25T03:02:05.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:01:00+00:00 exited with status success for try_number 1 2024-05-25T03:02:05.946731274Z [2024-05-25T03:02:05.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:01:00+00:00, map_index=-1, run_start_date=2024-05-25 03:02:03.138498+00:00, run_end_date=2024-05-25 03:02:04.902271+00:00, run_duration=1.763773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1079, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:02:00.845782+00:00, queued_by_job_id=1, pid=15807 2024-05-25T03:03:00.712185396Z [2024-05-25T03:03:00.711+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:03:00+00:00, run_after=2024-05-25T03:04:00+00:00 2024-05-25T03:03:00.722895378Z [2024-05-25T03:03:00.722+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:03:00.738234912Z [2024-05-25T03:03:00.737+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:03:00+00:00, run_after=2024-05-25T03:04:00+00:00 2024-05-25T03:03:00.819631707Z [2024-05-25T03:03:00.819+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T03:03:00.819708215Z 2024-05-25T03:03:00.819716235Z 2024-05-25T03:03:00.819721804Z 2024-05-25T03:03:00.819740008Z [2024-05-25T03:03:00.819+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:03:00.819848369Z [2024-05-25T03:03:00.819+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:03:00.819985915Z [2024-05-25T03:03:00.819+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:03:00.820728710Z [2024-05-25T03:03:00.820+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:03:00.820738956Z 2024-05-25T03:03:00.820744446Z 2024-05-25T03:03:00.820750309Z 2024-05-25T03:03:00.825431944Z [2024-05-25T03:03:00.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:03:00.825550931Z [2024-05-25T03:03:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:03:00.825788974Z [2024-05-25T03:03:00.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:03:00.825883790Z [2024-05-25T03:03:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:03:00.826115346Z [2024-05-25T03:03:00.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:03:00.826267772Z [2024-05-25T03:03:00.826+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:03:01.025990476Z [2024-05-25T03:03:01.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:02:00+00:00 exited with status queued for try_number 1 2024-05-25T03:03:01.026018886Z [2024-05-25T03:03:01.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:02:00+00:00 exited with status queued for try_number 1 2024-05-25T03:03:01.026076282Z [2024-05-25T03:03:01.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:02:00+00:00 exited with status queued for try_number 1 2024-05-25T03:03:01.034338309Z [2024-05-25T03:03:01.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3aaf08a6-4b99-4ec6-ac6b-3676791eb7a8 2024-05-25T03:03:01.034433441Z [2024-05-25T03:03:01.034+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab95374f-ac8b-4ffc-bd7e-3821970e9d34 2024-05-25T03:03:01.034520338Z [2024-05-25T03:03:01.034+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fa16212-7b70-48ee-88a6-9ef8f6ec8ca5 2024-05-25T03:03:02.172746756Z [2024-05-25T03:03:02.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:03:02.173064556Z [2024-05-25T03:03:02.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:02:00+00:00, run_id=scheduled__2024-05-25T03:02:00+00:00, run_start_date=2024-05-25 03:03:00.750495+00:00, run_end_date=2024-05-25 03:03:02.172606+00:00, run_duration=1.422111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:02:00+00:00, data_interval_end=2024-05-25 03:03:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:03:02.183878162Z [2024-05-25T03:03:02.183+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:03:00+00:00, run_after=2024-05-25T03:04:00+00:00 2024-05-25T03:03:03.435063787Z [2024-05-25T03:03:03.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:02:00+00:00 exited with status success for try_number 1 2024-05-25T03:03:03.444069881Z [2024-05-25T03:03:03.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:02:00+00:00, map_index=-1, run_start_date=2024-05-25 03:03:01.718029+00:00, run_end_date=2024-05-25 03:03:02.082251+00:00, run_duration=0.364222, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1080, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:03:00.821751+00:00, queued_by_job_id=1, pid=15839 2024-05-25T03:03:04.487602304Z [2024-05-25T03:03:04.487+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:03:04.487849978Z [2024-05-25T03:03:04.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:02:00+00:00, run_id=scheduled__2024-05-25T03:02:00+00:00, run_start_date=2024-05-25 03:03:00.751844+00:00, run_end_date=2024-05-25 03:03:04.487444+00:00, run_duration=3.7356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:02:00+00:00, data_interval_end=2024-05-25 03:03:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:03:04.498327094Z [2024-05-25T03:03:04.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:03:00+00:00, run_after=2024-05-25T03:04:00+00:00 2024-05-25T03:03:04.511911777Z [2024-05-25T03:03:04.511+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:03:04.512548898Z [2024-05-25T03:03:04.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:02:00+00:00, run_id=scheduled__2024-05-25T03:02:00+00:00, run_start_date=2024-05-25 03:03:00.753019+00:00, run_end_date=2024-05-25 03:03:04.511989+00:00, run_duration=3.75897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:02:00+00:00, data_interval_end=2024-05-25 03:03:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:03:04.530465166Z [2024-05-25T03:03:04.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:03:00+00:00, run_after=2024-05-25T03:04:00+00:00 2024-05-25T03:03:04.587396367Z [2024-05-25T03:03:04.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:02:00+00:00 exited with status success for try_number 1 2024-05-25T03:03:04.587685856Z [2024-05-25T03:03:04.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:02:00+00:00 exited with status success for try_number 1 2024-05-25T03:03:04.604790541Z [2024-05-25T03:03:04.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:02:00+00:00, map_index=-1, run_start_date=2024-05-25 03:03:02.547629+00:00, run_end_date=2024-05-25 03:03:03.751167+00:00, run_duration=1.203538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1081, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:03:00.821751+00:00, queued_by_job_id=1, pid=15857 2024-05-25T03:03:04.605135614Z [2024-05-25T03:03:04.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:02:00+00:00, map_index=-1, run_start_date=2024-05-25 03:03:02.671258+00:00, run_end_date=2024-05-25 03:03:04.246325+00:00, run_duration=1.575067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1082, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:03:00.821751+00:00, queued_by_job_id=1, pid=15858 2024-05-25T03:04:00.376496606Z [2024-05-25T03:04:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:04:00+00:00, run_after=2024-05-25T03:05:00+00:00 2024-05-25T03:04:00.386792846Z [2024-05-25T03:04:00.386+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:04:00.420050788Z [2024-05-25T03:04:00.419+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:04:00+00:00, run_after=2024-05-25T03:05:00+00:00 2024-05-25T03:04:00.429831266Z [2024-05-25T03:04:00.429+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:04:00.525092636Z [2024-05-25T03:04:00.524+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T03:04:00.525121898Z 2024-05-25T03:04:00.525128157Z 2024-05-25T03:04:00.525133154Z 2024-05-25T03:04:00.525138019Z 2024-05-25T03:04:00.525144217Z [2024-05-25T03:04:00.524+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T03:04:00.525275002Z [2024-05-25T03:04:00.525+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:04:00.525492941Z [2024-05-25T03:04:00.525+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:04:00.525663049Z [2024-05-25T03:04:00.525+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:04:00.526322755Z [2024-05-25T03:04:00.526+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:04:00.526335678Z 2024-05-25T03:04:00.526339550Z 2024-05-25T03:04:00.526343101Z 2024-05-25T03:04:00.526364110Z 2024-05-25T03:04:00.530098707Z [2024-05-25T03:04:00.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:04:00.530281791Z [2024-05-25T03:04:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:04:00.530548049Z [2024-05-25T03:04:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:04:00.530631722Z [2024-05-25T03:04:00.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:04:00.530798100Z [2024-05-25T03:04:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:04:00.530851919Z [2024-05-25T03:04:00.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:04:00.531078582Z [2024-05-25T03:04:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:04:00.531196575Z [2024-05-25T03:04:00.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:04:01.030646538Z [2024-05-25T03:04:01.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:02:00+00:00 exited with status queued for try_number 1 2024-05-25T03:04:01.030684253Z [2024-05-25T03:04:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:03:00+00:00 exited with status queued for try_number 1 2024-05-25T03:04:01.030716178Z [2024-05-25T03:04:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:03:00+00:00 exited with status queued for try_number 1 2024-05-25T03:04:01.030724055Z [2024-05-25T03:04:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:03:00+00:00 exited with status queued for try_number 1 2024-05-25T03:04:01.054580799Z [2024-05-25T03:04:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 870e2ef4-ef46-4816-a3f3-9191992defe5 2024-05-25T03:04:01.054771665Z [2024-05-25T03:04:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 202d059f-9772-497d-9f8d-89895eba37a3 2024-05-25T03:04:01.054963660Z [2024-05-25T03:04:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dc591ae-deaa-4649-8f1d-c58a0ee40ee3 2024-05-25T03:04:01.055088892Z [2024-05-25T03:04:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75e874a2-0022-4c75-9cca-6b6ea854f858 2024-05-25T03:04:01.824874003Z [2024-05-25T03:04:01.824+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:04:01.825478874Z [2024-05-25T03:04:01.825+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:03:00+00:00, run_id=scheduled__2024-05-25T03:03:00+00:00, run_start_date=2024-05-25 03:04:00.443605+00:00, run_end_date=2024-05-25 03:04:01.825016+00:00, run_duration=1.381411, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:03:00+00:00, data_interval_end=2024-05-25 03:04:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:04:01.838779518Z [2024-05-25T03:04:01.838+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:04:00+00:00, run_after=2024-05-25T03:05:00+00:00 2024-05-25T03:04:03.024289288Z [2024-05-25T03:04:03.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:04:03.024581858Z [2024-05-25T03:04:03.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 03:02:00+00:00, run_id=scheduled__2024-05-25T03:02:00+00:00, run_start_date=2024-05-25 03:04:00.442178+00:00, run_end_date=2024-05-25 03:04:03.024190+00:00, run_duration=2.582012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:02:00+00:00, data_interval_end=2024-05-25 03:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T03:04:03.033010990Z [2024-05-25T03:04:03.032+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T03:04:00+00:00, run_after=2024-05-25T03:06:00+00:00 2024-05-25T03:04:03.124925069Z [2024-05-25T03:04:03.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:02:00+00:00 exited with status success for try_number 1 2024-05-25T03:04:03.125448476Z [2024-05-25T03:04:03.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:03:00+00:00 exited with status success for try_number 1 2024-05-25T03:04:03.131261872Z [2024-05-25T03:04:03.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:03:00+00:00, map_index=-1, run_start_date=2024-05-25 03:04:01.385190+00:00, run_end_date=2024-05-25 03:04:01.795659+00:00, run_duration=0.410469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1083, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:04:00.527191+00:00, queued_by_job_id=1, pid=15891 2024-05-25T03:04:03.131500445Z [2024-05-25T03:04:03.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T03:02:00+00:00, map_index=-1, run_start_date=2024-05-25 03:04:01.754585+00:00, run_end_date=2024-05-25 03:04:02.137741+00:00, run_duration=0.383156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1084, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:04:00.527191+00:00, queued_by_job_id=1, pid=15897 2024-05-25T03:04:05.289682315Z [2024-05-25T03:04:05.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:04:05.289885844Z [2024-05-25T03:04:05.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:03:00+00:00, run_id=scheduled__2024-05-25T03:03:00+00:00, run_start_date=2024-05-25 03:04:00.444795+00:00, run_end_date=2024-05-25 03:04:05.289455+00:00, run_duration=4.84466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:03:00+00:00, data_interval_end=2024-05-25 03:04:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:04:05.303118206Z [2024-05-25T03:04:05.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:04:00+00:00, run_after=2024-05-25T03:05:00+00:00 2024-05-25T03:04:05.313104321Z [2024-05-25T03:04:05.312+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:04:05.313175184Z [2024-05-25T03:04:05.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:03:00+00:00, run_id=scheduled__2024-05-25T03:03:00+00:00, run_start_date=2024-05-25 03:04:00.446024+00:00, run_end_date=2024-05-25 03:04:05.312783+00:00, run_duration=4.866759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:03:00+00:00, data_interval_end=2024-05-25 03:04:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:04:05.322520519Z [2024-05-25T03:04:05.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:04:00+00:00, run_after=2024-05-25T03:05:00+00:00 2024-05-25T03:04:05.366609567Z [2024-05-25T03:04:05.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:03:00+00:00 exited with status success for try_number 1 2024-05-25T03:04:05.366652231Z [2024-05-25T03:04:05.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:03:00+00:00 exited with status success for try_number 1 2024-05-25T03:04:05.376380705Z [2024-05-25T03:04:05.375+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:03:00+00:00, map_index=-1, run_start_date=2024-05-25 03:04:02.825586+00:00, run_end_date=2024-05-25 03:04:04.183042+00:00, run_duration=1.357456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1085, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:04:00.527191+00:00, queued_by_job_id=1, pid=15915 2024-05-25T03:04:05.376548657Z [2024-05-25T03:04:05.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:03:00+00:00, map_index=-1, run_start_date=2024-05-25 03:04:02.964002+00:00, run_end_date=2024-05-25 03:04:04.699938+00:00, run_duration=1.735936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1086, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:04:00.527191+00:00, queued_by_job_id=1, pid=15916 2024-05-25T03:05:00.717235502Z [2024-05-25T03:05:00.716+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:05:00+00:00, run_after=2024-05-25T03:06:00+00:00 2024-05-25T03:05:00.732708871Z [2024-05-25T03:05:00.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:05:00+00:00, run_after=2024-05-25T03:06:00+00:00 2024-05-25T03:05:00.739533832Z [2024-05-25T03:05:00.739+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:05:00.750327409Z [2024-05-25T03:05:00.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:05:00+00:00, run_after=2024-05-25T03:10:00+00:00 2024-05-25T03:05:00.864725235Z [2024-05-25T03:05:00.864+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T03:05:00.864777691Z 2024-05-25T03:05:00.864784637Z 2024-05-25T03:05:00.864789606Z 2024-05-25T03:05:00.864794705Z 2024-05-25T03:05:00.864799725Z [2024-05-25T03:05:00.864+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:05:00.864814445Z [2024-05-25T03:05:00.864+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:05:00.864860821Z [2024-05-25T03:05:00.864+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:05:00.865075566Z [2024-05-25T03:05:00.864+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:05:00.865844953Z [2024-05-25T03:05:00.865+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:05:00.865858149Z 2024-05-25T03:05:00.865862490Z 2024-05-25T03:05:00.865882853Z 2024-05-25T03:05:00.865887041Z 2024-05-25T03:05:00.870784330Z [2024-05-25T03:05:00.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T03:05:00.870804434Z [2024-05-25T03:05:00.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:05:00.871007848Z [2024-05-25T03:05:00.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:05:00.871114838Z [2024-05-25T03:05:00.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:05:00.871315113Z [2024-05-25T03:05:00.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:05:00.871357144Z [2024-05-25T03:05:00.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:05:00.871626199Z [2024-05-25T03:05:00.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:05:00.871663203Z [2024-05-25T03:05:00.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:05:01.435261940Z [2024-05-25T03:05:01.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status queued for try_number 1 2024-05-25T03:05:01.437417521Z [2024-05-25T03:05:01.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:04:00+00:00 exited with status queued for try_number 1 2024-05-25T03:05:01.437557704Z [2024-05-25T03:05:01.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:04:00+00:00 exited with status queued for try_number 1 2024-05-25T03:05:01.437679248Z [2024-05-25T03:05:01.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:04:00+00:00 exited with status queued for try_number 1 2024-05-25T03:05:01.450385793Z [2024-05-25T03:05:01.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to d547c23f-b3eb-4f3b-b366-095810959942 2024-05-25T03:05:01.453558966Z [2024-05-25T03:05:01.453+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf9328e4-0dea-407e-81c3-afb8376f4bf8 2024-05-25T03:05:01.454421452Z [2024-05-25T03:05:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cf0f221-ba23-485c-8dbd-f47af5319ed9 2024-05-25T03:05:01.454623388Z [2024-05-25T03:05:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to bebab6dc-8e52-4271-ab4a-0149e01d9711 2024-05-25T03:05:04.286420943Z [2024-05-25T03:05:04.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:05:04.288013396Z [2024-05-25T03:05:04.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:04:00+00:00, run_id=scheduled__2024-05-25T03:04:00+00:00, run_start_date=2024-05-25 03:05:00.763099+00:00, run_end_date=2024-05-25 03:05:04.286893+00:00, run_duration=3.523794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:04:00+00:00, data_interval_end=2024-05-25 03:05:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:05:04.314087845Z [2024-05-25T03:05:04.313+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:05:00+00:00, run_after=2024-05-25T03:06:00+00:00 2024-05-25T03:05:04.376811902Z [2024-05-25T03:05:04.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:04:00+00:00 exited with status success for try_number 1 2024-05-25T03:05:04.384446207Z [2024-05-25T03:05:04.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:04:00+00:00, map_index=-1, run_start_date=2024-05-25 03:05:02.798232+00:00, run_end_date=2024-05-25 03:05:03.353690+00:00, run_duration=0.555458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1087, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:05:00.866682+00:00, queued_by_job_id=1, pid=15951 2024-05-25T03:05:05.485713877Z [2024-05-25T03:05:05.485+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:05:05.485749299Z 2024-05-25T03:05:05.485983475Z [2024-05-25T03:05:05.485+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:05:05.487044386Z [2024-05-25T03:05:05.486+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:05:05.487064435Z 2024-05-25T03:05:05.494705828Z [2024-05-25T03:05:05.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T03:05:05.495105575Z [2024-05-25T03:05:05.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:05:05.561550062Z [2024-05-25T03:05:05.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status queued for try_number 1 2024-05-25T03:05:05.561792479Z [2024-05-25T03:05:05.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status success for try_number 1 2024-05-25T03:05:05.567294447Z [2024-05-25T03:05:05.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to cea3ceb8-db59-4a6b-8690-4a4254feff4a 2024-05-25T03:05:05.570355041Z [2024-05-25T03:05:05.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T03:00:00+00:00, map_index=-1, run_start_date=2024-05-25 03:05:04.221049+00:00, run_end_date=2024-05-25 03:05:04.636391+00:00, run_duration=0.415342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1090, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:05:00.866682+00:00, queued_by_job_id=1, pid=15985 2024-05-25T03:05:05.619317019Z [2024-05-25T03:05:05.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:05:05.619649368Z [2024-05-25T03:05:05.619+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:04:00+00:00, run_id=scheduled__2024-05-25T03:04:00+00:00, run_start_date=2024-05-25 03:05:00.764580+00:00, run_end_date=2024-05-25 03:05:05.619231+00:00, run_duration=4.854651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:04:00+00:00, data_interval_end=2024-05-25 03:05:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:05:05.630738577Z [2024-05-25T03:05:05.630+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:05:00+00:00, run_after=2024-05-25T03:06:00+00:00 2024-05-25T03:05:05.638584981Z [2024-05-25T03:05:05.638+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:05:05.638897958Z [2024-05-25T03:05:05.638+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:04:00+00:00, run_id=scheduled__2024-05-25T03:04:00+00:00, run_start_date=2024-05-25 03:05:00.765767+00:00, run_end_date=2024-05-25 03:05:05.638501+00:00, run_duration=4.872734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:04:00+00:00, data_interval_end=2024-05-25 03:05:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:05:05.648353931Z [2024-05-25T03:05:05.648+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:05:00+00:00, run_after=2024-05-25T03:06:00+00:00 2024-05-25T03:05:05.696745519Z [2024-05-25T03:05:05.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:04:00+00:00 exited with status success for try_number 1 2024-05-25T03:05:05.702167920Z [2024-05-25T03:05:05.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:04:00+00:00, map_index=-1, run_start_date=2024-05-25 03:05:03.755139+00:00, run_end_date=2024-05-25 03:05:05.435969+00:00, run_duration=1.68083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1089, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:05:00.866682+00:00, queued_by_job_id=1, pid=15969 2024-05-25T03:05:06.804938436Z [2024-05-25T03:05:06.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:04:00+00:00 exited with status success for try_number 1 2024-05-25T03:05:06.811284144Z [2024-05-25T03:05:06.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:04:00+00:00, map_index=-1, run_start_date=2024-05-25 03:05:03.605047+00:00, run_end_date=2024-05-25 03:05:05.573007+00:00, run_duration=1.96796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1088, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:05:00.866682+00:00, queued_by_job_id=1, pid=15968 2024-05-25T03:05:07.883870150Z [2024-05-25T03:05:07.883+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:05:07.883890651Z 2024-05-25T03:05:07.884069539Z [2024-05-25T03:05:07.883+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:05:07.884583855Z [2024-05-25T03:05:07.884+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:05:07.884588949Z 2024-05-25T03:05:07.887108114Z [2024-05-25T03:05:07.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T03:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T03:05:07.887291066Z [2024-05-25T03:05:07.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T03:05:07.983447312Z [2024-05-25T03:05:07.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status queued for try_number 1 2024-05-25T03:05:07.983468774Z [2024-05-25T03:05:07.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status success for try_number 1 2024-05-25T03:05:07.997270006Z [2024-05-25T03:05:07.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to dce53892-d571-448e-b125-d4c7c9e24732 2024-05-25T03:05:07.997293986Z [2024-05-25T03:05:07.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T03:00:00+00:00, map_index=-1, run_start_date=2024-05-25 03:05:07.198716+00:00, run_end_date=2024-05-25 03:05:07.585619+00:00, run_duration=0.386903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1091, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:05:05.487778+00:00, queued_by_job_id=1, pid=16008 2024-05-25T03:05:10.518984209Z [2024-05-25T03:05:10.518+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:05:10.519083788Z 2024-05-25T03:05:10.519095650Z [2024-05-25T03:05:10.518+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:05:10.519695227Z [2024-05-25T03:05:10.519+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:05:10.519736510Z 2024-05-25T03:05:10.522478126Z [2024-05-25T03:05:10.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:05:10.522706580Z [2024-05-25T03:05:10.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:05:10.587311215Z [2024-05-25T03:05:10.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status queued for try_number 1 2024-05-25T03:05:10.587868233Z [2024-05-25T03:05:10.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status success for try_number 1 2024-05-25T03:05:10.596922744Z [2024-05-25T03:05:10.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45f0812b-ecad-4ff3-b5fc-27d9fa93109c 2024-05-25T03:05:10.597561027Z [2024-05-25T03:05:10.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T03:00:00+00:00, map_index=0, run_start_date=2024-05-25 03:05:09.582107+00:00, run_end_date=2024-05-25 03:05:09.973338+00:00, run_duration=0.391231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1092, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:05:07.884919+00:00, queued_by_job_id=1, pid=16019 2024-05-25T03:05:12.628753022Z [2024-05-25T03:05:12.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:05:12.629296951Z [2024-05-25T03:05:12.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:00:00+00:00, run_id=scheduled__2024-05-25T03:00:00+00:00, run_start_date=2024-05-25 03:05:00.760955+00:00, run_end_date=2024-05-25 03:05:12.628804+00:00, run_duration=11.867849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:00:00+00:00, data_interval_end=2024-05-25 03:05:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T03:05:12.639978513Z [2024-05-25T03:05:12.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:05:00+00:00, run_after=2024-05-25T03:10:00+00:00 2024-05-25T03:05:13.436495459Z [2024-05-25T03:05:13.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T03:00:00+00:00 exited with status success for try_number 1 2024-05-25T03:05:13.445646020Z [2024-05-25T03:05:13.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T03:00:00+00:00, map_index=-1, run_start_date=2024-05-25 03:05:12.140065+00:00, run_end_date=2024-05-25 03:05:12.521611+00:00, run_duration=0.381546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1093, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:05:10.520175+00:00, queued_by_job_id=1, pid=16027 2024-05-25T03:05:30.644929169Z [2024-05-25T03:05:30.644+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T03:06:00.188331504Z [2024-05-25T03:06:00.187+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:06:00.216469875Z [2024-05-25T03:06:00.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:06:00+00:00, run_after=2024-05-25T03:07:00+00:00 2024-05-25T03:06:00.235840874Z [2024-05-25T03:06:00.235+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:06:00.249970803Z [2024-05-25T03:06:00.249+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:06:00+00:00, run_after=2024-05-25T03:07:00+00:00 2024-05-25T03:06:00.340781056Z [2024-05-25T03:06:00.340+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T03:06:00.340864861Z 2024-05-25T03:06:00.340910327Z 2024-05-25T03:06:00.340919023Z 2024-05-25T03:06:00.340956455Z 2024-05-25T03:06:00.341010796Z [2024-05-25T03:06:00.340+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T03:06:00.341286786Z [2024-05-25T03:06:00.340+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:06:00.341303431Z [2024-05-25T03:06:00.341+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:06:00.341935833Z [2024-05-25T03:06:00.341+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:06:00.342504164Z [2024-05-25T03:06:00.342+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:06:00.342553665Z 2024-05-25T03:06:00.342568323Z 2024-05-25T03:06:00.342577216Z 2024-05-25T03:06:00.342585595Z 2024-05-25T03:06:00.346095646Z [2024-05-25T03:06:00.345+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:06:00.346137991Z [2024-05-25T03:06:00.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:06:00.346259440Z [2024-05-25T03:06:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:06:00.346419293Z [2024-05-25T03:06:00.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:06:00.346753517Z [2024-05-25T03:06:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:06:00.346947155Z [2024-05-25T03:06:00.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:06:00.347211153Z [2024-05-25T03:06:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:06:00.347427430Z [2024-05-25T03:06:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:06:00.860635937Z [2024-05-25T03:06:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:04:00+00:00 exited with status queued for try_number 1 2024-05-25T03:06:00.860990115Z [2024-05-25T03:06:00.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status queued for try_number 1 2024-05-25T03:06:00.861262705Z [2024-05-25T03:06:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status queued for try_number 1 2024-05-25T03:06:00.861537469Z [2024-05-25T03:06:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status queued for try_number 1 2024-05-25T03:06:00.887094877Z [2024-05-25T03:06:00.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to edff44ac-0b97-447a-bdc3-1a54fa4fc264 2024-05-25T03:06:00.887346476Z [2024-05-25T03:06:00.887+0000] {scheduler_job.py:635} INFO - Setting external_id for to 164724de-b6a1-4106-b08e-7b189fd6835c 2024-05-25T03:06:00.887541328Z [2024-05-25T03:06:00.887+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e30e633-3edc-4fef-b31d-1e25dd86be8f 2024-05-25T03:06:00.887779697Z [2024-05-25T03:06:00.887+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90811dff-051b-444d-b4e7-ca129b66d263 2024-05-25T03:06:01.852494210Z [2024-05-25T03:06:01.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:06:01.853543527Z [2024-05-25T03:06:01.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 03:04:00+00:00, run_id=scheduled__2024-05-25T03:04:00+00:00, run_start_date=2024-05-25 03:06:00.263120+00:00, run_end_date=2024-05-25 03:06:01.852701+00:00, run_duration=1.589581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:04:00+00:00, data_interval_end=2024-05-25 03:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T03:06:01.872083698Z [2024-05-25T03:06:01.871+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T03:06:00+00:00, run_after=2024-05-25T03:08:00+00:00 2024-05-25T03:06:01.880454636Z [2024-05-25T03:06:01.880+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:06:01.880894947Z [2024-05-25T03:06:01.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:05:00+00:00, run_id=scheduled__2024-05-25T03:05:00+00:00, run_start_date=2024-05-25 03:06:00.265468+00:00, run_end_date=2024-05-25 03:06:01.880506+00:00, run_duration=1.615038, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:05:00+00:00, data_interval_end=2024-05-25 03:06:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:06:01.892415102Z [2024-05-25T03:06:01.892+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:06:00+00:00, run_after=2024-05-25T03:07:00+00:00 2024-05-25T03:06:01.932669559Z [2024-05-25T03:06:01.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:04:00+00:00 exited with status success for try_number 1 2024-05-25T03:06:01.933097901Z [2024-05-25T03:06:01.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status success for try_number 1 2024-05-25T03:06:01.940935218Z [2024-05-25T03:06:01.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T03:04:00+00:00, map_index=-1, run_start_date=2024-05-25 03:06:01.188265+00:00, run_end_date=2024-05-25 03:06:01.572017+00:00, run_duration=0.383752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1094, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:06:00.343208+00:00, queued_by_job_id=1, pid=16037 2024-05-25T03:06:01.941229430Z [2024-05-25T03:06:01.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:05:00+00:00, map_index=-1, run_start_date=2024-05-25 03:06:01.219219+00:00, run_end_date=2024-05-25 03:06:01.666840+00:00, run_duration=0.447621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1095, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:06:00.343208+00:00, queued_by_job_id=1, pid=16038 2024-05-25T03:06:04.129513520Z [2024-05-25T03:06:04.128+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:06:04.130017885Z [2024-05-25T03:06:04.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:05:00+00:00, run_id=scheduled__2024-05-25T03:05:00+00:00, run_start_date=2024-05-25 03:06:00.266672+00:00, run_end_date=2024-05-25 03:06:04.129612+00:00, run_duration=3.86294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:05:00+00:00, data_interval_end=2024-05-25 03:06:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:06:04.141805109Z [2024-05-25T03:06:04.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:06:00+00:00, run_after=2024-05-25T03:07:00+00:00 2024-05-25T03:06:04.151363972Z [2024-05-25T03:06:04.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:06:04.151957811Z [2024-05-25T03:06:04.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:05:00+00:00, run_id=scheduled__2024-05-25T03:05:00+00:00, run_start_date=2024-05-25 03:06:00.268082+00:00, run_end_date=2024-05-25 03:06:04.151479+00:00, run_duration=3.883397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:05:00+00:00, data_interval_end=2024-05-25 03:06:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:06:04.163358699Z [2024-05-25T03:06:04.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:06:00+00:00, run_after=2024-05-25T03:07:00+00:00 2024-05-25T03:06:04.200735870Z [2024-05-25T03:06:04.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status success for try_number 1 2024-05-25T03:06:04.201818560Z [2024-05-25T03:06:04.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status success for try_number 1 2024-05-25T03:06:04.210804900Z [2024-05-25T03:06:04.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:05:00+00:00, map_index=-1, run_start_date=2024-05-25 03:06:02.399760+00:00, run_end_date=2024-05-25 03:06:03.784343+00:00, run_duration=1.384583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1097, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:06:00.343208+00:00, queued_by_job_id=1, pid=16062 2024-05-25T03:06:04.211330607Z [2024-05-25T03:06:04.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:05:00+00:00, map_index=-1, run_start_date=2024-05-25 03:06:02.284109+00:00, run_end_date=2024-05-25 03:06:03.847815+00:00, run_duration=1.563706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1096, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:06:00.343208+00:00, queued_by_job_id=1, pid=16061 2024-05-25T03:07:01.055435965Z [2024-05-25T03:07:01.054+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:07:01.078762294Z [2024-05-25T03:07:01.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:07:00+00:00, run_after=2024-05-25T03:08:00+00:00 2024-05-25T03:07:01.099803589Z [2024-05-25T03:07:01.099+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:07:00+00:00, run_after=2024-05-25T03:08:00+00:00 2024-05-25T03:07:01.179606365Z [2024-05-25T03:07:01.179+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T03:07:01.179644705Z 2024-05-25T03:07:01.179652947Z 2024-05-25T03:07:01.179660811Z 2024-05-25T03:07:01.179846344Z [2024-05-25T03:07:01.179+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:07:01.179951713Z [2024-05-25T03:07:01.179+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:07:01.180175498Z [2024-05-25T03:07:01.179+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:07:01.181011640Z [2024-05-25T03:07:01.180+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:07:01.181033766Z 2024-05-25T03:07:01.181043149Z 2024-05-25T03:07:01.181052022Z 2024-05-25T03:07:01.185044543Z [2024-05-25T03:07:01.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:07:01.185286271Z [2024-05-25T03:07:01.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:07:01.185589785Z [2024-05-25T03:07:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:07:01.185808580Z [2024-05-25T03:07:01.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:07:01.186018077Z [2024-05-25T03:07:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:07:01.186174418Z [2024-05-25T03:07:01.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:07:01.460170178Z [2024-05-25T03:07:01.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:06:00+00:00 exited with status queued for try_number 1 2024-05-25T03:07:01.460421322Z [2024-05-25T03:07:01.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:06:00+00:00 exited with status queued for try_number 1 2024-05-25T03:07:01.460643997Z [2024-05-25T03:07:01.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:06:00+00:00 exited with status queued for try_number 1 2024-05-25T03:07:01.468286273Z [2024-05-25T03:07:01.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5540bf62-70c9-4c63-8169-49f684382925 2024-05-25T03:07:01.468458150Z [2024-05-25T03:07:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a53a232-44a6-4572-8233-5e53c6210384 2024-05-25T03:07:01.468638717Z [2024-05-25T03:07:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8eb6604-7fca-40c4-b206-51393007636b 2024-05-25T03:07:03.492094628Z [2024-05-25T03:07:03.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:07:03.492910816Z [2024-05-25T03:07:03.492+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:06:00+00:00, run_id=scheduled__2024-05-25T03:06:00+00:00, run_start_date=2024-05-25 03:07:01.116298+00:00, run_end_date=2024-05-25 03:07:03.491923+00:00, run_duration=2.375625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:06:00+00:00, data_interval_end=2024-05-25 03:07:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:07:03.506983397Z [2024-05-25T03:07:03.506+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:07:00+00:00, run_after=2024-05-25T03:08:00+00:00 2024-05-25T03:07:03.560737170Z [2024-05-25T03:07:03.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:06:00+00:00 exited with status success for try_number 1 2024-05-25T03:07:03.570564484Z [2024-05-25T03:07:03.570+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:06:00+00:00, map_index=-1, run_start_date=2024-05-25 03:07:01.969782+00:00, run_end_date=2024-05-25 03:07:02.461674+00:00, run_duration=0.491892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1098, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:07:01.181801+00:00, queued_by_job_id=1, pid=16095 2024-05-25T03:07:04.621299298Z [2024-05-25T03:07:04.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:07:04.621861802Z [2024-05-25T03:07:04.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:06:00+00:00, run_id=scheduled__2024-05-25T03:06:00+00:00, run_start_date=2024-05-25 03:07:01.118241+00:00, run_end_date=2024-05-25 03:07:04.621120+00:00, run_duration=3.502879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:06:00+00:00, data_interval_end=2024-05-25 03:07:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:07:04.640594073Z [2024-05-25T03:07:04.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:07:00+00:00, run_after=2024-05-25T03:08:00+00:00 2024-05-25T03:07:04.650939095Z [2024-05-25T03:07:04.650+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:07:04.651502766Z [2024-05-25T03:07:04.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:06:00+00:00, run_id=scheduled__2024-05-25T03:06:00+00:00, run_start_date=2024-05-25 03:07:01.119835+00:00, run_end_date=2024-05-25 03:07:04.651006+00:00, run_duration=3.531171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:06:00+00:00, data_interval_end=2024-05-25 03:07:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:07:04.664612218Z [2024-05-25T03:07:04.664+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:07:00+00:00, run_after=2024-05-25T03:08:00+00:00 2024-05-25T03:07:04.707262032Z [2024-05-25T03:07:04.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:06:00+00:00 exited with status success for try_number 1 2024-05-25T03:07:04.707547325Z [2024-05-25T03:07:04.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:06:00+00:00 exited with status success for try_number 1 2024-05-25T03:07:04.717908409Z [2024-05-25T03:07:04.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:06:00+00:00, map_index=-1, run_start_date=2024-05-25 03:07:02.939714+00:00, run_end_date=2024-05-25 03:07:04.514680+00:00, run_duration=1.574966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1099, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:07:01.181801+00:00, queued_by_job_id=1, pid=16113 2024-05-25T03:07:04.718342309Z [2024-05-25T03:07:04.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:06:00+00:00, map_index=-1, run_start_date=2024-05-25 03:07:03.008899+00:00, run_end_date=2024-05-25 03:07:04.238989+00:00, run_duration=1.23009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:07:01.181801+00:00, queued_by_job_id=1, pid=16114 2024-05-25T03:08:00.395656491Z [2024-05-25T03:08:00.395+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:08:00.406185699Z [2024-05-25T03:08:00.405+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:08:00.419018163Z [2024-05-25T03:08:00.418+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:08:00+00:00, run_after=2024-05-25T03:09:00+00:00 2024-05-25T03:08:00.432662558Z [2024-05-25T03:08:00.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:08:00+00:00, run_after=2024-05-25T03:09:00+00:00 2024-05-25T03:08:00.517866211Z [2024-05-25T03:08:00.517+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T03:08:00.517903434Z 2024-05-25T03:08:00.517911623Z 2024-05-25T03:08:00.517914790Z 2024-05-25T03:08:00.517917854Z 2024-05-25T03:08:00.518147866Z [2024-05-25T03:08:00.517+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T03:08:00.518412768Z [2024-05-25T03:08:00.518+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:08:00.518567603Z [2024-05-25T03:08:00.518+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:08:00.518857273Z [2024-05-25T03:08:00.518+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:08:00.519511735Z [2024-05-25T03:08:00.519+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:08:00.519531893Z 2024-05-25T03:08:00.519537596Z 2024-05-25T03:08:00.519542038Z 2024-05-25T03:08:00.519546581Z 2024-05-25T03:08:00.524651034Z [2024-05-25T03:08:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:08:00.524926529Z [2024-05-25T03:08:00.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:08:00.525344218Z [2024-05-25T03:08:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:08:00.525596439Z [2024-05-25T03:08:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:08:00.525987921Z [2024-05-25T03:08:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:08:00.526226210Z [2024-05-25T03:08:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:08:00.526676594Z [2024-05-25T03:08:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:08:00.526967497Z [2024-05-25T03:08:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:08:00.976318007Z [2024-05-25T03:08:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:06:00+00:00 exited with status queued for try_number 1 2024-05-25T03:08:00.976378573Z [2024-05-25T03:08:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:07:00+00:00 exited with status queued for try_number 1 2024-05-25T03:08:00.976405331Z [2024-05-25T03:08:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:07:00+00:00 exited with status queued for try_number 1 2024-05-25T03:08:00.976411532Z [2024-05-25T03:08:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:07:00+00:00 exited with status queued for try_number 1 2024-05-25T03:08:00.996394317Z [2024-05-25T03:08:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 901e0454-2854-4ae3-9ae9-fa54a466486a 2024-05-25T03:08:00.996449567Z [2024-05-25T03:08:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4201a757-1697-46ce-af14-945a88e492a8 2024-05-25T03:08:00.998527506Z [2024-05-25T03:08:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to cac6ef0e-c793-469d-9503-7da71db6bcb1 2024-05-25T03:08:00.998718619Z [2024-05-25T03:08:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cd89d0d-3e93-4e45-8c38-b7b5b1eddc04 2024-05-25T03:08:02.170496264Z [2024-05-25T03:08:02.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:08:02.170744905Z [2024-05-25T03:08:02.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 03:06:00+00:00, run_id=scheduled__2024-05-25T03:06:00+00:00, run_start_date=2024-05-25 03:08:00.448730+00:00, run_end_date=2024-05-25 03:08:02.170207+00:00, run_duration=1.721477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:06:00+00:00, data_interval_end=2024-05-25 03:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T03:08:02.186020367Z [2024-05-25T03:08:02.185+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T03:08:00+00:00, run_after=2024-05-25T03:10:00+00:00 2024-05-25T03:08:02.193359121Z [2024-05-25T03:08:02.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:08:02.193381174Z [2024-05-25T03:08:02.191+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:07:00+00:00, run_id=scheduled__2024-05-25T03:07:00+00:00, run_start_date=2024-05-25 03:08:00.450471+00:00, run_end_date=2024-05-25 03:08:02.191732+00:00, run_duration=1.741261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:07:00+00:00, data_interval_end=2024-05-25 03:08:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:08:02.209962882Z [2024-05-25T03:08:02.209+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:08:00+00:00, run_after=2024-05-25T03:09:00+00:00 2024-05-25T03:08:02.344373876Z [2024-05-25T03:08:02.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:06:00+00:00 exited with status success for try_number 1 2024-05-25T03:08:02.344689277Z [2024-05-25T03:08:02.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:07:00+00:00 exited with status success for try_number 1 2024-05-25T03:08:02.359315575Z [2024-05-25T03:08:02.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T03:06:00+00:00, map_index=-1, run_start_date=2024-05-25 03:08:01.467960+00:00, run_end_date=2024-05-25 03:08:01.892997+00:00, run_duration=0.425037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:08:00.520635+00:00, queued_by_job_id=1, pid=16149 2024-05-25T03:08:02.359672055Z [2024-05-25T03:08:02.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:07:00+00:00, map_index=-1, run_start_date=2024-05-25 03:08:01.337888+00:00, run_end_date=2024-05-25 03:08:01.845154+00:00, run_duration=0.507266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:08:00.520635+00:00, queued_by_job_id=1, pid=16148 2024-05-25T03:08:05.013650704Z [2024-05-25T03:08:05.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:08:05.013680446Z [2024-05-25T03:08:05.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:07:00+00:00, run_id=scheduled__2024-05-25T03:07:00+00:00, run_start_date=2024-05-25 03:08:00.451950+00:00, run_end_date=2024-05-25 03:08:05.012799+00:00, run_duration=4.560849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:07:00+00:00, data_interval_end=2024-05-25 03:08:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:08:05.041396347Z [2024-05-25T03:08:05.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:08:00+00:00, run_after=2024-05-25T03:09:00+00:00 2024-05-25T03:08:05.046673603Z [2024-05-25T03:08:05.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:08:05.047078458Z [2024-05-25T03:08:05.046+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:07:00+00:00, run_id=scheduled__2024-05-25T03:07:00+00:00, run_start_date=2024-05-25 03:08:00.453365+00:00, run_end_date=2024-05-25 03:08:05.046572+00:00, run_duration=4.593207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:07:00+00:00, data_interval_end=2024-05-25 03:08:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:08:05.059235830Z [2024-05-25T03:08:05.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:08:00+00:00, run_after=2024-05-25T03:09:00+00:00 2024-05-25T03:08:05.088680218Z [2024-05-25T03:08:05.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:07:00+00:00 exited with status success for try_number 1 2024-05-25T03:08:05.088712294Z [2024-05-25T03:08:05.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:07:00+00:00 exited with status success for try_number 1 2024-05-25T03:08:05.094768366Z [2024-05-25T03:08:05.094+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:07:00+00:00, map_index=-1, run_start_date=2024-05-25 03:08:02.659041+00:00, run_end_date=2024-05-25 03:08:03.966743+00:00, run_duration=1.307702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:08:00.520635+00:00, queued_by_job_id=1, pid=16173 2024-05-25T03:08:05.094966829Z [2024-05-25T03:08:05.094+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:07:00+00:00, map_index=-1, run_start_date=2024-05-25 03:08:02.601950+00:00, run_end_date=2024-05-25 03:08:04.341056+00:00, run_duration=1.739106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:08:00.520635+00:00, queued_by_job_id=1, pid=16172 2024-05-25T03:09:00.655251551Z [2024-05-25T03:09:00.654+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:09:00+00:00, run_after=2024-05-25T03:10:00+00:00 2024-05-25T03:09:00.664958010Z [2024-05-25T03:09:00.664+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:09:00.679879458Z [2024-05-25T03:09:00.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:09:00+00:00, run_after=2024-05-25T03:10:00+00:00 2024-05-25T03:09:00.744892482Z [2024-05-25T03:09:00.744+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T03:09:00.744998165Z 2024-05-25T03:09:00.745013847Z 2024-05-25T03:09:00.745027090Z 2024-05-25T03:09:00.745185305Z [2024-05-25T03:09:00.744+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:09:00.745722328Z [2024-05-25T03:09:00.745+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:09:00.746012649Z [2024-05-25T03:09:00.745+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:09:00.747699786Z [2024-05-25T03:09:00.747+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:09:00.747710389Z 2024-05-25T03:09:00.747714920Z 2024-05-25T03:09:00.747747584Z 2024-05-25T03:09:00.754028540Z [2024-05-25T03:09:00.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:09:00.754371553Z [2024-05-25T03:09:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:09:00.755014238Z [2024-05-25T03:09:00.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:09:00.755325436Z [2024-05-25T03:09:00.755+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:09:00.755848019Z [2024-05-25T03:09:00.755+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:09:00.756151439Z [2024-05-25T03:09:00.755+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:09:01.033762196Z [2024-05-25T03:09:01.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:08:00+00:00 exited with status queued for try_number 1 2024-05-25T03:09:01.034093693Z [2024-05-25T03:09:01.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:08:00+00:00 exited with status queued for try_number 1 2024-05-25T03:09:01.034300425Z [2024-05-25T03:09:01.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:08:00+00:00 exited with status queued for try_number 1 2024-05-25T03:09:01.041101974Z [2024-05-25T03:09:01.040+0000] {scheduler_job.py:635} INFO - Setting external_id for to 173f9e3a-432c-4f63-9717-0a4db1eb485d 2024-05-25T03:09:01.041441544Z [2024-05-25T03:09:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f265207-da90-4c91-9789-7b41e7d77be8 2024-05-25T03:09:01.041693222Z [2024-05-25T03:09:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to c883c92c-317c-4963-a375-3ed8da13436c 2024-05-25T03:09:03.027690794Z [2024-05-25T03:09:03.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:09:03.027830178Z [2024-05-25T03:09:03.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:08:00+00:00, run_id=scheduled__2024-05-25T03:08:00+00:00, run_start_date=2024-05-25 03:09:00.692564+00:00, run_end_date=2024-05-25 03:09:03.027338+00:00, run_duration=2.334774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:08:00+00:00, data_interval_end=2024-05-25 03:09:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:09:03.038691732Z [2024-05-25T03:09:03.038+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:09:00+00:00, run_after=2024-05-25T03:10:00+00:00 2024-05-25T03:09:03.106338188Z [2024-05-25T03:09:03.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:08:00+00:00 exited with status success for try_number 1 2024-05-25T03:09:03.113728794Z [2024-05-25T03:09:03.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:08:00+00:00, map_index=-1, run_start_date=2024-05-25 03:09:01.622163+00:00, run_end_date=2024-05-25 03:09:01.975926+00:00, run_duration=0.353763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:09:00.749536+00:00, queued_by_job_id=1, pid=16205 2024-05-25T03:09:04.355985659Z [2024-05-25T03:09:04.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:09:04.356279017Z [2024-05-25T03:09:04.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:08:00+00:00, run_id=scheduled__2024-05-25T03:08:00+00:00, run_start_date=2024-05-25 03:09:00.694158+00:00, run_end_date=2024-05-25 03:09:04.355738+00:00, run_duration=3.66158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:08:00+00:00, data_interval_end=2024-05-25 03:09:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:09:04.378999655Z [2024-05-25T03:09:04.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:09:00+00:00, run_after=2024-05-25T03:10:00+00:00 2024-05-25T03:09:04.388021571Z [2024-05-25T03:09:04.387+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:09:04.388352703Z [2024-05-25T03:09:04.388+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:08:00+00:00, run_id=scheduled__2024-05-25T03:08:00+00:00, run_start_date=2024-05-25 03:09:00.695385+00:00, run_end_date=2024-05-25 03:09:04.388074+00:00, run_duration=3.692689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:08:00+00:00, data_interval_end=2024-05-25 03:09:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:09:04.398309634Z [2024-05-25T03:09:04.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:09:00+00:00, run_after=2024-05-25T03:10:00+00:00 2024-05-25T03:09:04.432683753Z [2024-05-25T03:09:04.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:08:00+00:00 exited with status success for try_number 1 2024-05-25T03:09:04.432922440Z [2024-05-25T03:09:04.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:08:00+00:00 exited with status success for try_number 1 2024-05-25T03:09:04.441825091Z [2024-05-25T03:09:04.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:08:00+00:00, map_index=-1, run_start_date=2024-05-25 03:09:02.566630+00:00, run_end_date=2024-05-25 03:09:04.220541+00:00, run_duration=1.653911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:09:00.749536+00:00, queued_by_job_id=1, pid=16223 2024-05-25T03:09:04.442155791Z [2024-05-25T03:09:04.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:08:00+00:00, map_index=-1, run_start_date=2024-05-25 03:09:02.584570+00:00, run_end_date=2024-05-25 03:09:03.875653+00:00, run_duration=1.291083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:09:00.749536+00:00, queued_by_job_id=1, pid=16224 2024-05-25T03:10:00.963024506Z [2024-05-25T03:10:00.962+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:10:00+00:00, run_after=2024-05-25T03:11:00+00:00 2024-05-25T03:10:00.990578744Z [2024-05-25T03:10:00.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:10:00+00:00, run_after=2024-05-25T03:15:00+00:00 2024-05-25T03:10:01.002962257Z [2024-05-25T03:10:01.002+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:10:01.025018471Z [2024-05-25T03:10:01.024+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:10:00+00:00, run_after=2024-05-25T03:11:00+00:00 2024-05-25T03:10:01.031289949Z [2024-05-25T03:10:01.031+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:10:01.131924637Z [2024-05-25T03:10:01.131+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T03:10:01.131955737Z 2024-05-25T03:10:01.131961001Z 2024-05-25T03:10:01.131971787Z 2024-05-25T03:10:01.131976613Z 2024-05-25T03:10:01.131982050Z 2024-05-25T03:10:01.132130727Z [2024-05-25T03:10:01.131+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:10:01.132385571Z [2024-05-25T03:10:01.132+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T03:10:01.132656164Z [2024-05-25T03:10:01.132+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:10:01.132881788Z [2024-05-25T03:10:01.132+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:10:01.133118983Z [2024-05-25T03:10:01.132+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:10:01.134015937Z [2024-05-25T03:10:01.133+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:10:01.134031230Z 2024-05-25T03:10:01.134036815Z 2024-05-25T03:10:01.134041363Z 2024-05-25T03:10:01.134045756Z 2024-05-25T03:10:01.134050092Z 2024-05-25T03:10:01.139842732Z [2024-05-25T03:10:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T03:10:01.140126557Z [2024-05-25T03:10:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:10:01.140567147Z [2024-05-25T03:10:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:10:01.140790653Z [2024-05-25T03:10:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:10:01.141194645Z [2024-05-25T03:10:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:10:01.141478724Z [2024-05-25T03:10:01.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:10:01.141878900Z [2024-05-25T03:10:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:10:01.142057544Z [2024-05-25T03:10:01.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:10:01.142495329Z [2024-05-25T03:10:01.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:10:01.142506824Z [2024-05-25T03:10:01.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:10:01.634383589Z [2024-05-25T03:10:01.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status queued for try_number 1 2024-05-25T03:10:01.634561885Z [2024-05-25T03:10:01.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:08:00+00:00 exited with status queued for try_number 1 2024-05-25T03:10:01.634682602Z [2024-05-25T03:10:01.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:09:00+00:00 exited with status queued for try_number 1 2024-05-25T03:10:01.634795172Z [2024-05-25T03:10:01.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:09:00+00:00 exited with status queued for try_number 1 2024-05-25T03:10:01.634898595Z [2024-05-25T03:10:01.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:09:00+00:00 exited with status queued for try_number 1 2024-05-25T03:10:01.649523542Z [2024-05-25T03:10:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ac88213-cc28-4c1e-b390-f4b76182ba9a 2024-05-25T03:10:01.649787848Z [2024-05-25T03:10:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to a39138d6-a06d-4b51-b789-97ec475627e4 2024-05-25T03:10:01.650016733Z [2024-05-25T03:10:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 662a4d9b-79e2-4be4-ac1c-f1371fa72938 2024-05-25T03:10:01.650252943Z [2024-05-25T03:10:01.650+0000] {scheduler_job.py:635} INFO - Setting external_id for to c215b33f-3374-480d-bc8f-3464bfaa07f0 2024-05-25T03:10:01.650510236Z [2024-05-25T03:10:01.650+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd6a79c1-09da-44f4-946b-a38f510cf76a 2024-05-25T03:10:02.843750176Z [2024-05-25T03:10:02.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:10:02.844062089Z [2024-05-25T03:10:02.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 03:08:00+00:00, run_id=scheduled__2024-05-25T03:08:00+00:00, run_start_date=2024-05-25 03:10:01.041397+00:00, run_end_date=2024-05-25 03:10:02.843657+00:00, run_duration=1.80226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:08:00+00:00, data_interval_end=2024-05-25 03:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T03:10:02.851905175Z [2024-05-25T03:10:02.851+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T03:10:00+00:00, run_after=2024-05-25T03:12:00+00:00 2024-05-25T03:10:02.859091263Z [2024-05-25T03:10:02.858+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:10:02.859330269Z [2024-05-25T03:10:02.859+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:09:00+00:00, run_id=scheduled__2024-05-25T03:09:00+00:00, run_start_date=2024-05-25 03:10:01.043209+00:00, run_end_date=2024-05-25 03:10:02.859050+00:00, run_duration=1.815841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:09:00+00:00, data_interval_end=2024-05-25 03:10:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:10:02.868327809Z [2024-05-25T03:10:02.868+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:10:00+00:00, run_after=2024-05-25T03:11:00+00:00 2024-05-25T03:10:02.958240592Z [2024-05-25T03:10:02.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:08:00+00:00 exited with status success for try_number 1 2024-05-25T03:10:02.972833383Z [2024-05-25T03:10:02.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T03:08:00+00:00, map_index=-1, run_start_date=2024-05-25 03:10:02.039304+00:00, run_end_date=2024-05-25 03:10:02.595430+00:00, run_duration=0.556126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:10:01.135532+00:00, queued_by_job_id=1, pid=16258 2024-05-25T03:10:03.774748697Z [2024-05-25T03:10:03.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:09:00+00:00 exited with status success for try_number 1 2024-05-25T03:10:03.784207881Z [2024-05-25T03:10:03.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:09:00+00:00, map_index=-1, run_start_date=2024-05-25 03:10:02.405420+00:00, run_end_date=2024-05-25 03:10:02.792321+00:00, run_duration=0.386901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:10:01.135532+00:00, queued_by_job_id=1, pid=16259 2024-05-25T03:10:04.906393747Z [2024-05-25T03:10:04.905+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:10:04.906429019Z 2024-05-25T03:10:04.906806772Z [2024-05-25T03:10:04.906+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:10:04.907783835Z [2024-05-25T03:10:04.907+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:10:04.907799120Z 2024-05-25T03:10:04.912141395Z [2024-05-25T03:10:04.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T03:10:04.912540386Z [2024-05-25T03:10:04.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:10:04.980301541Z [2024-05-25T03:10:04.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status queued for try_number 1 2024-05-25T03:10:04.980621190Z [2024-05-25T03:10:04.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status success for try_number 1 2024-05-25T03:10:04.981068731Z [2024-05-25T03:10:04.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:09:00+00:00 exited with status success for try_number 1 2024-05-25T03:10:04.998535391Z [2024-05-25T03:10:04.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T03:05:00+00:00, map_index=-1, run_start_date=2024-05-25 03:10:03.338401+00:00, run_end_date=2024-05-25 03:10:03.751879+00:00, run_duration=0.413478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1110, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:10:01.135532+00:00, queued_by_job_id=1, pid=16288 2024-05-25T03:10:04.999057450Z [2024-05-25T03:10:04.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:09:00+00:00, map_index=-1, run_start_date=2024-05-25 03:10:03.354847+00:00, run_end_date=2024-05-25 03:10:04.738580+00:00, run_duration=1.383733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:10:01.135532+00:00, queued_by_job_id=1, pid=16289 2024-05-25T03:10:04.999487631Z [2024-05-25T03:10:04.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15e6a2b5-ecd8-4e81-abc3-db3e9aea1853 2024-05-25T03:10:05.050195233Z [2024-05-25T03:10:05.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:10:05.050607673Z [2024-05-25T03:10:05.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:09:00+00:00, run_id=scheduled__2024-05-25T03:09:00+00:00, run_start_date=2024-05-25 03:10:01.044557+00:00, run_end_date=2024-05-25 03:10:05.050114+00:00, run_duration=4.005557, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:09:00+00:00, data_interval_end=2024-05-25 03:10:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:10:05.063781183Z [2024-05-25T03:10:05.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:10:00+00:00, run_after=2024-05-25T03:11:00+00:00 2024-05-25T03:10:06.178061619Z [2024-05-25T03:10:06.177+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:10:06.178693496Z [2024-05-25T03:10:06.178+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:09:00+00:00, run_id=scheduled__2024-05-25T03:09:00+00:00, run_start_date=2024-05-25 03:10:01.045560+00:00, run_end_date=2024-05-25 03:10:06.178234+00:00, run_duration=5.132674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:09:00+00:00, data_interval_end=2024-05-25 03:10:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:10:06.192931940Z [2024-05-25T03:10:06.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:10:00+00:00, run_after=2024-05-25T03:11:00+00:00 2024-05-25T03:10:06.244563149Z [2024-05-25T03:10:06.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:09:00+00:00 exited with status success for try_number 1 2024-05-25T03:10:06.258443227Z [2024-05-25T03:10:06.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:09:00+00:00, map_index=-1, run_start_date=2024-05-25 03:10:03.575071+00:00, run_end_date=2024-05-25 03:10:05.285580+00:00, run_duration=1.710509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:10:01.135532+00:00, queued_by_job_id=1, pid=16290 2024-05-25T03:10:08.049893925Z [2024-05-25T03:10:08.049+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:10:08.049915871Z 2024-05-25T03:10:08.050140320Z [2024-05-25T03:10:08.049+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:10:08.050996769Z [2024-05-25T03:10:08.050+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:10:08.051002596Z 2024-05-25T03:10:08.054697760Z [2024-05-25T03:10:08.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T03:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T03:10:08.055163919Z [2024-05-25T03:10:08.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T03:10:08.131697857Z [2024-05-25T03:10:08.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status queued for try_number 1 2024-05-25T03:10:08.131821230Z [2024-05-25T03:10:08.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status success for try_number 1 2024-05-25T03:10:08.142161712Z [2024-05-25T03:10:08.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fe11b60-fcfc-433b-9965-bc4918883c74 2024-05-25T03:10:08.142410751Z [2024-05-25T03:10:08.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T03:05:00+00:00, map_index=-1, run_start_date=2024-05-25 03:10:06.784926+00:00, run_end_date=2024-05-25 03:10:07.148615+00:00, run_duration=0.363689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1113, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:10:04.908422+00:00, queued_by_job_id=1, pid=16322 2024-05-25T03:10:10.414054281Z [2024-05-25T03:10:10.413+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:10:10.414099924Z 2024-05-25T03:10:10.414276717Z [2024-05-25T03:10:10.414+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:10:10.415204019Z [2024-05-25T03:10:10.414+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:10:10.415221943Z 2024-05-25T03:10:10.418618042Z [2024-05-25T03:10:10.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:10:10.419125365Z [2024-05-25T03:10:10.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:10:10.473052400Z [2024-05-25T03:10:10.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status queued for try_number 1 2024-05-25T03:10:10.473341373Z [2024-05-25T03:10:10.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status success for try_number 1 2024-05-25T03:10:10.478609364Z [2024-05-25T03:10:10.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 178fb612-0adc-4d21-b9fc-61002c1a8176 2024-05-25T03:10:10.478929493Z [2024-05-25T03:10:10.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T03:05:00+00:00, map_index=0, run_start_date=2024-05-25 03:10:09.738888+00:00, run_end_date=2024-05-25 03:10:10.106771+00:00, run_duration=0.367883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1114, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:10:08.051493+00:00, queued_by_job_id=1, pid=16333 2024-05-25T03:10:12.732289717Z [2024-05-25T03:10:12.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:10:12.733377171Z [2024-05-25T03:10:12.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:05:00+00:00, run_id=scheduled__2024-05-25T03:05:00+00:00, run_start_date=2024-05-25 03:10:01.040194+00:00, run_end_date=2024-05-25 03:10:12.732116+00:00, run_duration=11.691922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:05:00+00:00, data_interval_end=2024-05-25 03:10:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T03:10:12.743341566Z [2024-05-25T03:10:12.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:10:00+00:00, run_after=2024-05-25T03:15:00+00:00 2024-05-25T03:10:12.782849773Z [2024-05-25T03:10:12.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T03:05:00+00:00 exited with status success for try_number 1 2024-05-25T03:10:12.788007069Z [2024-05-25T03:10:12.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T03:05:00+00:00, map_index=-1, run_start_date=2024-05-25 03:10:12.017960+00:00, run_end_date=2024-05-25 03:10:12.441671+00:00, run_duration=0.423711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:10:10.415874+00:00, queued_by_job_id=1, pid=16341 2024-05-25T03:10:30.713898667Z [2024-05-25T03:10:30.712+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T03:11:00.056851596Z [2024-05-25T03:11:00.056+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:11:00+00:00, run_after=2024-05-25T03:12:00+00:00 2024-05-25T03:11:00.064455163Z [2024-05-25T03:11:00.064+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:11:00.092080830Z [2024-05-25T03:11:00.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:11:00+00:00, run_after=2024-05-25T03:12:00+00:00 2024-05-25T03:11:00.153896432Z [2024-05-25T03:11:00.153+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T03:11:00.153932341Z 2024-05-25T03:11:00.153938502Z 2024-05-25T03:11:00.153943991Z 2024-05-25T03:11:00.153949313Z [2024-05-25T03:11:00.153+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:11:00.154155747Z [2024-05-25T03:11:00.153+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:11:00.154378631Z [2024-05-25T03:11:00.154+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:11:00.155014692Z [2024-05-25T03:11:00.154+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:11:00.155020778Z 2024-05-25T03:11:00.155024786Z 2024-05-25T03:11:00.155028494Z 2024-05-25T03:11:00.158068518Z [2024-05-25T03:11:00.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:11:00.158120231Z [2024-05-25T03:11:00.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:11:00.158504706Z [2024-05-25T03:11:00.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:11:00.158638809Z [2024-05-25T03:11:00.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:11:00.158991581Z [2024-05-25T03:11:00.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:11:00.159192547Z [2024-05-25T03:11:00.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:11:00.422315857Z [2024-05-25T03:11:00.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status queued for try_number 1 2024-05-25T03:11:00.422628576Z [2024-05-25T03:11:00.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status queued for try_number 1 2024-05-25T03:11:00.422876895Z [2024-05-25T03:11:00.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status queued for try_number 1 2024-05-25T03:11:00.433679673Z [2024-05-25T03:11:00.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a9c4b1f-a401-48b2-a76d-794296c776f3 2024-05-25T03:11:00.434122455Z [2024-05-25T03:11:00.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcd28b27-0e2a-4388-b518-729baff7c69a 2024-05-25T03:11:00.434548865Z [2024-05-25T03:11:00.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75baf8ae-e957-4c51-9962-442f4e1ff90c 2024-05-25T03:11:01.606583785Z [2024-05-25T03:11:01.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:11:01.606957410Z [2024-05-25T03:11:01.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:10:00+00:00, run_id=scheduled__2024-05-25T03:10:00+00:00, run_start_date=2024-05-25 03:11:00.107253+00:00, run_end_date=2024-05-25 03:11:01.606503+00:00, run_duration=1.49925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:10:00+00:00, data_interval_end=2024-05-25 03:11:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:11:01.617331223Z [2024-05-25T03:11:01.616+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:11:00+00:00, run_after=2024-05-25T03:12:00+00:00 2024-05-25T03:11:01.669094043Z [2024-05-25T03:11:01.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status success for try_number 1 2024-05-25T03:11:01.676058258Z [2024-05-25T03:11:01.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:10:00+00:00, map_index=-1, run_start_date=2024-05-25 03:11:00.966509+00:00, run_end_date=2024-05-25 03:11:01.319841+00:00, run_duration=0.353332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:11:00.155656+00:00, queued_by_job_id=1, pid=16350 2024-05-25T03:11:03.838719620Z [2024-05-25T03:11:03.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:11:03.839165745Z [2024-05-25T03:11:03.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:10:00+00:00, run_id=scheduled__2024-05-25T03:10:00+00:00, run_start_date=2024-05-25 03:11:00.108580+00:00, run_end_date=2024-05-25 03:11:03.838527+00:00, run_duration=3.729947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:10:00+00:00, data_interval_end=2024-05-25 03:11:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:11:03.876217024Z [2024-05-25T03:11:03.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:11:00+00:00, run_after=2024-05-25T03:12:00+00:00 2024-05-25T03:11:03.891798650Z [2024-05-25T03:11:03.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:11:03.891844088Z [2024-05-25T03:11:03.891+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:10:00+00:00, run_id=scheduled__2024-05-25T03:10:00+00:00, run_start_date=2024-05-25 03:11:00.109739+00:00, run_end_date=2024-05-25 03:11:03.891380+00:00, run_duration=3.781641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:10:00+00:00, data_interval_end=2024-05-25 03:11:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:11:03.904994729Z [2024-05-25T03:11:03.903+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:11:00+00:00, run_after=2024-05-25T03:12:00+00:00 2024-05-25T03:11:03.954025499Z [2024-05-25T03:11:03.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status success for try_number 1 2024-05-25T03:11:03.954281635Z [2024-05-25T03:11:03.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status success for try_number 1 2024-05-25T03:11:03.963442948Z [2024-05-25T03:11:03.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:10:00+00:00, map_index=-1, run_start_date=2024-05-25 03:11:02.000917+00:00, run_end_date=2024-05-25 03:11:03.252140+00:00, run_duration=1.251223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:11:00.155656+00:00, queued_by_job_id=1, pid=16369 2024-05-25T03:11:03.963651202Z [2024-05-25T03:11:03.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:10:00+00:00, map_index=-1, run_start_date=2024-05-25 03:11:01.848690+00:00, run_end_date=2024-05-25 03:11:03.669900+00:00, run_duration=1.82121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:11:00.155656+00:00, queued_by_job_id=1, pid=16368 2024-05-25T03:12:00.687045263Z [2024-05-25T03:12:00.686+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:12:00+00:00, run_after=2024-05-25T03:13:00+00:00 2024-05-25T03:12:00.694166357Z [2024-05-25T03:12:00.693+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:12:00.708800759Z [2024-05-25T03:12:00.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:12:00+00:00, run_after=2024-05-25T03:13:00+00:00 2024-05-25T03:12:00.715765345Z [2024-05-25T03:12:00.715+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:12:00.789538163Z [2024-05-25T03:12:00.788+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T03:12:00.789559710Z 2024-05-25T03:12:00.789565828Z 2024-05-25T03:12:00.789569165Z 2024-05-25T03:12:00.789572048Z 2024-05-25T03:12:00.789575470Z [2024-05-25T03:12:00.789+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T03:12:00.789857477Z [2024-05-25T03:12:00.789+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:12:00.790083556Z [2024-05-25T03:12:00.789+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:12:00.790239527Z [2024-05-25T03:12:00.790+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:12:00.791318833Z [2024-05-25T03:12:00.791+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:12:00.791343817Z 2024-05-25T03:12:00.791347475Z 2024-05-25T03:12:00.791350823Z 2024-05-25T03:12:00.791353756Z 2024-05-25T03:12:00.799432185Z [2024-05-25T03:12:00.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:12:00.799675914Z [2024-05-25T03:12:00.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:12:00.800078354Z [2024-05-25T03:12:00.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:12:00.800236451Z [2024-05-25T03:12:00.800+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:12:00.800587521Z [2024-05-25T03:12:00.800+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:12:00.800731826Z [2024-05-25T03:12:00.800+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:12:00.801170538Z [2024-05-25T03:12:00.800+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:12:00.801594496Z [2024-05-25T03:12:00.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:12:01.339353349Z [2024-05-25T03:12:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status queued for try_number 1 2024-05-25T03:12:01.339455931Z [2024-05-25T03:12:01.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:11:00+00:00 exited with status queued for try_number 1 2024-05-25T03:12:01.339629949Z [2024-05-25T03:12:01.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:11:00+00:00 exited with status queued for try_number 1 2024-05-25T03:12:01.339645118Z [2024-05-25T03:12:01.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:11:00+00:00 exited with status queued for try_number 1 2024-05-25T03:12:01.368491189Z [2024-05-25T03:12:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7403c93-cfbe-4318-a964-bc1fd490c814 2024-05-25T03:12:01.368554107Z [2024-05-25T03:12:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72c4e6e8-51df-4e64-a51a-d368bbaa4298 2024-05-25T03:12:01.368643455Z [2024-05-25T03:12:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 848157d5-20a5-438e-a179-4d9d40954d26 2024-05-25T03:12:01.368741130Z [2024-05-25T03:12:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5d844e5-2c1e-42c9-9d08-e946b95bb0d6 2024-05-25T03:12:02.530783584Z [2024-05-25T03:12:02.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:12:02.531246422Z [2024-05-25T03:12:02.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 03:10:00+00:00, run_id=scheduled__2024-05-25T03:10:00+00:00, run_start_date=2024-05-25 03:12:00.725500+00:00, run_end_date=2024-05-25 03:12:02.530793+00:00, run_duration=1.805293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:10:00+00:00, data_interval_end=2024-05-25 03:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T03:12:02.539581493Z [2024-05-25T03:12:02.539+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T03:12:00+00:00, run_after=2024-05-25T03:14:00+00:00 2024-05-25T03:12:02.546659740Z [2024-05-25T03:12:02.546+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:12:02.547059604Z [2024-05-25T03:12:02.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:11:00+00:00, run_id=scheduled__2024-05-25T03:11:00+00:00, run_start_date=2024-05-25 03:12:00.726758+00:00, run_end_date=2024-05-25 03:12:02.546777+00:00, run_duration=1.820019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:11:00+00:00, data_interval_end=2024-05-25 03:12:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:12:02.556350492Z [2024-05-25T03:12:02.556+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:12:00+00:00, run_after=2024-05-25T03:13:00+00:00 2024-05-25T03:12:02.606144145Z [2024-05-25T03:12:02.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status success for try_number 1 2024-05-25T03:12:02.606516115Z [2024-05-25T03:12:02.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:11:00+00:00 exited with status success for try_number 1 2024-05-25T03:12:02.615862538Z [2024-05-25T03:12:02.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T03:10:00+00:00, map_index=-1, run_start_date=2024-05-25 03:12:01.635431+00:00, run_end_date=2024-05-25 03:12:01.980811+00:00, run_duration=0.34538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:12:00.793551+00:00, queued_by_job_id=1, pid=16401 2024-05-25T03:12:02.616267491Z [2024-05-25T03:12:02.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:11:00+00:00, map_index=-1, run_start_date=2024-05-25 03:12:01.843787+00:00, run_end_date=2024-05-25 03:12:02.282468+00:00, run_duration=0.438681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:12:00.793551+00:00, queued_by_job_id=1, pid=16403 2024-05-25T03:12:04.952556988Z [2024-05-25T03:12:04.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:12:04.953130081Z [2024-05-25T03:12:04.952+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:11:00+00:00, run_id=scheduled__2024-05-25T03:11:00+00:00, run_start_date=2024-05-25 03:12:00.728857+00:00, run_end_date=2024-05-25 03:12:04.952663+00:00, run_duration=4.223806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:11:00+00:00, data_interval_end=2024-05-25 03:12:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:12:04.965297079Z [2024-05-25T03:12:04.964+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:12:00+00:00, run_after=2024-05-25T03:13:00+00:00 2024-05-25T03:12:05.013094949Z [2024-05-25T03:12:05.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:11:00+00:00 exited with status success for try_number 1 2024-05-25T03:12:05.018748078Z [2024-05-25T03:12:05.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:11:00+00:00, map_index=-1, run_start_date=2024-05-25 03:12:02.745791+00:00, run_end_date=2024-05-25 03:12:04.587965+00:00, run_duration=1.842174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:12:00.793551+00:00, queued_by_job_id=1, pid=16427 2024-05-25T03:12:06.095062320Z [2024-05-25T03:12:06.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:12:06.095197151Z [2024-05-25T03:12:06.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:11:00+00:00, run_id=scheduled__2024-05-25T03:11:00+00:00, run_start_date=2024-05-25 03:12:00.727783+00:00, run_end_date=2024-05-25 03:12:06.094563+00:00, run_duration=5.36678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:11:00+00:00, data_interval_end=2024-05-25 03:12:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:12:06.107276251Z [2024-05-25T03:12:06.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:12:00+00:00, run_after=2024-05-25T03:13:00+00:00 2024-05-25T03:12:06.142436673Z [2024-05-25T03:12:06.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:11:00+00:00 exited with status success for try_number 1 2024-05-25T03:12:06.148165878Z [2024-05-25T03:12:06.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:11:00+00:00, map_index=-1, run_start_date=2024-05-25 03:12:02.681699+00:00, run_end_date=2024-05-25 03:12:05.493343+00:00, run_duration=2.811644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:12:00.793551+00:00, queued_by_job_id=1, pid=16426 2024-05-25T03:13:00.153797095Z [2024-05-25T03:13:00.153+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:13:00+00:00, run_after=2024-05-25T03:14:00+00:00 2024-05-25T03:13:00.168882057Z [2024-05-25T03:13:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:13:00+00:00, run_after=2024-05-25T03:14:00+00:00 2024-05-25T03:13:00.179277943Z [2024-05-25T03:13:00.178+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:13:00.253786439Z [2024-05-25T03:13:00.253+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T03:13:00.253822788Z 2024-05-25T03:13:00.253838251Z 2024-05-25T03:13:00.253844423Z 2024-05-25T03:13:00.253965460Z [2024-05-25T03:13:00.253+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:13:00.254140965Z [2024-05-25T03:13:00.253+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:13:00.254163892Z [2024-05-25T03:13:00.253+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:13:00.254832595Z [2024-05-25T03:13:00.254+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:13:00.254855207Z 2024-05-25T03:13:00.254861434Z 2024-05-25T03:13:00.254889121Z 2024-05-25T03:13:00.259342157Z [2024-05-25T03:13:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:13:00.259422274Z [2024-05-25T03:13:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:13:00.259683339Z [2024-05-25T03:13:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:13:00.259811548Z [2024-05-25T03:13:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:13:00.260096306Z [2024-05-25T03:13:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:13:00.260201121Z [2024-05-25T03:13:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:13:00.533059451Z [2024-05-25T03:13:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:12:00+00:00 exited with status queued for try_number 1 2024-05-25T03:13:00.533440677Z [2024-05-25T03:13:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:12:00+00:00 exited with status queued for try_number 1 2024-05-25T03:13:00.533468623Z [2024-05-25T03:13:00.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:12:00+00:00 exited with status queued for try_number 1 2024-05-25T03:13:00.552062971Z [2024-05-25T03:13:00.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bb020cc-34ad-4c30-97a5-aeb4538b80c5 2024-05-25T03:13:00.552092694Z [2024-05-25T03:13:00.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a05791e-8afb-4424-a6c2-97bd5437f828 2024-05-25T03:13:00.552174958Z [2024-05-25T03:13:00.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to eedb6440-bf39-43ee-844e-a4b8222f1f41 2024-05-25T03:13:02.717198403Z [2024-05-25T03:13:02.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:13:02.717618593Z [2024-05-25T03:13:02.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:12:00+00:00, run_id=scheduled__2024-05-25T03:12:00+00:00, run_start_date=2024-05-25 03:13:00.194353+00:00, run_end_date=2024-05-25 03:13:02.717046+00:00, run_duration=2.522693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:12:00+00:00, data_interval_end=2024-05-25 03:13:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:13:02.726575271Z [2024-05-25T03:13:02.726+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:13:00+00:00, run_after=2024-05-25T03:14:00+00:00 2024-05-25T03:13:02.775167015Z [2024-05-25T03:13:02.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:12:00+00:00 exited with status success for try_number 1 2024-05-25T03:13:02.780445632Z [2024-05-25T03:13:02.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:12:00+00:00, map_index=-1, run_start_date=2024-05-25 03:13:01.243517+00:00, run_end_date=2024-05-25 03:13:01.672523+00:00, run_duration=0.429006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:13:00.255595+00:00, queued_by_job_id=1, pid=16458 2024-05-25T03:13:04.987608387Z [2024-05-25T03:13:04.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:13:04.988025139Z [2024-05-25T03:13:04.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:12:00+00:00, run_id=scheduled__2024-05-25T03:12:00+00:00, run_start_date=2024-05-25 03:13:00.195821+00:00, run_end_date=2024-05-25 03:13:04.987385+00:00, run_duration=4.791564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:12:00+00:00, data_interval_end=2024-05-25 03:13:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:13:05.000838025Z [2024-05-25T03:13:05.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:13:00+00:00, run_after=2024-05-25T03:14:00+00:00 2024-05-25T03:13:05.007464992Z [2024-05-25T03:13:05.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:13:05.007527009Z [2024-05-25T03:13:05.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:12:00+00:00, run_id=scheduled__2024-05-25T03:12:00+00:00, run_start_date=2024-05-25 03:13:00.197069+00:00, run_end_date=2024-05-25 03:13:05.007185+00:00, run_duration=4.810116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:12:00+00:00, data_interval_end=2024-05-25 03:13:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:13:05.016097057Z [2024-05-25T03:13:05.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:13:00+00:00, run_after=2024-05-25T03:14:00+00:00 2024-05-25T03:13:05.054341687Z [2024-05-25T03:13:05.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:12:00+00:00 exited with status success for try_number 1 2024-05-25T03:13:05.062785310Z [2024-05-25T03:13:05.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:12:00+00:00, map_index=-1, run_start_date=2024-05-25 03:13:02.533358+00:00, run_end_date=2024-05-25 03:13:04.534668+00:00, run_duration=2.00131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:13:00.255595+00:00, queued_by_job_id=1, pid=16477 2024-05-25T03:13:05.148697952Z [2024-05-25T03:13:05.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:12:00+00:00 exited with status success for try_number 1 2024-05-25T03:13:05.156393924Z [2024-05-25T03:13:05.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:12:00+00:00, map_index=-1, run_start_date=2024-05-25 03:13:02.237021+00:00, run_end_date=2024-05-25 03:13:04.889172+00:00, run_duration=2.652151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:13:00.255595+00:00, queued_by_job_id=1, pid=16476 2024-05-25T03:14:01.081322673Z [2024-05-25T03:14:01.080+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:14:01.094971263Z [2024-05-25T03:14:01.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:14:00+00:00, run_after=2024-05-25T03:15:00+00:00 2024-05-25T03:14:01.101685155Z [2024-05-25T03:14:01.101+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:14:01.112680165Z [2024-05-25T03:14:01.112+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:14:00+00:00, run_after=2024-05-25T03:15:00+00:00 2024-05-25T03:14:01.174931303Z [2024-05-25T03:14:01.174+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T03:14:01.174973139Z 2024-05-25T03:14:01.174983943Z 2024-05-25T03:14:01.174992526Z 2024-05-25T03:14:01.175001503Z 2024-05-25T03:14:01.175010908Z [2024-05-25T03:14:01.174+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T03:14:01.175154929Z [2024-05-25T03:14:01.174+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:14:01.175344192Z [2024-05-25T03:14:01.175+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:14:01.175502248Z [2024-05-25T03:14:01.175+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:14:01.176203327Z [2024-05-25T03:14:01.175+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:14:01.176215201Z 2024-05-25T03:14:01.176219055Z 2024-05-25T03:14:01.176222154Z 2024-05-25T03:14:01.176225131Z 2024-05-25T03:14:01.179586205Z [2024-05-25T03:14:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:14:01.179814409Z [2024-05-25T03:14:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:14:01.180199165Z [2024-05-25T03:14:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:14:01.180404612Z [2024-05-25T03:14:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:14:01.180711734Z [2024-05-25T03:14:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:14:01.180907512Z [2024-05-25T03:14:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:14:01.181189972Z [2024-05-25T03:14:01.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:14:01.181519252Z [2024-05-25T03:14:01.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:14:01.642172701Z [2024-05-25T03:14:01.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:12:00+00:00 exited with status queued for try_number 1 2024-05-25T03:14:01.645486719Z [2024-05-25T03:14:01.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:13:00+00:00 exited with status queued for try_number 1 2024-05-25T03:14:01.645755656Z [2024-05-25T03:14:01.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:13:00+00:00 exited with status queued for try_number 1 2024-05-25T03:14:01.645938033Z [2024-05-25T03:14:01.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:13:00+00:00 exited with status queued for try_number 1 2024-05-25T03:14:01.670600342Z [2024-05-25T03:14:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8d3535a-be10-4ec7-8cf4-6c50459e3bd2 2024-05-25T03:14:01.670922795Z [2024-05-25T03:14:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10716d66-fa30-44b6-b35b-430636e0c558 2024-05-25T03:14:01.671183968Z [2024-05-25T03:14:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb88089d-6132-4516-a9d2-3e393fe2ddbf 2024-05-25T03:14:01.671434640Z [2024-05-25T03:14:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8c49e9d-cfef-42de-9d1f-b1eb09772105 2024-05-25T03:14:04.083824174Z [2024-05-25T03:14:04.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:14:04.084494731Z [2024-05-25T03:14:04.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 03:12:00+00:00, run_id=scheduled__2024-05-25T03:12:00+00:00, run_start_date=2024-05-25 03:14:01.122062+00:00, run_end_date=2024-05-25 03:14:04.083660+00:00, run_duration=2.961598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:12:00+00:00, data_interval_end=2024-05-25 03:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T03:14:04.092685756Z [2024-05-25T03:14:04.092+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T03:14:00+00:00, run_after=2024-05-25T03:16:00+00:00 2024-05-25T03:14:04.099570753Z [2024-05-25T03:14:04.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:14:04.099776458Z [2024-05-25T03:14:04.099+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:13:00+00:00, run_id=scheduled__2024-05-25T03:13:00+00:00, run_start_date=2024-05-25 03:14:01.123282+00:00, run_end_date=2024-05-25 03:14:04.099449+00:00, run_duration=2.976167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:13:00+00:00, data_interval_end=2024-05-25 03:14:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:14:04.116423170Z [2024-05-25T03:14:04.115+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:14:00+00:00, run_after=2024-05-25T03:15:00+00:00 2024-05-25T03:14:04.167278390Z [2024-05-25T03:14:04.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:12:00+00:00 exited with status success for try_number 1 2024-05-25T03:14:04.167350390Z [2024-05-25T03:14:04.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:13:00+00:00 exited with status success for try_number 1 2024-05-25T03:14:04.173593388Z [2024-05-25T03:14:04.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T03:12:00+00:00, map_index=-1, run_start_date=2024-05-25 03:14:02.691307+00:00, run_end_date=2024-05-25 03:14:03.280342+00:00, run_duration=0.589035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:14:01.176999+00:00, queued_by_job_id=1, pid=16511 2024-05-25T03:14:04.173812382Z [2024-05-25T03:14:04.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:13:00+00:00, map_index=-1, run_start_date=2024-05-25 03:14:02.765298+00:00, run_end_date=2024-05-25 03:14:03.299123+00:00, run_duration=0.533825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:14:01.176999+00:00, queued_by_job_id=1, pid=16510 2024-05-25T03:14:05.224255491Z [2024-05-25T03:14:05.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:14:05.225062001Z [2024-05-25T03:14:05.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:13:00+00:00, run_id=scheduled__2024-05-25T03:13:00+00:00, run_start_date=2024-05-25 03:14:01.124292+00:00, run_end_date=2024-05-25 03:14:05.224380+00:00, run_duration=4.100088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:13:00+00:00, data_interval_end=2024-05-25 03:14:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:14:05.243812834Z [2024-05-25T03:14:05.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:14:00+00:00, run_after=2024-05-25T03:15:00+00:00 2024-05-25T03:14:05.295290341Z [2024-05-25T03:14:05.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:13:00+00:00 exited with status success for try_number 1 2024-05-25T03:14:05.305487082Z [2024-05-25T03:14:05.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:13:00+00:00, map_index=-1, run_start_date=2024-05-25 03:14:03.724541+00:00, run_end_date=2024-05-25 03:14:05.102270+00:00, run_duration=1.377729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:14:01.176999+00:00, queued_by_job_id=1, pid=16533 2024-05-25T03:14:05.583182753Z [2024-05-25T03:14:05.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:14:05.583488138Z [2024-05-25T03:14:05.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:13:00+00:00, run_id=scheduled__2024-05-25T03:13:00+00:00, run_start_date=2024-05-25 03:14:01.125198+00:00, run_end_date=2024-05-25 03:14:05.583004+00:00, run_duration=4.457806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:13:00+00:00, data_interval_end=2024-05-25 03:14:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:14:05.597394776Z [2024-05-25T03:14:05.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:14:00+00:00, run_after=2024-05-25T03:15:00+00:00 2024-05-25T03:14:06.728464844Z [2024-05-25T03:14:06.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:13:00+00:00 exited with status success for try_number 1 2024-05-25T03:14:06.733445286Z [2024-05-25T03:14:06.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:13:00+00:00, map_index=-1, run_start_date=2024-05-25 03:14:03.908115+00:00, run_end_date=2024-05-25 03:14:05.522769+00:00, run_duration=1.614654, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:14:01.176999+00:00, queued_by_job_id=1, pid=16534 2024-05-25T03:15:00.896471464Z [2024-05-25T03:15:00.896+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:15:00+00:00, run_after=2024-05-25T03:16:00+00:00 2024-05-25T03:15:00.918984943Z [2024-05-25T03:15:00.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:15:00+00:00, run_after=2024-05-25T03:20:00+00:00 2024-05-25T03:15:00.929329513Z [2024-05-25T03:15:00.928+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:15:00.949560103Z [2024-05-25T03:15:00.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:15:00+00:00, run_after=2024-05-25T03:16:00+00:00 2024-05-25T03:15:01.049262702Z [2024-05-25T03:15:01.048+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T03:15:01.049301603Z 2024-05-25T03:15:01.049321352Z 2024-05-25T03:15:01.049329020Z 2024-05-25T03:15:01.049336288Z 2024-05-25T03:15:01.049531615Z [2024-05-25T03:15:01.049+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:15:01.049686878Z [2024-05-25T03:15:01.049+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:15:01.049826040Z [2024-05-25T03:15:01.049+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:15:01.049964065Z [2024-05-25T03:15:01.049+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:15:01.050621571Z [2024-05-25T03:15:01.050+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:15:01.050632391Z 2024-05-25T03:15:01.050639475Z 2024-05-25T03:15:01.050650930Z 2024-05-25T03:15:01.050658019Z 2024-05-25T03:15:01.054543533Z [2024-05-25T03:15:01.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T03:15:01.054732276Z [2024-05-25T03:15:01.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:15:01.054981788Z [2024-05-25T03:15:01.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:15:01.055089257Z [2024-05-25T03:15:01.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:15:01.055326796Z [2024-05-25T03:15:01.055+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:15:01.055440303Z [2024-05-25T03:15:01.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:15:01.055657379Z [2024-05-25T03:15:01.055+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:15:01.055752773Z [2024-05-25T03:15:01.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:15:01.490966118Z [2024-05-25T03:15:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status queued for try_number 1 2024-05-25T03:15:01.490991435Z [2024-05-25T03:15:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:14:00+00:00 exited with status queued for try_number 1 2024-05-25T03:15:01.490994965Z [2024-05-25T03:15:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:14:00+00:00 exited with status queued for try_number 1 2024-05-25T03:15:01.491241950Z [2024-05-25T03:15:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:14:00+00:00 exited with status queued for try_number 1 2024-05-25T03:15:01.505603719Z [2024-05-25T03:15:01.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10a87ed7-d1b9-4b32-9ad9-c64c6db31b22 2024-05-25T03:15:01.509643828Z [2024-05-25T03:15:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 737bedc1-8b31-4704-aaa6-509d92dbd410 2024-05-25T03:15:01.509806011Z [2024-05-25T03:15:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe6232b8-ee80-42db-a632-45a399b1c45e 2024-05-25T03:15:01.509960880Z [2024-05-25T03:15:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4874c365-5d00-4864-b65c-a5d37a5f07bf 2024-05-25T03:15:02.762927594Z [2024-05-25T03:15:02.762+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:15:02.763408349Z [2024-05-25T03:15:02.763+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:14:00+00:00, run_id=scheduled__2024-05-25T03:14:00+00:00, run_start_date=2024-05-25 03:15:00.961950+00:00, run_end_date=2024-05-25 03:15:02.763010+00:00, run_duration=1.80106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:14:00+00:00, data_interval_end=2024-05-25 03:15:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:15:02.778918244Z [2024-05-25T03:15:02.778+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:15:00+00:00, run_after=2024-05-25T03:16:00+00:00 2024-05-25T03:15:02.850883319Z [2024-05-25T03:15:02.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:14:00+00:00 exited with status success for try_number 1 2024-05-25T03:15:02.856635181Z [2024-05-25T03:15:02.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:14:00+00:00, map_index=-1, run_start_date=2024-05-25 03:15:01.874046+00:00, run_end_date=2024-05-25 03:15:02.454468+00:00, run_duration=0.580422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:15:01.051648+00:00, queued_by_job_id=1, pid=16567 2024-05-25T03:15:03.956454575Z [2024-05-25T03:15:03.955+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:15:03.956504246Z 2024-05-25T03:15:03.956805634Z [2024-05-25T03:15:03.956+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:15:03.958559539Z [2024-05-25T03:15:03.958+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:15:03.958573620Z 2024-05-25T03:15:03.963518862Z [2024-05-25T03:15:03.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='split_metrics', run_id='scheduled__2024-05-25T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T03:15:03.964042439Z [2024-05-25T03:15:03.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:15:04.033264359Z [2024-05-25T03:15:04.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status queued for try_number 1 2024-05-25T03:15:04.033441428Z [2024-05-25T03:15:04.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status success for try_number 1 2024-05-25T03:15:04.038923021Z [2024-05-25T03:15:04.038+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8eb6c81e-6581-4f32-b32f-d53ae57f4cf0 2024-05-25T03:15:04.039272761Z [2024-05-25T03:15:04.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T03:10:00+00:00, map_index=-1, run_start_date=2024-05-25 03:15:03.021323+00:00, run_end_date=2024-05-25 03:15:03.414492+00:00, run_duration=0.393169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1131, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:15:01.051648+00:00, queued_by_job_id=1, pid=16586 2024-05-25T03:15:05.219723229Z [2024-05-25T03:15:05.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:15:05.220092547Z [2024-05-25T03:15:05.219+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:14:00+00:00, run_id=scheduled__2024-05-25T03:14:00+00:00, run_start_date=2024-05-25 03:15:00.963305+00:00, run_end_date=2024-05-25 03:15:05.219683+00:00, run_duration=4.256378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:14:00+00:00, data_interval_end=2024-05-25 03:15:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:15:05.230975278Z [2024-05-25T03:15:05.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:15:00+00:00, run_after=2024-05-25T03:16:00+00:00 2024-05-25T03:15:05.242341725Z [2024-05-25T03:15:05.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:15:05.242605849Z [2024-05-25T03:15:05.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:14:00+00:00, run_id=scheduled__2024-05-25T03:14:00+00:00, run_start_date=2024-05-25 03:15:00.964658+00:00, run_end_date=2024-05-25 03:15:05.242322+00:00, run_duration=4.277664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:14:00+00:00, data_interval_end=2024-05-25 03:15:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:15:05.254001910Z [2024-05-25T03:15:05.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:15:00+00:00, run_after=2024-05-25T03:16:00+00:00 2024-05-25T03:15:05.317594944Z [2024-05-25T03:15:05.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:14:00+00:00 exited with status success for try_number 1 2024-05-25T03:15:05.317826316Z [2024-05-25T03:15:05.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:14:00+00:00 exited with status success for try_number 1 2024-05-25T03:15:05.328219450Z [2024-05-25T03:15:05.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:14:00+00:00, map_index=-1, run_start_date=2024-05-25 03:15:03.284217+00:00, run_end_date=2024-05-25 03:15:04.533532+00:00, run_duration=1.249315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:15:01.051648+00:00, queued_by_job_id=1, pid=16593 2024-05-25T03:15:05.328567562Z [2024-05-25T03:15:05.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:14:00+00:00, map_index=-1, run_start_date=2024-05-25 03:15:03.175027+00:00, run_end_date=2024-05-25 03:15:04.883857+00:00, run_duration=1.70883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:15:01.051648+00:00, queued_by_job_id=1, pid=16592 2024-05-25T03:15:07.220066954Z [2024-05-25T03:15:07.219+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:15:07.220092939Z 2024-05-25T03:15:07.220117311Z [2024-05-25T03:15:07.219+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:15:07.220645444Z [2024-05-25T03:15:07.220+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:15:07.220660816Z 2024-05-25T03:15:07.222608513Z [2024-05-25T03:15:07.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='collect_metrics', run_id='scheduled__2024-05-25T03:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T03:15:07.222675703Z [2024-05-25T03:15:07.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T03:15:07.284726632Z [2024-05-25T03:15:07.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status queued for try_number 1 2024-05-25T03:15:07.284758128Z [2024-05-25T03:15:07.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.split_metrics run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status success for try_number 1 2024-05-25T03:15:07.293631881Z [2024-05-25T03:15:07.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to bacb332a-6e25-4e57-acd5-43d6443f28b0 2024-05-25T03:15:07.293751031Z [2024-05-25T03:15:07.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=split_metrics, run_id=scheduled__2024-05-25T03:10:00+00:00, map_index=-1, run_start_date=2024-05-25 03:15:05.689575+00:00, run_end_date=2024-05-25 03:15:06.098037+00:00, run_duration=0.408462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1134, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:15:03.959465+00:00, queued_by_job_id=1, pid=16616 2024-05-25T03:15:10.142610822Z [2024-05-25T03:15:10.142+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T03:15:10.142651109Z 2024-05-25T03:15:10.142842091Z [2024-05-25T03:15:10.142+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:15:10.143976208Z [2024-05-25T03:15:10.143+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:15:10.143994801Z 2024-05-25T03:15:10.146818636Z [2024-05-25T03:15:10.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='send_prometheus', run_id='scheduled__2024-05-25T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:15:10.147062322Z [2024-05-25T03:15:10.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:15:10.210795508Z [2024-05-25T03:15:10.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status queued for try_number 1 2024-05-25T03:15:10.210859278Z [2024-05-25T03:15:10.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.collect_metrics run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status success for try_number 1 2024-05-25T03:15:10.222014158Z [2024-05-25T03:15:10.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47a2771f-3c2f-4cd6-873d-fbd99b572643 2024-05-25T03:15:10.222245004Z [2024-05-25T03:15:10.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=collect_metrics, run_id=scheduled__2024-05-25T03:10:00+00:00, map_index=0, run_start_date=2024-05-25 03:15:09.105019+00:00, run_end_date=2024-05-25 03:15:09.494582+00:00, run_duration=0.389563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1135, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:15:07.220895+00:00, queued_by_job_id=1, pid=16637 2024-05-25T03:15:12.453927456Z [2024-05-25T03:15:12.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:15:12.454407230Z [2024-05-25T03:15:12.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:10:00+00:00, run_id=scheduled__2024-05-25T03:10:00+00:00, run_start_date=2024-05-25 03:15:00.960449+00:00, run_end_date=2024-05-25 03:15:12.453799+00:00, run_duration=11.49335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:10:00+00:00, data_interval_end=2024-05-25 03:15:00+00:00, dag_hash=f6369e7243341cebcdfc88cb7caf38f4 2024-05-25T03:15:12.466281445Z [2024-05-25T03:15:12.465+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:15:00+00:00, run_after=2024-05-25T03:20:00+00:00 2024-05-25T03:15:12.508796173Z [2024-05-25T03:15:12.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.send_prometheus run_id=scheduled__2024-05-25T03:10:00+00:00 exited with status success for try_number 1 2024-05-25T03:15:12.516535675Z [2024-05-25T03:15:12.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=send_prometheus, run_id=scheduled__2024-05-25T03:10:00+00:00, map_index=-1, run_start_date=2024-05-25 03:15:11.726659+00:00, run_end_date=2024-05-25 03:15:12.123947+00:00, run_duration=0.397288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:15:10.144439+00:00, queued_by_job_id=1, pid=16645 2024-05-25T03:15:30.765197212Z [2024-05-25T03:15:30.764+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T03:16:00.805998837Z [2024-05-25T03:16:00.805+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:16:00.825625276Z [2024-05-25T03:16:00.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:16:00+00:00, run_after=2024-05-25T03:17:00+00:00 2024-05-25T03:16:00.834616531Z [2024-05-25T03:16:00.834+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:16:00.849749273Z [2024-05-25T03:16:00.849+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:16:00+00:00, run_after=2024-05-25T03:17:00+00:00 2024-05-25T03:16:00.953065804Z [2024-05-25T03:16:00.952+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T03:16:00.953105247Z 2024-05-25T03:16:00.953114195Z 2024-05-25T03:16:00.953120878Z 2024-05-25T03:16:00.953127260Z 2024-05-25T03:16:00.953160767Z [2024-05-25T03:16:00.952+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T03:16:00.953319264Z [2024-05-25T03:16:00.953+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:16:00.953456953Z [2024-05-25T03:16:00.953+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:16:00.953598493Z [2024-05-25T03:16:00.953+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:16:00.954730259Z [2024-05-25T03:16:00.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:16:00.954751871Z 2024-05-25T03:16:00.954759257Z 2024-05-25T03:16:00.954766187Z 2024-05-25T03:16:00.954772660Z 2024-05-25T03:16:00.961153705Z [2024-05-25T03:16:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:16:00.961264856Z [2024-05-25T03:16:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:16:00.961654846Z [2024-05-25T03:16:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:16:00.961835060Z [2024-05-25T03:16:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:16:00.962024073Z [2024-05-25T03:16:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:16:00.962118497Z [2024-05-25T03:16:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:16:00.962385318Z [2024-05-25T03:16:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:16:00.962507951Z [2024-05-25T03:16:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:16:01.336867424Z [2024-05-25T03:16:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:14:00+00:00 exited with status queued for try_number 1 2024-05-25T03:16:01.336981714Z [2024-05-25T03:16:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:15:00+00:00 exited with status queued for try_number 1 2024-05-25T03:16:01.337012599Z [2024-05-25T03:16:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:15:00+00:00 exited with status queued for try_number 1 2024-05-25T03:16:01.337018669Z [2024-05-25T03:16:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:15:00+00:00 exited with status queued for try_number 1 2024-05-25T03:16:01.353805151Z [2024-05-25T03:16:01.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91dbef3d-fd51-4a8c-8bb8-2a9ce581a997 2024-05-25T03:16:01.353828859Z [2024-05-25T03:16:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9588493-4402-4140-93dd-f990b596de2f 2024-05-25T03:16:01.353832595Z [2024-05-25T03:16:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b506ad2-815d-4451-bffb-feebf45d3770 2024-05-25T03:16:01.353836019Z [2024-05-25T03:16:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a6dbd1c-3e66-4fd5-88a8-1646daa15c95 2024-05-25T03:16:02.494170517Z [2024-05-25T03:16:02.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:16:02.494951574Z [2024-05-25T03:16:02.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 03:14:00+00:00, run_id=scheduled__2024-05-25T03:14:00+00:00, run_start_date=2024-05-25 03:16:00.868350+00:00, run_end_date=2024-05-25 03:16:02.494122+00:00, run_duration=1.625772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:14:00+00:00, data_interval_end=2024-05-25 03:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T03:16:02.515044047Z [2024-05-25T03:16:02.514+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T03:16:00+00:00, run_after=2024-05-25T03:18:00+00:00 2024-05-25T03:16:02.526248116Z [2024-05-25T03:16:02.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:16:02.526391628Z [2024-05-25T03:16:02.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:15:00+00:00, run_id=scheduled__2024-05-25T03:15:00+00:00, run_start_date=2024-05-25 03:16:00.869990+00:00, run_end_date=2024-05-25 03:16:02.526101+00:00, run_duration=1.656111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:15:00+00:00, data_interval_end=2024-05-25 03:16:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:16:02.538365064Z [2024-05-25T03:16:02.538+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:16:00+00:00, run_after=2024-05-25T03:17:00+00:00 2024-05-25T03:16:02.589823502Z [2024-05-25T03:16:02.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:14:00+00:00 exited with status success for try_number 1 2024-05-25T03:16:02.596428690Z [2024-05-25T03:16:02.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T03:14:00+00:00, map_index=-1, run_start_date=2024-05-25 03:16:01.863607+00:00, run_end_date=2024-05-25 03:16:02.185856+00:00, run_duration=0.322249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:16:00.956112+00:00, queued_by_job_id=1, pid=16655 2024-05-25T03:16:02.687309827Z [2024-05-25T03:16:02.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:15:00+00:00 exited with status success for try_number 1 2024-05-25T03:16:02.694775488Z [2024-05-25T03:16:02.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:15:00+00:00, map_index=-1, run_start_date=2024-05-25 03:16:01.900457+00:00, run_end_date=2024-05-25 03:16:02.431739+00:00, run_duration=0.531282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:16:00.956112+00:00, queued_by_job_id=1, pid=16656 2024-05-25T03:16:04.916544546Z [2024-05-25T03:16:04.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:16:04.917234340Z [2024-05-25T03:16:04.916+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:15:00+00:00, run_id=scheduled__2024-05-25T03:15:00+00:00, run_start_date=2024-05-25 03:16:00.871362+00:00, run_end_date=2024-05-25 03:16:04.916822+00:00, run_duration=4.04546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:15:00+00:00, data_interval_end=2024-05-25 03:16:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:16:04.925756226Z [2024-05-25T03:16:04.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:16:00+00:00, run_after=2024-05-25T03:17:00+00:00 2024-05-25T03:16:04.951688603Z [2024-05-25T03:16:04.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:16:04.952035984Z [2024-05-25T03:16:04.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:15:00+00:00, run_id=scheduled__2024-05-25T03:15:00+00:00, run_start_date=2024-05-25 03:16:00.872836+00:00, run_end_date=2024-05-25 03:16:04.951520+00:00, run_duration=4.078684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:15:00+00:00, data_interval_end=2024-05-25 03:16:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:16:04.965901356Z [2024-05-25T03:16:04.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:16:00+00:00, run_after=2024-05-25T03:17:00+00:00 2024-05-25T03:16:05.015837737Z [2024-05-25T03:16:05.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:15:00+00:00 exited with status success for try_number 1 2024-05-25T03:16:05.015874843Z [2024-05-25T03:16:05.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:15:00+00:00 exited with status success for try_number 1 2024-05-25T03:16:05.024387070Z [2024-05-25T03:16:05.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:15:00+00:00, map_index=-1, run_start_date=2024-05-25 03:16:03.291816+00:00, run_end_date=2024-05-25 03:16:04.765733+00:00, run_duration=1.473917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:16:00.956112+00:00, queued_by_job_id=1, pid=16680 2024-05-25T03:16:05.024460333Z [2024-05-25T03:16:05.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:15:00+00:00, map_index=-1, run_start_date=2024-05-25 03:16:03.101817+00:00, run_end_date=2024-05-25 03:16:04.771966+00:00, run_duration=1.670149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:16:00.956112+00:00, queued_by_job_id=1, pid=16679 2024-05-25T03:17:00.780867153Z [2024-05-25T03:17:00.780+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:17:00.800736041Z [2024-05-25T03:17:00.800+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:17:00+00:00, run_after=2024-05-25T03:18:00+00:00 2024-05-25T03:17:00.816806144Z [2024-05-25T03:17:00.815+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:17:00+00:00, run_after=2024-05-25T03:18:00+00:00 2024-05-25T03:17:00.895240197Z [2024-05-25T03:17:00.894+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T03:17:00.895292539Z 2024-05-25T03:17:00.895300060Z 2024-05-25T03:17:00.895305963Z 2024-05-25T03:17:00.895530292Z [2024-05-25T03:17:00.895+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:17:00.895806560Z [2024-05-25T03:17:00.895+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:17:00.896078154Z [2024-05-25T03:17:00.895+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:17:00.897102952Z [2024-05-25T03:17:00.896+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:17:00.897109873Z 2024-05-25T03:17:00.897113570Z 2024-05-25T03:17:00.897117054Z 2024-05-25T03:17:00.901611455Z [2024-05-25T03:17:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:17:00.901916961Z [2024-05-25T03:17:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:17:00.902498592Z [2024-05-25T03:17:00.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:17:00.902784786Z [2024-05-25T03:17:00.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:17:00.903098131Z [2024-05-25T03:17:00.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:17:00.903277131Z [2024-05-25T03:17:00.903+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:17:01.142841185Z [2024-05-25T03:17:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:16:00+00:00 exited with status queued for try_number 1 2024-05-25T03:17:01.143290280Z [2024-05-25T03:17:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:16:00+00:00 exited with status queued for try_number 1 2024-05-25T03:17:01.143666840Z [2024-05-25T03:17:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:16:00+00:00 exited with status queued for try_number 1 2024-05-25T03:17:01.156127549Z [2024-05-25T03:17:01.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15c34048-9a67-45fc-b68c-7a5310695643 2024-05-25T03:17:01.156471840Z [2024-05-25T03:17:01.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d8afc82-ea3b-419d-8a75-3b4222a69477 2024-05-25T03:17:01.156792588Z [2024-05-25T03:17:01.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a6791c3-bbb0-4fd9-9199-d5dacc1167ee 2024-05-25T03:17:02.347839348Z [2024-05-25T03:17:02.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:17:02.347881204Z [2024-05-25T03:17:02.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:16:00+00:00, run_id=scheduled__2024-05-25T03:16:00+00:00, run_start_date=2024-05-25 03:17:00.829185+00:00, run_end_date=2024-05-25 03:17:02.347107+00:00, run_duration=1.517922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:16:00+00:00, data_interval_end=2024-05-25 03:17:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:17:02.361043169Z [2024-05-25T03:17:02.360+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:17:00+00:00, run_after=2024-05-25T03:18:00+00:00 2024-05-25T03:17:02.424127977Z [2024-05-25T03:17:02.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:16:00+00:00 exited with status success for try_number 1 2024-05-25T03:17:02.429087287Z [2024-05-25T03:17:02.428+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:16:00+00:00, map_index=-1, run_start_date=2024-05-25 03:17:01.674430+00:00, run_end_date=2024-05-25 03:17:02.124351+00:00, run_duration=0.449921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:17:00.898312+00:00, queued_by_job_id=1, pid=16712 2024-05-25T03:17:05.935176402Z [2024-05-25T03:17:05.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:17:05.935454959Z [2024-05-25T03:17:05.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:16:00+00:00, run_id=scheduled__2024-05-25T03:16:00+00:00, run_start_date=2024-05-25 03:17:00.830439+00:00, run_end_date=2024-05-25 03:17:05.934945+00:00, run_duration=5.104506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:16:00+00:00, data_interval_end=2024-05-25 03:17:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:17:05.949390993Z [2024-05-25T03:17:05.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:17:00+00:00, run_after=2024-05-25T03:18:00+00:00 2024-05-25T03:17:05.957880626Z [2024-05-25T03:17:05.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:17:05.958058844Z [2024-05-25T03:17:05.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:16:00+00:00, run_id=scheduled__2024-05-25T03:16:00+00:00, run_start_date=2024-05-25 03:17:00.831425+00:00, run_end_date=2024-05-25 03:17:05.957711+00:00, run_duration=5.126286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:16:00+00:00, data_interval_end=2024-05-25 03:17:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:17:05.968252216Z [2024-05-25T03:17:05.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:17:00+00:00, run_after=2024-05-25T03:18:00+00:00 2024-05-25T03:17:06.016181305Z [2024-05-25T03:17:06.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:16:00+00:00 exited with status success for try_number 1 2024-05-25T03:17:06.016345540Z [2024-05-25T03:17:06.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:16:00+00:00 exited with status success for try_number 1 2024-05-25T03:17:06.029549696Z [2024-05-25T03:17:06.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:16:00+00:00, map_index=-1, run_start_date=2024-05-25 03:17:02.815862+00:00, run_end_date=2024-05-25 03:17:05.257902+00:00, run_duration=2.44204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:17:00.898312+00:00, queued_by_job_id=1, pid=16730 2024-05-25T03:17:06.029699468Z [2024-05-25T03:17:06.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:16:00+00:00, map_index=-1, run_start_date=2024-05-25 03:17:02.831713+00:00, run_end_date=2024-05-25 03:17:04.930829+00:00, run_duration=2.099116, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:17:00.898312+00:00, queued_by_job_id=1, pid=16731 2024-05-25T03:18:00.484718041Z [2024-05-25T03:18:00.483+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:18:00.501165584Z [2024-05-25T03:18:00.500+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:18:00.529377736Z [2024-05-25T03:18:00.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:18:00+00:00, run_after=2024-05-25T03:19:00+00:00 2024-05-25T03:18:00.544578637Z [2024-05-25T03:18:00.544+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:18:00+00:00, run_after=2024-05-25T03:19:00+00:00 2024-05-25T03:18:00.658072759Z [2024-05-25T03:18:00.657+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T03:18:00.658098582Z 2024-05-25T03:18:00.658103711Z 2024-05-25T03:18:00.658107756Z 2024-05-25T03:18:00.658111566Z 2024-05-25T03:18:00.658269624Z [2024-05-25T03:18:00.657+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T03:18:00.658522840Z [2024-05-25T03:18:00.658+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:18:00.658701565Z [2024-05-25T03:18:00.658+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:18:00.658916535Z [2024-05-25T03:18:00.658+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:18:00.659654245Z [2024-05-25T03:18:00.659+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:18:00.659667081Z 2024-05-25T03:18:00.659671838Z 2024-05-25T03:18:00.659675580Z 2024-05-25T03:18:00.659680929Z 2024-05-25T03:18:00.664665270Z [2024-05-25T03:18:00.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:18:00.664708395Z [2024-05-25T03:18:00.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:18:00.665100395Z [2024-05-25T03:18:00.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:18:00.665130488Z [2024-05-25T03:18:00.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:18:00.665552235Z [2024-05-25T03:18:00.665+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:18:00.665681098Z [2024-05-25T03:18:00.665+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:18:00.665954490Z [2024-05-25T03:18:00.665+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:18:00.665990689Z [2024-05-25T03:18:00.665+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:18:00.964004170Z [2024-05-25T03:18:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:16:00+00:00 exited with status queued for try_number 1 2024-05-25T03:18:00.964306266Z [2024-05-25T03:18:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:17:00+00:00 exited with status queued for try_number 1 2024-05-25T03:18:00.964525854Z [2024-05-25T03:18:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:17:00+00:00 exited with status queued for try_number 1 2024-05-25T03:18:00.964759726Z [2024-05-25T03:18:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:17:00+00:00 exited with status queued for try_number 1 2024-05-25T03:18:00.983906576Z [2024-05-25T03:18:00.983+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22691088-595b-489b-bee0-664b992d8f4c 2024-05-25T03:18:00.984351495Z [2024-05-25T03:18:00.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to 350645fe-c019-445a-a741-ab50954c2793 2024-05-25T03:18:00.984682449Z [2024-05-25T03:18:00.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1dd1ab5-056c-40da-a6ec-58c56c7636be 2024-05-25T03:18:00.985021412Z [2024-05-25T03:18:00.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d87da8d-b55c-4c81-afa8-140c50a8c46a 2024-05-25T03:18:02.229285474Z [2024-05-25T03:18:02.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:18:02.229318263Z [2024-05-25T03:18:02.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 03:16:00+00:00, run_id=scheduled__2024-05-25T03:16:00+00:00, run_start_date=2024-05-25 03:18:00.558292+00:00, run_end_date=2024-05-25 03:18:02.228421+00:00, run_duration=1.670129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:16:00+00:00, data_interval_end=2024-05-25 03:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T03:18:02.241177965Z [2024-05-25T03:18:02.239+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T03:18:00+00:00, run_after=2024-05-25T03:20:00+00:00 2024-05-25T03:18:02.253289314Z [2024-05-25T03:18:02.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:18:02.253319131Z [2024-05-25T03:18:02.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:17:00+00:00, run_id=scheduled__2024-05-25T03:17:00+00:00, run_start_date=2024-05-25 03:18:00.561182+00:00, run_end_date=2024-05-25 03:18:02.247769+00:00, run_duration=1.686587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:17:00+00:00, data_interval_end=2024-05-25 03:18:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:18:02.261538619Z [2024-05-25T03:18:02.259+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:18:00+00:00, run_after=2024-05-25T03:19:00+00:00 2024-05-25T03:18:02.326057986Z [2024-05-25T03:18:02.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T03:16:00+00:00 exited with status success for try_number 1 2024-05-25T03:18:02.326184904Z [2024-05-25T03:18:02.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:17:00+00:00 exited with status success for try_number 1 2024-05-25T03:18:02.332880764Z [2024-05-25T03:18:02.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:17:00+00:00, map_index=-1, run_start_date=2024-05-25 03:18:01.681991+00:00, run_end_date=2024-05-25 03:18:02.114934+00:00, run_duration=0.432943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:18:00.660780+00:00, queued_by_job_id=1, pid=16765 2024-05-25T03:18:02.333439410Z [2024-05-25T03:18:02.333+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T03:16:00+00:00, map_index=-1, run_start_date=2024-05-25 03:18:01.606100+00:00, run_end_date=2024-05-25 03:18:02.083541+00:00, run_duration=0.477441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:18:00.660780+00:00, queued_by_job_id=1, pid=16764 2024-05-25T03:18:04.285028246Z [2024-05-25T03:18:04.284+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:18:04.285685767Z [2024-05-25T03:18:04.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:17:00+00:00, run_id=scheduled__2024-05-25T03:17:00+00:00, run_start_date=2024-05-25 03:18:00.562897+00:00, run_end_date=2024-05-25 03:18:04.285120+00:00, run_duration=3.722223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:17:00+00:00, data_interval_end=2024-05-25 03:18:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:18:04.301416318Z [2024-05-25T03:18:04.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:18:00+00:00, run_after=2024-05-25T03:19:00+00:00 2024-05-25T03:18:04.360160312Z [2024-05-25T03:18:04.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:17:00+00:00 exited with status success for try_number 1 2024-05-25T03:18:04.368629223Z [2024-05-25T03:18:04.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:17:00+00:00, map_index=-1, run_start_date=2024-05-25 03:18:02.803971+00:00, run_end_date=2024-05-25 03:18:04.155434+00:00, run_duration=1.351463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:18:00.660780+00:00, queued_by_job_id=1, pid=16788 2024-05-25T03:18:05.433745339Z [2024-05-25T03:18:05.433+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:18:05.434369147Z [2024-05-25T03:18:05.434+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:17:00+00:00, run_id=scheduled__2024-05-25T03:17:00+00:00, run_start_date=2024-05-25 03:18:00.564409+00:00, run_end_date=2024-05-25 03:18:05.433941+00:00, run_duration=4.869532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:17:00+00:00, data_interval_end=2024-05-25 03:18:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:18:05.447717331Z [2024-05-25T03:18:05.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:18:00+00:00, run_after=2024-05-25T03:19:00+00:00 2024-05-25T03:18:05.501342522Z [2024-05-25T03:18:05.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:17:00+00:00 exited with status success for try_number 1 2024-05-25T03:18:05.512074147Z [2024-05-25T03:18:05.511+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:17:00+00:00, map_index=-1, run_start_date=2024-05-25 03:18:02.888638+00:00, run_end_date=2024-05-25 03:18:04.824836+00:00, run_duration=1.936198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:18:00.660780+00:00, queued_by_job_id=1, pid=16789 2024-05-25T03:19:00.903047462Z [2024-05-25T03:19:00.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:19:00+00:00, run_after=2024-05-25T03:20:00+00:00 2024-05-25T03:19:00.911504548Z [2024-05-25T03:19:00.911+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T03:19:00.925581903Z [2024-05-25T03:19:00.925+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:19:00+00:00, run_after=2024-05-25T03:20:00+00:00 2024-05-25T03:19:01.020224928Z [2024-05-25T03:19:01.019+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T03:19:01.020262251Z 2024-05-25T03:19:01.020269064Z 2024-05-25T03:19:01.020274723Z 2024-05-25T03:19:01.020515378Z [2024-05-25T03:19:01.020+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:19:01.020832618Z [2024-05-25T03:19:01.020+0000] {scheduler_job.py:425} INFO - DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 has 0/16 running and queued tasks 2024-05-25T03:19:01.021112778Z [2024-05-25T03:19:01.020+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf has 0/16 running and queued tasks 2024-05-25T03:19:01.022101806Z [2024-05-25T03:19:01.021+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T03:19:01.022121926Z 2024-05-25T03:19:01.022127830Z 2024-05-25T03:19:01.022133335Z 2024-05-25T03:19:01.026561540Z [2024-05-25T03:19:01.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:19:01.026656678Z [2024-05-25T03:19:01.026+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:19:01.027072923Z [2024-05-25T03:19:01.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:19:01.027308269Z [2024-05-25T03:19:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:19:01.027625144Z [2024-05-25T03:19:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T03:19:01.027816017Z [2024-05-25T03:19:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:19:01.307798143Z [2024-05-25T03:19:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:18:00+00:00 exited with status queued for try_number 1 2024-05-25T03:19:01.309832434Z [2024-05-25T03:19:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:18:00+00:00 exited with status queued for try_number 1 2024-05-25T03:19:01.310134511Z [2024-05-25T03:19:01.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:18:00+00:00 exited with status queued for try_number 1 2024-05-25T03:19:01.324227174Z [2024-05-25T03:19:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26e3c931-457d-4eef-a704-b586e63b4443 2024-05-25T03:19:01.324567743Z [2024-05-25T03:19:01.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2090a300-4a35-43aa-a2e5-67f7cd1d07ae 2024-05-25T03:19:01.324823700Z [2024-05-25T03:19:01.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to da098174-c1f4-4ff1-94be-29304a27a5c4 2024-05-25T03:19:03.116100026Z [2024-05-25T03:19:03.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:19:03.116441771Z [2024-05-25T03:19:03.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, execution_date=2024-05-25 03:18:00+00:00, run_id=scheduled__2024-05-25T03:18:00+00:00, run_start_date=2024-05-25 03:19:00.939043+00:00, run_end_date=2024-05-25 03:19:03.116111+00:00, run_duration=2.177068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:18:00+00:00, data_interval_end=2024-05-25 03:19:00+00:00, dag_hash=c5f8cbdbe4273782744cc8b1f4693fe9 2024-05-25T03:19:03.125138045Z [2024-05-25T03:19:03.124+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf to 2024-05-25T03:19:00+00:00, run_after=2024-05-25T03:20:00+00:00 2024-05-25T03:19:03.173093920Z [2024-05-25T03:19:03.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:18:00+00:00 exited with status success for try_number 1 2024-05-25T03:19:03.188507181Z [2024-05-25T03:19:03.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:18:00+00:00, map_index=-1, run_start_date=2024-05-25 03:19:01.822378+00:00, run_end_date=2024-05-25 03:19:02.245160+00:00, run_duration=0.422782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:19:01.023424+00:00, queued_by_job_id=1, pid=16821 2024-05-25T03:19:05.730419497Z [2024-05-25T03:19:05.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:19:05.730576706Z [2024-05-25T03:19:05.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:18:00+00:00, run_id=scheduled__2024-05-25T03:18:00+00:00, run_start_date=2024-05-25 03:19:00.940319+00:00, run_end_date=2024-05-25 03:19:05.730278+00:00, run_duration=4.789959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:18:00+00:00, data_interval_end=2024-05-25 03:19:00+00:00, dag_hash=763de130d3d8f92028e6a3b21f373028 2024-05-25T03:19:05.739039387Z [2024-05-25T03:19:05.738+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:19:00+00:00, run_after=2024-05-25T03:20:00+00:00 2024-05-25T03:19:05.745754038Z [2024-05-25T03:19:05.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T03:19:05.745872417Z [2024-05-25T03:19:05.745+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, execution_date=2024-05-25 03:18:00+00:00, run_id=scheduled__2024-05-25T03:18:00+00:00, run_start_date=2024-05-25 03:19:00.941577+00:00, run_end_date=2024-05-25 03:19:05.745608+00:00, run_duration=4.804031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 03:18:00+00:00, data_interval_end=2024-05-25 03:19:00+00:00, dag_hash=5d7489b0754af033e26ed152efec9a3b 2024-05-25T03:19:05.754712195Z [2024-05-25T03:19:05.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 to 2024-05-25T03:19:00+00:00, run_after=2024-05-25T03:20:00+00:00 2024-05-25T03:19:05.790779920Z [2024-05-25T03:19:05.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:18:00+00:00 exited with status success for try_number 1 2024-05-25T03:19:05.790939597Z [2024-05-25T03:19:05.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T03:18:00+00:00 exited with status success for try_number 1 2024-05-25T03:19:05.799272253Z [2024-05-25T03:19:05.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:18:00+00:00, map_index=-1, run_start_date=2024-05-25 03:19:02.914017+00:00, run_end_date=2024-05-25 03:19:04.612164+00:00, run_duration=1.698147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:19:01.023424+00:00, queued_by_job_id=1, pid=16840 2024-05-25T03:19:05.799692299Z [2024-05-25T03:19:05.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T03:18:00+00:00, map_index=-1, run_start_date=2024-05-25 03:19:02.852779+00:00, run_end_date=2024-05-25 03:19:05.337968+00:00, run_duration=2.485189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 03:19:01.023424+00:00, queued_by_job_id=1, pid=16839 2024-05-24T22:55:19.408871686Z 2024-05-24T22:55:19.465320229Z Cleaning logs every 900 seconds 2024-05-24T22:55:19.465342034Z Trimming airflow logs to 15 days. 2024-05-24T23:00:00.618674556Z Trimming airflow logs to 15 days. 2024-05-24T23:00:01.647568008Z Trimming airflow logs to 15 days. 2024-05-24T23:15:00.684164156Z Trimming airflow logs to 15 days. 2024-05-24T23:15:01.709586318Z Trimming airflow logs to 15 days. 2024-05-24T23:30:00.761513220Z Trimming airflow logs to 15 days. 2024-05-24T23:30:01.822282808Z Trimming airflow logs to 15 days. 2024-05-24T23:45:00.888272333Z Trimming airflow logs to 15 days. 2024-05-24T23:45:01.909747479Z Trimming airflow logs to 15 days. 2024-05-25T00:00:00.949896194Z Trimming airflow logs to 15 days. 2024-05-25T00:00:01.992286913Z Trimming airflow logs to 15 days. 2024-05-25T00:15:00.023839379Z Trimming airflow logs to 15 days. 2024-05-25T00:15:01.051924609Z Trimming airflow logs to 15 days. 2024-05-25T00:30:00.122426742Z Trimming airflow logs to 15 days. 2024-05-25T00:30:01.147458718Z Trimming airflow logs to 15 days. 2024-05-25T00:45:00.185329228Z Trimming airflow logs to 15 days. 2024-05-25T00:45:01.209757878Z Trimming airflow logs to 15 days. 2024-05-25T01:00:00.261485066Z Trimming airflow logs to 15 days. 2024-05-25T01:00:01.297543608Z Trimming airflow logs to 15 days. 2024-05-25T01:15:00.322128595Z Trimming airflow logs to 15 days. 2024-05-25T01:15:01.363775910Z Trimming airflow logs to 15 days. 2024-05-25T01:30:00.402858775Z Trimming airflow logs to 15 days. 2024-05-25T01:30:01.425500247Z Trimming airflow logs to 15 days. 2024-05-25T01:45:00.463476619Z Trimming airflow logs to 15 days. 2024-05-25T01:45:01.497472140Z Trimming airflow logs to 15 days. 2024-05-25T02:00:00.531269729Z Trimming airflow logs to 15 days. 2024-05-25T02:00:01.564803691Z Trimming airflow logs to 15 days. 2024-05-25T02:15:00.605413179Z Trimming airflow logs to 15 days. 2024-05-25T02:15:01.629918774Z Trimming airflow logs to 15 days. 2024-05-25T02:30:00.666204865Z Trimming airflow logs to 15 days. 2024-05-25T02:30:01.695891119Z Trimming airflow logs to 15 days. 2024-05-25T02:45:00.741273275Z Trimming airflow logs to 15 days. 2024-05-25T02:45:01.783277281Z Trimming airflow logs to 15 days. 2024-05-25T03:00:00.823222298Z Trimming airflow logs to 15 days. 2024-05-25T03:00:01.857721888Z Trimming airflow logs to 15 days. 2024-05-25T03:15:00.915052938Z Trimming airflow logs to 15 days. 2024-05-25T03:15:01.957785763Z Trimming airflow logs to 15 days.