2024-06-27T03:03:54.284800415Z ...... 2024-06-27T03:03:55.746213853Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-06-27T03:03:58.685401227Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-06-27T03:04:15.410536620Z [2024-06-27T03:04:15.406+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-06-27T03:04:16.449531512Z [2024-06-27T03:04:16.445+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-06-27T03:04:17.457376667Z [2024-06-27T03:04:17.456+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-06-27T03:04:18.469417735Z [2024-06-27T03:04:18.468+0000] {db.py:755} INFO - Waiting for migrations... 3 second(s) 2024-06-27T03:04:46.460373353Z 2024-06-27T03:04:48.500849492Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-06-27T03:04:51.314031060Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-06-27T03:05:02.056871424Z ____________ _____________ 2024-06-27T03:05:02.056902048Z ____ |__( )_________ __/__ /________ __ 2024-06-27T03:05:02.056907806Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-06-27T03:05:02.056912690Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-06-27T03:05:02.056917549Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-06-27T03:05:02.056923492Z [2024-06-27T03:05:02.053+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-06-27T03:05:02.056929000Z [2024-06-27T03:05:02.053+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-06-27T03:05:03.073809913Z [2024-06-27T03:05:03.072+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-06-27T03:05:03.093729751Z [2024-06-27T03:05:03.082+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 15 2024-06-27T03:05:03.093809361Z [2024-06-27T03:05:03.093+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T03:05:03.215449885Z [2024-06-27T03:05:03.143+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-06-27T03:05:03.224094660Z [2024-06-27T03:05:03.221+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-06-27T03:05:09.762507108Z [2024-06-27T03:05:09.762+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:05:10.584833509Z [2024-06-27T03:05:10.584+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:05:10.584858584Z 2024-06-27T03:05:10.585500982Z [2024-06-27T03:05:10.584+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:05:10.586352567Z [2024-06-27T03:05:10.586+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:05:10.586365789Z 2024-06-27T03:05:10.596529748Z [2024-06-27T03:05:10.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:05:10.600334804Z [2024-06-27T03:05:10.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:05:11.765223886Z [2024-06-27T03:05:11.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:02:00+00:00 exited with status queued for try_number 1 2024-06-27T03:05:11.874507926Z [2024-06-27T03:05:11.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to 337af795-fbd2-45f7-80fc-f8048fc4de96 2024-06-27T03:05:22.841021117Z [2024-06-27T03:05:22.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:02:00+00:00 exited with status success for try_number 1 2024-06-27T03:05:22.846610738Z [2024-06-27T03:05:22.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:02:00+00:00, map_index=-1, run_start_date=2024-06-27 03:05:20.253168+00:00, run_end_date=2024-06-27 03:05:21.298614+00:00, run_duration=1.045446, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:05:10.592672+00:00, queued_by_job_id=2, pid=37 2024-06-27T03:05:31.382922934Z [2024-06-27T03:05:31.381+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:05:31.382949090Z 2024-06-27T03:05:31.383535686Z [2024-06-27T03:05:31.381+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:05:31.383555092Z [2024-06-27T03:05:31.382+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:05:31.383559379Z 2024-06-27T03:05:31.396577481Z [2024-06-27T03:05:31.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:02:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:05:31.396595877Z [2024-06-27T03:05:31.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:05:31.463356524Z [2024-06-27T03:05:31.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:02:00+00:00 exited with status queued for try_number 2 2024-06-27T03:05:31.472404665Z [2024-06-27T03:05:31.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9eb8452d-5819-49d3-af6c-f554d2f92300 2024-06-27T03:05:35.216427880Z [2024-06-27T03:05:35.215+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T03:05:35.222486896Z [2024-06-27T03:05:35.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:02:00+00:00, run_id=scheduled__2024-06-27T03:02:00+00:00, run_start_date=2024-06-27 03:05:09.845592+00:00, run_end_date=2024-06-27 03:05:35.221113+00:00, run_duration=25.375521, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:02:00+00:00, data_interval_end=2024-06-27 03:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:05:35.239534515Z [2024-06-27T03:05:35.239+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:04:00+00:00, run_after=2024-06-27T03:06:00+00:00 2024-06-27T03:05:35.319318585Z [2024-06-27T03:05:35.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:02:00+00:00 exited with status success for try_number 2 2024-06-27T03:05:35.333406864Z [2024-06-27T03:05:35.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:02:00+00:00, map_index=-1, run_start_date=2024-06-27 03:05:33.257035+00:00, run_end_date=2024-06-27 03:05:33.967018+00:00, run_duration=0.709983, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:05:31.382703+00:00, queued_by_job_id=2, pid=48 2024-06-27T03:06:00.697286379Z [2024-06-27T03:06:00.696+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:06:00.805098558Z [2024-06-27T03:06:00.804+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:06:00.805114545Z 2024-06-27T03:06:00.807573228Z [2024-06-27T03:06:00.806+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:06:00.808561849Z [2024-06-27T03:06:00.808+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:06:00.808574439Z 2024-06-27T03:06:00.813554555Z [2024-06-27T03:06:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:06:00.813825270Z [2024-06-27T03:06:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:06:00.931655094Z [2024-06-27T03:06:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:04:00+00:00 exited with status queued for try_number 1 2024-06-27T03:06:00.947322532Z [2024-06-27T03:06:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b845284-40ef-4d0d-8fac-fc8c98718873 2024-06-27T03:06:03.278977103Z [2024-06-27T03:06:03.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:04:00+00:00 exited with status success for try_number 1 2024-06-27T03:06:03.285865785Z [2024-06-27T03:06:03.285+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:04:00+00:00, map_index=-1, run_start_date=2024-06-27 03:06:02.101825+00:00, run_end_date=2024-06-27 03:06:02.631211+00:00, run_duration=0.529386, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:06:00.809452+00:00, queued_by_job_id=2, pid=72 2024-06-27T03:06:13.340003665Z [2024-06-27T03:06:13.339+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:06:13.340027839Z 2024-06-27T03:06:13.340285133Z [2024-06-27T03:06:13.339+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:06:13.341647682Z [2024-06-27T03:06:13.341+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:06:13.341659906Z 2024-06-27T03:06:13.345295411Z [2024-06-27T03:06:13.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:04:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:06:13.345478468Z [2024-06-27T03:06:13.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:06:13.431247052Z [2024-06-27T03:06:13.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:04:00+00:00 exited with status queued for try_number 2 2024-06-27T03:06:13.438897355Z [2024-06-27T03:06:13.438+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07aa4d5d-cba6-4b64-a61f-d5ca2bcabc6c 2024-06-27T03:06:15.078685729Z [2024-06-27T03:06:15.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:06:15.079424002Z [2024-06-27T03:06:15.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:04:00+00:00, run_id=scheduled__2024-06-27T03:04:00+00:00, run_start_date=2024-06-27 03:06:00.717223+00:00, run_end_date=2024-06-27 03:06:15.078629+00:00, run_duration=14.361406, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:04:00+00:00, data_interval_end=2024-06-27 03:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:06:15.090226996Z [2024-06-27T03:06:15.089+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:06:00+00:00, run_after=2024-06-27T03:08:00+00:00 2024-06-27T03:06:15.141721043Z [2024-06-27T03:06:15.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:04:00+00:00 exited with status success for try_number 2 2024-06-27T03:06:15.151804888Z [2024-06-27T03:06:15.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:04:00+00:00, map_index=-1, run_start_date=2024-06-27 03:06:14.274726+00:00, run_end_date=2024-06-27 03:06:14.669603+00:00, run_duration=0.394877, state=success, executor_state=success, try_number=2, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:06:13.342075+00:00, queued_by_job_id=2, pid=83 2024-06-27T03:08:00.541770820Z [2024-06-27T03:08:00.540+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:08:00.606648438Z [2024-06-27T03:08:00.606+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:08:00.606661054Z 2024-06-27T03:08:00.606933025Z [2024-06-27T03:08:00.606+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:08:00.607608419Z [2024-06-27T03:08:00.607+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:08:00.607619537Z 2024-06-27T03:08:00.610011981Z [2024-06-27T03:08:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:08:00.610286588Z [2024-06-27T03:08:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:08:00.689056191Z [2024-06-27T03:08:00.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:06:00+00:00 exited with status queued for try_number 1 2024-06-27T03:08:00.696902727Z [2024-06-27T03:08:00.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e3b4f50-caf3-4660-a5a3-776e1f837e81 2024-06-27T03:08:03.309715821Z [2024-06-27T03:08:03.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:08:03.310069167Z [2024-06-27T03:08:03.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:06:00+00:00, run_id=scheduled__2024-06-27T03:06:00+00:00, run_start_date=2024-06-27 03:08:00.568011+00:00, run_end_date=2024-06-27 03:08:03.309707+00:00, run_duration=2.741696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:06:00+00:00, data_interval_end=2024-06-27 03:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:08:03.320876295Z [2024-06-27T03:08:03.320+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:08:00+00:00, run_after=2024-06-27T03:10:00+00:00 2024-06-27T03:08:03.358944736Z [2024-06-27T03:08:03.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:06:00+00:00 exited with status success for try_number 1 2024-06-27T03:08:03.369520889Z [2024-06-27T03:08:03.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:06:00+00:00, map_index=-1, run_start_date=2024-06-27 03:08:01.710415+00:00, run_end_date=2024-06-27 03:08:02.277115+00:00, run_duration=0.5667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:08:00.608102+00:00, queued_by_job_id=2, pid=121 2024-06-27T03:10:00.330706304Z [2024-06-27T03:10:00.329+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:10:00.409407027Z [2024-06-27T03:10:00.409+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:10:00.409426416Z 2024-06-27T03:10:00.409799021Z [2024-06-27T03:10:00.409+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:10:00.410837677Z [2024-06-27T03:10:00.410+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:10:00.410847165Z 2024-06-27T03:10:00.414152388Z [2024-06-27T03:10:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:10:00.414601674Z [2024-06-27T03:10:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:10:00.553507823Z [2024-06-27T03:10:00.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:08:00+00:00 exited with status queued for try_number 1 2024-06-27T03:10:00.568834559Z [2024-06-27T03:10:00.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d8715fe-6f53-45aa-af87-a393de2e233d 2024-06-27T03:10:03.052698788Z [2024-06-27T03:10:03.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:10:03.053166035Z [2024-06-27T03:10:03.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:08:00+00:00, run_id=scheduled__2024-06-27T03:08:00+00:00, run_start_date=2024-06-27 03:10:00.350323+00:00, run_end_date=2024-06-27 03:10:03.052494+00:00, run_duration=2.702171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:08:00+00:00, data_interval_end=2024-06-27 03:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:10:03.064675947Z [2024-06-27T03:10:03.064+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:10:00+00:00, run_after=2024-06-27T03:12:00+00:00 2024-06-27T03:10:03.114220587Z [2024-06-27T03:10:03.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:08:00+00:00 exited with status success for try_number 1 2024-06-27T03:10:03.131086484Z [2024-06-27T03:10:03.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:08:00+00:00, map_index=-1, run_start_date=2024-06-27 03:10:01.813659+00:00, run_end_date=2024-06-27 03:10:02.350924+00:00, run_duration=0.537265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:10:00.411312+00:00, queued_by_job_id=2, pid=157 2024-06-27T03:10:03.463508659Z [2024-06-27T03:10:03.463+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T03:12:01.037191750Z [2024-06-27T03:12:01.036+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:12:01.144938764Z [2024-06-27T03:12:01.143+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:12:01.144966981Z 2024-06-27T03:12:01.144972305Z [2024-06-27T03:12:01.143+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:12:01.144976448Z [2024-06-27T03:12:01.144+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:12:01.144980589Z 2024-06-27T03:12:01.147042370Z [2024-06-27T03:12:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:12:01.147928247Z [2024-06-27T03:12:01.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:12:01.280134225Z [2024-06-27T03:12:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status queued for try_number 1 2024-06-27T03:12:01.294587172Z [2024-06-27T03:12:01.294+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92a98151-4f3a-4428-a1fc-80d7fe9db02a 2024-06-27T03:12:02.445304273Z [2024-06-27T03:12:02.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:12:02.446147749Z [2024-06-27T03:12:02.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:10:00+00:00, run_id=scheduled__2024-06-27T03:10:00+00:00, run_start_date=2024-06-27 03:12:01.057793+00:00, run_end_date=2024-06-27 03:12:02.445188+00:00, run_duration=1.387395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:10:00+00:00, data_interval_end=2024-06-27 03:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:12:02.454821772Z [2024-06-27T03:12:02.454+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:12:00+00:00, run_after=2024-06-27T03:14:00+00:00 2024-06-27T03:12:03.571271083Z [2024-06-27T03:12:03.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status success for try_number 1 2024-06-27T03:12:03.578393763Z [2024-06-27T03:12:03.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:10:00+00:00, map_index=-1, run_start_date=2024-06-27 03:12:02.037214+00:00, run_end_date=2024-06-27 03:12:02.410104+00:00, run_duration=0.37289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:12:01.144502+00:00, queued_by_job_id=2, pid=194 2024-06-27T03:12:16.922238686Z [2024-06-27T03:12:16.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:12:00+00:00, run_after=2024-06-27T03:13:00+00:00 2024-06-27T03:12:16.997992427Z [2024-06-27T03:12:16.997+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:12:16.998008954Z 2024-06-27T03:12:16.998359959Z [2024-06-27T03:12:16.998+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:12:16.999319625Z [2024-06-27T03:12:16.999+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:12:16.999330693Z 2024-06-27T03:12:17.006630378Z [2024-06-27T03:12:17.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:12:17.007312375Z [2024-06-27T03:12:17.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:12:17.086822655Z [2024-06-27T03:12:17.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:11:00+00:00 exited with status queued for try_number 1 2024-06-27T03:12:17.093703323Z [2024-06-27T03:12:17.093+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb82db3b-b26e-4da9-bea7-5e3ab3668e4a 2024-06-27T03:12:24.001017032Z [2024-06-27T03:12:24.000+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:12:24.018436656Z [2024-06-27T03:12:24.018+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:12:00+00:00, run_after=2024-06-27T03:13:00+00:00 2024-06-27T03:12:24.073200286Z [2024-06-27T03:12:24.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:12:24.073537307Z [2024-06-27T03:12:24.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:11:00+00:00, run_id=scheduled__2024-06-27T03:11:00+00:00, run_start_date=2024-06-27 03:12:16.936976+00:00, run_end_date=2024-06-27 03:12:24.073143+00:00, run_duration=7.136167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:11:00+00:00, data_interval_end=2024-06-27 03:12:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:12:24.092274376Z [2024-06-27T03:12:24.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:12:00+00:00, run_after=2024-06-27T03:13:00+00:00 2024-06-27T03:12:24.107677722Z [2024-06-27T03:12:24.107+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-06-27T03:12:24.107701613Z 2024-06-27T03:12:24.107705193Z 2024-06-27T03:12:24.108325177Z [2024-06-27T03:12:24.107+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:12:24.108723967Z [2024-06-27T03:12:24.108+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:12:24.109372051Z [2024-06-27T03:12:24.109+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:12:24.109384677Z 2024-06-27T03:12:24.109388575Z 2024-06-27T03:12:24.113401473Z [2024-06-27T03:12:24.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:12:24.114219322Z [2024-06-27T03:12:24.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:12:24.115154569Z [2024-06-27T03:12:24.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:12:24.115564384Z [2024-06-27T03:12:24.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:12:24.408418573Z [2024-06-27T03:12:24.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:11:00+00:00 exited with status queued for try_number 1 2024-06-27T03:12:24.410658651Z [2024-06-27T03:12:24.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:11:00+00:00 exited with status queued for try_number 1 2024-06-27T03:12:24.410800877Z [2024-06-27T03:12:24.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:11:00+00:00 exited with status success for try_number 1 2024-06-27T03:12:24.426900660Z [2024-06-27T03:12:24.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:11:00+00:00, map_index=-1, run_start_date=2024-06-27 03:12:21.047810+00:00, run_end_date=2024-06-27 03:12:23.392306+00:00, run_duration=2.344496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:12:16.999924+00:00, queued_by_job_id=2, pid=215 2024-06-27T03:12:24.433365411Z [2024-06-27T03:12:24.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to 653b15ac-c079-4548-ab1b-2d3204aa74dc 2024-06-27T03:12:24.433458586Z [2024-06-27T03:12:24.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58083484-f652-48ad-a1e6-74f3f69907b8 2024-06-27T03:12:26.696074439Z [2024-06-27T03:12:26.695+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:10:00+00:00, run_after=2024-06-27T03:15:00+00:00 2024-06-27T03:12:26.752518143Z [2024-06-27T03:12:26.752+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:12:26.753268715Z [2024-06-27T03:12:26.752+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:11:00+00:00, run_id=scheduled__2024-06-27T03:11:00+00:00, run_start_date=2024-06-27 03:12:24.039719+00:00, run_end_date=2024-06-27 03:12:26.752693+00:00, run_duration=2.712974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:11:00+00:00, data_interval_end=2024-06-27 03:12:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:12:26.773112789Z [2024-06-27T03:12:26.771+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:12:00+00:00, run_after=2024-06-27T03:13:00+00:00 2024-06-27T03:12:26.794198057Z [2024-06-27T03:12:26.793+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:12:26.794234178Z 2024-06-27T03:12:26.794600795Z [2024-06-27T03:12:26.794+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:12:26.795318966Z [2024-06-27T03:12:26.795+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:12:26.795341842Z 2024-06-27T03:12:26.797480028Z [2024-06-27T03:12:26.797+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T03:12:26.798035417Z [2024-06-27T03:12:26.797+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:12:26.871672660Z [2024-06-27T03:12:26.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status queued for try_number 1 2024-06-27T03:12:26.871937351Z [2024-06-27T03:12:26.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:11:00+00:00 exited with status success for try_number 1 2024-06-27T03:12:26.900504645Z [2024-06-27T03:12:26.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45d36874-fe09-4fce-a58b-1720ac5113d6 2024-06-27T03:12:26.900932941Z [2024-06-27T03:12:26.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:11:00+00:00, map_index=-1, run_start_date=2024-06-27 03:12:25.239021+00:00, run_end_date=2024-06-27 03:12:25.829761+00:00, run_duration=0.59074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:12:24.110086+00:00, queued_by_job_id=2, pid=236 2024-06-27T03:12:29.449497399Z [2024-06-27T03:12:29.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:12:29.450087944Z [2024-06-27T03:12:29.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:11:00+00:00, run_id=scheduled__2024-06-27T03:11:00+00:00, run_start_date=2024-06-27 03:12:24.037502+00:00, run_end_date=2024-06-27 03:12:29.449577+00:00, run_duration=5.412075, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:11:00+00:00, data_interval_end=2024-06-27 03:12:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:12:29.474743236Z [2024-06-27T03:12:29.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:12:00+00:00, run_after=2024-06-27T03:13:00+00:00 2024-06-27T03:12:29.558982260Z [2024-06-27T03:12:29.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:11:00+00:00 exited with status success for try_number 1 2024-06-27T03:12:29.574456045Z [2024-06-27T03:12:29.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:11:00+00:00, map_index=-1, run_start_date=2024-06-27 03:12:27.111071+00:00, run_end_date=2024-06-27 03:12:28.937990+00:00, run_duration=1.826919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:12:24.110086+00:00, queued_by_job_id=2, pid=257 2024-06-27T03:12:30.643928333Z [2024-06-27T03:12:30.643+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:12:30.643948590Z 2024-06-27T03:12:30.644136654Z [2024-06-27T03:12:30.643+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:12:30.644801064Z [2024-06-27T03:12:30.644+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:12:30.644812674Z 2024-06-27T03:12:30.650061808Z [2024-06-27T03:12:30.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:12:30.650323982Z [2024-06-27T03:12:30.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:12:30.712324129Z [2024-06-27T03:12:30.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status queued for try_number 1 2024-06-27T03:12:30.715221552Z [2024-06-27T03:12:30.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status success for try_number 1 2024-06-27T03:12:30.731531258Z [2024-06-27T03:12:30.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:05:00+00:00, map_index=-1, run_start_date=2024-06-27 03:12:28.953397+00:00, run_end_date=2024-06-27 03:12:29.587576+00:00, run_duration=0.634179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:12:26.795651+00:00, queued_by_job_id=2, pid=277 2024-06-27T03:12:30.732011094Z [2024-06-27T03:12:30.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 390e9d81-49d6-44b1-8ce0-6b2bcc2c02aa 2024-06-27T03:12:33.248342910Z [2024-06-27T03:12:33.247+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:12:33.248362219Z 2024-06-27T03:12:33.248366411Z [2024-06-27T03:12:33.248+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:12:33.251619454Z [2024-06-27T03:12:33.249+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:12:33.251632767Z 2024-06-27T03:12:33.253732109Z [2024-06-27T03:12:33.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T03:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T03:12:33.253929907Z [2024-06-27T03:12:33.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T03:12:33.296116219Z [2024-06-27T03:12:33.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status queued for try_number 1 2024-06-27T03:12:33.303075848Z [2024-06-27T03:12:33.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to b68a6491-b697-4744-923b-28ccde5f7487 2024-06-27T03:12:33.412870167Z [2024-06-27T03:12:33.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status success for try_number 1 2024-06-27T03:12:33.422847061Z [2024-06-27T03:12:33.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T03:05:00+00:00, map_index=-1, run_start_date=2024-06-27 03:12:32.705488+00:00, run_end_date=2024-06-27 03:12:33.101453+00:00, run_duration=0.395965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:12:30.645445+00:00, queued_by_job_id=2, pid=298 2024-06-27T03:12:36.637891471Z [2024-06-27T03:12:36.637+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:12:36.637927163Z 2024-06-27T03:12:36.639680603Z [2024-06-27T03:12:36.639+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:12:36.642795298Z [2024-06-27T03:12:36.642+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:12:36.642811560Z 2024-06-27T03:12:36.650463698Z [2024-06-27T03:12:36.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:12:36.650893244Z [2024-06-27T03:12:36.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:12:36.712658994Z [2024-06-27T03:12:36.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status queued for try_number 1 2024-06-27T03:12:36.712823424Z [2024-06-27T03:12:36.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status success for try_number 1 2024-06-27T03:12:36.725080116Z [2024-06-27T03:12:36.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T03:05:00+00:00, map_index=0, run_start_date=2024-06-27 03:12:35.397216+00:00, run_end_date=2024-06-27 03:12:35.784168+00:00, run_duration=0.386952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:12:33.251964+00:00, queued_by_job_id=2, pid=320 2024-06-27T03:12:36.728002286Z [2024-06-27T03:12:36.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6898106-c19f-4bf3-a3d0-902439e88713 2024-06-27T03:12:39.478643615Z [2024-06-27T03:12:39.478+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:12:39.478996761Z [2024-06-27T03:12:39.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:05:00+00:00, run_id=scheduled__2024-06-27T03:05:00+00:00, run_start_date=2024-06-27 03:12:26.710038+00:00, run_end_date=2024-06-27 03:12:39.478542+00:00, run_duration=12.768504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:05:00+00:00, data_interval_end=2024-06-27 03:10:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T03:12:39.485597594Z [2024-06-27T03:12:39.485+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:10:00+00:00, run_after=2024-06-27T03:15:00+00:00 2024-06-27T03:12:39.522432683Z [2024-06-27T03:12:39.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status success for try_number 1 2024-06-27T03:12:39.528191005Z [2024-06-27T03:12:39.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T03:05:00+00:00, map_index=-1, run_start_date=2024-06-27 03:12:38.552449+00:00, run_end_date=2024-06-27 03:12:38.945491+00:00, run_duration=0.393042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:12:36.645687+00:00, queued_by_job_id=2, pid=335 2024-06-27T03:12:49.471876440Z [2024-06-27T03:12:49.471+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ff17604e-b0ec-4a59-af64-45253357189f to 2024-06-27T03:12:00+00:00, run_after=2024-06-27T03:13:00+00:00 2024-06-27T03:12:49.518667137Z [2024-06-27T03:12:49.518+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:12:49.518681269Z 2024-06-27T03:12:49.518860319Z [2024-06-27T03:12:49.518+0000] {scheduler_job.py:425} INFO - DAG vim_status_ff17604e-b0ec-4a59-af64-45253357189f has 0/16 running and queued tasks 2024-06-27T03:12:49.519417225Z [2024-06-27T03:12:49.519+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:12:49.519427699Z 2024-06-27T03:12:49.522872725Z [2024-06-27T03:12:49.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ff17604e-b0ec-4a59-af64-45253357189f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:12:49.523123068Z [2024-06-27T03:12:49.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ff17604e-b0ec-4a59-af64-45253357189f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:12:49.592082664Z [2024-06-27T03:12:49.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff17604e-b0ec-4a59-af64-45253357189f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:11:00+00:00 exited with status queued for try_number 1 2024-06-27T03:12:49.602314172Z [2024-06-27T03:12:49.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd6bf0ba-b6dc-4732-ae6c-d45dfad66a82 2024-06-27T03:12:53.442265196Z [2024-06-27T03:12:53.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:12:53.443012031Z [2024-06-27T03:12:53.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ff17604e-b0ec-4a59-af64-45253357189f, execution_date=2024-06-27 03:11:00+00:00, run_id=scheduled__2024-06-27T03:11:00+00:00, run_start_date=2024-06-27 03:12:49.486837+00:00, run_end_date=2024-06-27 03:12:53.442216+00:00, run_duration=3.955379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:11:00+00:00, data_interval_end=2024-06-27 03:12:00+00:00, dag_hash=eb0315b49216c63ec45bcf0622ba32b4 2024-06-27T03:12:53.451812387Z [2024-06-27T03:12:53.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ff17604e-b0ec-4a59-af64-45253357189f to 2024-06-27T03:12:00+00:00, run_after=2024-06-27T03:13:00+00:00 2024-06-27T03:12:53.491643746Z [2024-06-27T03:12:53.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff17604e-b0ec-4a59-af64-45253357189f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:11:00+00:00 exited with status success for try_number 1 2024-06-27T03:12:53.500468926Z [2024-06-27T03:12:53.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:11:00+00:00, map_index=-1, run_start_date=2024-06-27 03:12:51.838718+00:00, run_end_date=2024-06-27 03:12:53.248217+00:00, run_duration=1.409499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:12:49.520011+00:00, queued_by_job_id=2, pid=347 2024-06-27T03:12:55.611609225Z [2024-06-27T03:12:55.611+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:12:55.654634253Z [2024-06-27T03:12:55.654+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:12:55.654651336Z 2024-06-27T03:12:55.654888050Z [2024-06-27T03:12:55.654+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f has 0/16 running and queued tasks 2024-06-27T03:12:55.655461201Z [2024-06-27T03:12:55.655+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:12:55.655528791Z 2024-06-27T03:12:55.657942533Z [2024-06-27T03:12:55.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:12:55.658614572Z [2024-06-27T03:12:55.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:12:55.701089486Z [2024-06-27T03:12:55.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:11:00+00:00 exited with status queued for try_number 1 2024-06-27T03:12:55.708525822Z [2024-06-27T03:12:55.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to a308433d-2e5f-41be-915f-f39597d5051e 2024-06-27T03:12:59.720401721Z [2024-06-27T03:12:59.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f to 2024-06-27T03:10:00+00:00, run_after=2024-06-27T03:15:00+00:00 2024-06-27T03:12:59.831320847Z [2024-06-27T03:12:59.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:12:59.831836324Z [2024-06-27T03:12:59.831+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f, execution_date=2024-06-27 03:11:00+00:00, run_id=scheduled__2024-06-27T03:11:00+00:00, run_start_date=2024-06-27 03:12:55.623414+00:00, run_end_date=2024-06-27 03:12:59.831256+00:00, run_duration=4.207842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:11:00+00:00, data_interval_end=2024-06-27 03:12:00+00:00, dag_hash=ed95c02caf20da1f6931cf685d25f55b 2024-06-27T03:12:59.846402228Z [2024-06-27T03:12:59.846+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f to 2024-06-27T03:12:00+00:00, run_after=2024-06-27T03:13:00+00:00 2024-06-27T03:12:59.859197690Z [2024-06-27T03:12:59.858+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:12:59.859234392Z 2024-06-27T03:12:59.859493146Z [2024-06-27T03:12:59.859+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f has 0/16 running and queued tasks 2024-06-27T03:12:59.860213139Z [2024-06-27T03:12:59.860+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:12:59.860223830Z 2024-06-27T03:12:59.862430765Z [2024-06-27T03:12:59.862+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T03:12:59.863439308Z [2024-06-27T03:12:59.862+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:12:59.933679736Z [2024-06-27T03:12:59.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status queued for try_number 1 2024-06-27T03:12:59.933698888Z [2024-06-27T03:12:59.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:11:00+00:00 exited with status success for try_number 1 2024-06-27T03:12:59.943404320Z [2024-06-27T03:12:59.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:11:00+00:00, map_index=-1, run_start_date=2024-06-27 03:12:57.849089+00:00, run_end_date=2024-06-27 03:12:59.607412+00:00, run_duration=1.758323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:12:55.656273+00:00, queued_by_job_id=2, pid=368 2024-06-27T03:12:59.943504270Z [2024-06-27T03:12:59.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to d89fb3b1-6e4a-44f0-b239-8a746688ba31 2024-06-27T03:13:01.087911691Z [2024-06-27T03:13:01.087+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:13:01.115302720Z [2024-06-27T03:13:01.115+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:13:00+00:00, run_after=2024-06-27T03:14:00+00:00 2024-06-27T03:13:01.123321378Z [2024-06-27T03:13:01.122+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:13:01.162912152Z [2024-06-27T03:13:01.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:13:00+00:00, run_after=2024-06-27T03:14:00+00:00 2024-06-27T03:13:01.197264243Z [2024-06-27T03:13:01.196+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ff17604e-b0ec-4a59-af64-45253357189f to 2024-06-27T03:13:00+00:00, run_after=2024-06-27T03:14:00+00:00 2024-06-27T03:13:01.315263021Z [2024-06-27T03:13:01.314+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T03:13:01.315281019Z 2024-06-27T03:13:01.315284613Z 2024-06-27T03:13:01.315288149Z 2024-06-27T03:13:01.315291193Z 2024-06-27T03:13:01.315294324Z 2024-06-27T03:13:01.316274287Z [2024-06-27T03:13:01.315+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f has 0/16 running and queued tasks 2024-06-27T03:13:01.317338089Z [2024-06-27T03:13:01.317+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:13:01.317666793Z [2024-06-27T03:13:01.317+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:13:01.318118502Z [2024-06-27T03:13:01.317+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:13:01.318402146Z [2024-06-27T03:13:01.318+0000] {scheduler_job.py:425} INFO - DAG vim_status_ff17604e-b0ec-4a59-af64-45253357189f has 0/16 running and queued tasks 2024-06-27T03:13:01.319368351Z [2024-06-27T03:13:01.319+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:13:01.319380067Z 2024-06-27T03:13:01.319383501Z 2024-06-27T03:13:01.319386590Z 2024-06-27T03:13:01.319389712Z 2024-06-27T03:13:01.319392797Z 2024-06-27T03:13:01.326270639Z [2024-06-27T03:13:01.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:13:01.326580118Z [2024-06-27T03:13:01.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:13:01.326940788Z [2024-06-27T03:13:01.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:13:01.327186002Z [2024-06-27T03:13:01.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:13:01.327549254Z [2024-06-27T03:13:01.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:13:01.327777228Z [2024-06-27T03:13:01.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:13:01.328588059Z [2024-06-27T03:13:01.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:13:01.329000942Z [2024-06-27T03:13:01.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:13:01.330459174Z [2024-06-27T03:13:01.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ff17604e-b0ec-4a59-af64-45253357189f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:13:01.330709651Z [2024-06-27T03:13:01.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ff17604e-b0ec-4a59-af64-45253357189f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:13:01.843825801Z [2024-06-27T03:13:01.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status queued for try_number 1 2024-06-27T03:13:01.844154296Z [2024-06-27T03:13:01.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status queued for try_number 1 2024-06-27T03:13:01.844373660Z [2024-06-27T03:13:01.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status queued for try_number 1 2024-06-27T03:13:01.844583764Z [2024-06-27T03:13:01.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status queued for try_number 1 2024-06-27T03:13:01.844835333Z [2024-06-27T03:13:01.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff17604e-b0ec-4a59-af64-45253357189f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status queued for try_number 1 2024-06-27T03:13:01.869850681Z [2024-06-27T03:13:01.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a3e1c2f-7e25-41a1-92da-2535f1c4bf99 2024-06-27T03:13:01.869914041Z [2024-06-27T03:13:01.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7323870-7633-4800-ad20-84eb7fe13e20 2024-06-27T03:13:01.870027423Z [2024-06-27T03:13:01.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e51cbeb-00a9-44f0-9341-c2d099e9300f 2024-06-27T03:13:01.870116611Z [2024-06-27T03:13:01.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c7ff2d5-fe4f-4fe2-83d9-d380b97a7a19 2024-06-27T03:13:01.870216065Z [2024-06-27T03:13:01.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd3e8fe1-1dc2-4f2a-a864-15af9a99dfd7 2024-06-27T03:13:04.083034220Z [2024-06-27T03:13:04.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:13:04.083261184Z [2024-06-27T03:13:04.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:12:00+00:00, run_id=scheduled__2024-06-27T03:12:00+00:00, run_start_date=2024-06-27 03:13:01.215330+00:00, run_end_date=2024-06-27 03:13:04.082978+00:00, run_duration=2.867648, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:12:00+00:00, data_interval_end=2024-06-27 03:13:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:13:04.131322642Z [2024-06-27T03:13:04.130+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:13:00+00:00, run_after=2024-06-27T03:14:00+00:00 2024-06-27T03:13:04.190293112Z [2024-06-27T03:13:04.189+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:13:04.190316414Z 2024-06-27T03:13:04.190369279Z [2024-06-27T03:13:04.190+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f has 0/16 running and queued tasks 2024-06-27T03:13:04.191063212Z [2024-06-27T03:13:04.190+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:13:04.191077579Z 2024-06-27T03:13:04.194231993Z [2024-06-27T03:13:04.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f', task_id='split_metrics', run_id='scheduled__2024-06-27T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:13:04.194320853Z [2024-06-27T03:13:04.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f', 'split_metrics', 'scheduled__2024-06-27T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:13:04.313550643Z [2024-06-27T03:13:04.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f.split_metrics run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status queued for try_number 1 2024-06-27T03:13:04.313577081Z [2024-06-27T03:13:04.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status success for try_number 1 2024-06-27T03:13:04.313674177Z [2024-06-27T03:13:04.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status success for try_number 1 2024-06-27T03:13:04.324039519Z [2024-06-27T03:13:04.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:05:00+00:00, map_index=-1, run_start_date=2024-06-27 03:13:02.379391+00:00, run_end_date=2024-06-27 03:13:03.535469+00:00, run_duration=1.156078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:12:59.860654+00:00, queued_by_job_id=2, pid=394 2024-06-27T03:13:04.324185520Z [2024-06-27T03:13:04.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e6f7c51-16c5-4413-8a5a-aa064b5a6233 2024-06-27T03:13:04.324374062Z [2024-06-27T03:13:04.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:12:00+00:00, map_index=-1, run_start_date=2024-06-27 03:13:03.420070+00:00, run_end_date=2024-06-27 03:13:03.996260+00:00, run_duration=0.57619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:13:01.321144+00:00, queued_by_job_id=2, pid=413 2024-06-27T03:13:06.769814341Z [2024-06-27T03:13:06.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status failed for try_number 1 2024-06-27T03:13:06.769846114Z [2024-06-27T03:13:06.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff17604e-b0ec-4a59-af64-45253357189f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status success for try_number 1 2024-06-27T03:13:06.776043633Z [2024-06-27T03:13:06.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:12:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:13:01.321144+00:00, queued_by_job_id=2, pid=None 2024-06-27T03:13:06.776492763Z [2024-06-27T03:13:06.776+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:13:06.778967034Z [2024-06-27T03:13:06.778+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:13:06.820879654Z [2024-06-27T03:13:06.820+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240627T031200, start_date=, end_date=20240627T031306 2024-06-27T03:13:06.853540983Z [2024-06-27T03:13:06.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:12:00+00:00, map_index=-1, run_start_date=2024-06-27 03:13:05.235494+00:00, run_end_date=2024-06-27 03:13:06.038484+00:00, run_duration=0.80299, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:13:01.321144+00:00, queued_by_job_id=2, pid=447 2024-06-27T03:13:07.590980617Z [2024-06-27T03:13:07.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:13:07.592427438Z [2024-06-27T03:13:07.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:12:00+00:00, run_id=scheduled__2024-06-27T03:12:00+00:00, run_start_date=2024-06-27 03:13:01.217621+00:00, run_end_date=2024-06-27 03:13:07.590841+00:00, run_duration=6.37322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:12:00+00:00, data_interval_end=2024-06-27 03:13:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:13:07.621081066Z [2024-06-27T03:13:07.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:13:00+00:00, run_after=2024-06-27T03:14:00+00:00 2024-06-27T03:13:07.737207022Z [2024-06-27T03:13:07.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status success for try_number 1 2024-06-27T03:13:07.737812694Z [2024-06-27T03:13:07.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f.split_metrics run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status failed for try_number 1 2024-06-27T03:13:07.747883578Z [2024-06-27T03:13:07.747+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:12:00+00:00, map_index=-1, run_start_date=2024-06-27 03:13:05.137908+00:00, run_end_date=2024-06-27 03:13:07.315188+00:00, run_duration=2.17728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:13:01.321144+00:00, queued_by_job_id=2, pid=446 2024-06-27T03:13:07.748451758Z [2024-06-27T03:13:07.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f, task_id=split_metrics, run_id=scheduled__2024-06-27T03:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:13:04.191465+00:00, queued_by_job_id=2, pid=None 2024-06-27T03:13:07.749313080Z [2024-06-27T03:13:07.749+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:13:07.750763258Z [2024-06-27T03:13:07.750+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:13:07.761157251Z [2024-06-27T03:13:07.760+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f, task_id=split_metrics, execution_date=20240627T030500, start_date=, end_date=20240627T031307 2024-06-27T03:13:09.164462066Z [2024-06-27T03:13:09.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:13:09.165266204Z [2024-06-27T03:13:09.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:12:00+00:00, run_id=scheduled__2024-06-27T03:12:00+00:00, run_start_date=2024-06-27 03:13:01.218962+00:00, run_end_date=2024-06-27 03:13:09.164866+00:00, run_duration=7.945904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:12:00+00:00, data_interval_end=2024-06-27 03:13:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:13:09.174179957Z [2024-06-27T03:13:09.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:13:00+00:00, run_after=2024-06-27T03:14:00+00:00 2024-06-27T03:13:10.488812345Z [2024-06-27T03:13:10.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status success for try_number 1 2024-06-27T03:13:10.493976333Z [2024-06-27T03:13:10.493+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:12:00+00:00, map_index=-1, run_start_date=2024-06-27 03:13:06.265842+00:00, run_end_date=2024-06-27 03:13:09.103298+00:00, run_duration=2.837456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:13:01.321144+00:00, queued_by_job_id=2, pid=494 2024-06-27T03:13:16.531711969Z [2024-06-27T03:13:16.531+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:13:16.531774391Z 2024-06-27T03:13:16.531821059Z [2024-06-27T03:13:16.531+0000] {scheduler_job.py:425} INFO - DAG vim_status_ff17604e-b0ec-4a59-af64-45253357189f has 0/16 running and queued tasks 2024-06-27T03:13:16.532405156Z [2024-06-27T03:13:16.532+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:13:16.532415005Z 2024-06-27T03:13:16.534527103Z [2024-06-27T03:13:16.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ff17604e-b0ec-4a59-af64-45253357189f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:12:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:13:16.534584406Z [2024-06-27T03:13:16.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ff17604e-b0ec-4a59-af64-45253357189f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:13:16.572448284Z [2024-06-27T03:13:16.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff17604e-b0ec-4a59-af64-45253357189f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status queued for try_number 2 2024-06-27T03:13:16.577062248Z [2024-06-27T03:13:16.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to b24757da-f173-4b85-a560-36ceb31ddfb8 2024-06-27T03:13:17.784253229Z [2024-06-27T03:13:17.783+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:13:17.784281490Z 2024-06-27T03:13:17.784378618Z [2024-06-27T03:13:17.784+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f has 0/16 running and queued tasks 2024-06-27T03:13:17.785179105Z [2024-06-27T03:13:17.784+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:13:17.785193567Z 2024-06-27T03:13:17.788201575Z [2024-06-27T03:13:17.787+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:12:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:13:17.788323864Z [2024-06-27T03:13:17.788+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:13:17.835384239Z [2024-06-27T03:13:17.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status queued for try_number 2 2024-06-27T03:13:17.840599665Z [2024-06-27T03:13:17.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36992b06-f3b7-4461-92fd-947f0891acf3 2024-06-27T03:13:17.946856893Z [2024-06-27T03:13:17.946+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:13:17.946879518Z 2024-06-27T03:13:17.946993849Z [2024-06-27T03:13:17.946+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f has 0/16 running and queued tasks 2024-06-27T03:13:17.948019761Z [2024-06-27T03:13:17.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:13:17.948044956Z 2024-06-27T03:13:17.950360912Z [2024-06-27T03:13:17.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f', task_id='split_metrics', run_id='scheduled__2024-06-27T03:05:00+00:00', try_number=2, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:13:17.950565107Z [2024-06-27T03:13:17.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f', 'split_metrics', 'scheduled__2024-06-27T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:13:17.995624567Z [2024-06-27T03:13:17.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f.split_metrics run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status queued for try_number 2 2024-06-27T03:13:18.006959033Z [2024-06-27T03:13:18.006+0000] {scheduler_job.py:635} INFO - Setting external_id for to d62c62fb-9f72-4b08-b6cb-cc459436b1cf 2024-06-27T03:13:19.494499980Z [2024-06-27T03:13:19.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff17604e-b0ec-4a59-af64-45253357189f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status failed for try_number 2 2024-06-27T03:13:19.506066194Z [2024-06-27T03:13:19.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:12:00+00:00, map_index=-1, run_start_date=2024-06-27 03:13:05.235494+00:00, run_end_date=2024-06-27 03:13:06.038484+00:00, run_duration=0.80299, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:13:16.532708+00:00, queued_by_job_id=2, pid=447 2024-06-27T03:13:19.513611317Z [2024-06-27T03:13:19.513+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:13:19.525488168Z [2024-06-27T03:13:19.525+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:13:19.570381933Z [2024-06-27T03:13:19.570+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240627T031200, start_date=20240627T031305, end_date=20240627T031319 2024-06-27T03:13:20.651846386Z [2024-06-27T03:13:20.651+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T03:13:20.652195977Z [2024-06-27T03:13:20.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ff17604e-b0ec-4a59-af64-45253357189f, execution_date=2024-06-27 03:12:00+00:00, run_id=scheduled__2024-06-27T03:12:00+00:00, run_start_date=2024-06-27 03:13:01.220254+00:00, run_end_date=2024-06-27 03:13:20.651853+00:00, run_duration=19.431599, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:12:00+00:00, data_interval_end=2024-06-27 03:13:00+00:00, dag_hash=eb0315b49216c63ec45bcf0622ba32b4 2024-06-27T03:13:20.665552163Z [2024-06-27T03:13:20.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ff17604e-b0ec-4a59-af64-45253357189f to 2024-06-27T03:13:00+00:00, run_after=2024-06-27T03:14:00+00:00 2024-06-27T03:13:20.717513727Z [2024-06-27T03:13:20.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status failed for try_number 2 2024-06-27T03:13:20.717606276Z [2024-06-27T03:13:20.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f.split_metrics run_id=scheduled__2024-06-27T03:05:00+00:00 exited with status failed for try_number 2 2024-06-27T03:13:20.727053979Z [2024-06-27T03:13:20.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f, task_id=split_metrics, run_id=scheduled__2024-06-27T03:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 03:13:07.753586+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:13:17.948360+00:00, queued_by_job_id=2, pid=None 2024-06-27T03:13:20.727526517Z [2024-06-27T03:13:20.727+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:13:20.730070590Z [2024-06-27T03:13:20.729+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:13:20.740171079Z [2024-06-27T03:13:20.739+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f, task_id=split_metrics, execution_date=20240627T030500, start_date=, end_date=20240627T031320 2024-06-27T03:13:20.752172917Z [2024-06-27T03:13:20.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:12:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 03:13:06.783510+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:13:17.786200+00:00, queued_by_job_id=2, pid=None 2024-06-27T03:13:20.752692313Z [2024-06-27T03:13:20.752+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:13:20.755717476Z [2024-06-27T03:13:20.755+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:13:20.769080290Z [2024-06-27T03:13:20.768+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240627T031200, start_date=, end_date=20240627T031320 2024-06-27T03:13:21.855769026Z [2024-06-27T03:13:21.855+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T03:13:21.856014931Z [2024-06-27T03:13:21.855+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f, execution_date=2024-06-27 03:12:00+00:00, run_id=scheduled__2024-06-27T03:12:00+00:00, run_start_date=2024-06-27 03:13:01.211835+00:00, run_end_date=2024-06-27 03:13:21.855615+00:00, run_duration=20.64378, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:12:00+00:00, data_interval_end=2024-06-27 03:13:00+00:00, dag_hash=ed95c02caf20da1f6931cf685d25f55b 2024-06-27T03:13:21.869691581Z [2024-06-27T03:13:21.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f to 2024-06-27T03:13:00+00:00, run_after=2024-06-27T03:14:00+00:00 2024-06-27T03:13:23.317583175Z [2024-06-27T03:13:23.317+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T03:13:23.317815007Z [2024-06-27T03:13:23.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f, execution_date=2024-06-27 03:05:00+00:00, run_id=scheduled__2024-06-27T03:05:00+00:00, run_start_date=2024-06-27 03:12:59.768902+00:00, run_end_date=2024-06-27 03:13:23.317459+00:00, run_duration=23.548557, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:05:00+00:00, data_interval_end=2024-06-27 03:10:00+00:00, dag_hash=e718408dc4b51d0548a4e5b0dd421394 2024-06-27T03:13:23.324686480Z [2024-06-27T03:13:23.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ff17604e-b0ec-4a59-af64-45253357189f to 2024-06-27T03:10:00+00:00, run_after=2024-06-27T03:15:00+00:00 2024-06-27T03:14:00.984742784Z [2024-06-27T03:14:00.984+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:14:01.010039117Z [2024-06-27T03:14:01.009+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ff17604e-b0ec-4a59-af64-45253357189f to 2024-06-27T03:14:00+00:00, run_after=2024-06-27T03:15:00+00:00 2024-06-27T03:14:01.022269255Z [2024-06-27T03:14:01.020+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:14:01.029698099Z [2024-06-27T03:14:01.029+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:14:01.043698780Z [2024-06-27T03:14:01.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:14:00+00:00, run_after=2024-06-27T03:15:00+00:00 2024-06-27T03:14:01.078944154Z [2024-06-27T03:14:01.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:14:00+00:00, run_after=2024-06-27T03:15:00+00:00 2024-06-27T03:14:01.280743351Z [2024-06-27T03:14:01.280+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-06-27T03:14:01.280786173Z 2024-06-27T03:14:01.280805312Z 2024-06-27T03:14:01.280808794Z 2024-06-27T03:14:01.280812211Z 2024-06-27T03:14:01.280815279Z 2024-06-27T03:14:01.280818341Z 2024-06-27T03:14:01.281026497Z [2024-06-27T03:14:01.280+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:14:01.281267187Z [2024-06-27T03:14:01.281+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f has 0/16 running and queued tasks 2024-06-27T03:14:01.281514739Z [2024-06-27T03:14:01.281+0000] {scheduler_job.py:425} INFO - DAG vim_status_ff17604e-b0ec-4a59-af64-45253357189f has 0/16 running and queued tasks 2024-06-27T03:14:01.281709741Z [2024-06-27T03:14:01.281+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:14:01.281896199Z [2024-06-27T03:14:01.281+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:14:01.282064136Z [2024-06-27T03:14:01.281+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:14:01.282868519Z [2024-06-27T03:14:01.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:14:01.282882864Z 2024-06-27T03:14:01.282886749Z 2024-06-27T03:14:01.282890074Z 2024-06-27T03:14:01.282893198Z 2024-06-27T03:14:01.282896444Z 2024-06-27T03:14:01.282899812Z 2024-06-27T03:14:01.290395915Z [2024-06-27T03:14:01.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:14:01.290586154Z [2024-06-27T03:14:01.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:14:01.290840573Z [2024-06-27T03:14:01.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:14:01.290979680Z [2024-06-27T03:14:01.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:14:01.291246875Z [2024-06-27T03:14:01.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ff17604e-b0ec-4a59-af64-45253357189f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:14:01.291392270Z [2024-06-27T03:14:01.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ff17604e-b0ec-4a59-af64-45253357189f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:14:01.291607796Z [2024-06-27T03:14:01.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:14:01.291730555Z [2024-06-27T03:14:01.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:14:01.291976822Z [2024-06-27T03:14:01.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:14:01.292178970Z [2024-06-27T03:14:01.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:14:01.292444537Z [2024-06-27T03:14:01.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:14:01.292598383Z [2024-06-27T03:14:01.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:14:01.897560589Z [2024-06-27T03:14:01.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status queued for try_number 1 2024-06-27T03:14:01.897992590Z [2024-06-27T03:14:01.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:13:00+00:00 exited with status queued for try_number 1 2024-06-27T03:14:01.898198394Z [2024-06-27T03:14:01.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff17604e-b0ec-4a59-af64-45253357189f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:13:00+00:00 exited with status queued for try_number 1 2024-06-27T03:14:01.899778337Z [2024-06-27T03:14:01.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:13:00+00:00 exited with status queued for try_number 1 2024-06-27T03:14:01.899891997Z [2024-06-27T03:14:01.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:13:00+00:00 exited with status queued for try_number 1 2024-06-27T03:14:01.900007419Z [2024-06-27T03:14:01.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:13:00+00:00 exited with status queued for try_number 1 2024-06-27T03:14:01.937504523Z [2024-06-27T03:14:01.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d15ca40-30bd-43a9-86e2-b07c36ac5c20 2024-06-27T03:14:01.937840754Z [2024-06-27T03:14:01.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e554e1b-f17e-4214-8a86-70cbc15d2594 2024-06-27T03:14:01.938155790Z [2024-06-27T03:14:01.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0e752b0-0f93-48e7-a67a-cfc465763cd5 2024-06-27T03:14:01.938454851Z [2024-06-27T03:14:01.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13b01405-6a21-44ca-a9d2-54a90821eae2 2024-06-27T03:14:01.938803818Z [2024-06-27T03:14:01.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c8dc9fd-d55e-4a5a-8417-6ae851d8438a 2024-06-27T03:14:01.939232488Z [2024-06-27T03:14:01.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b03c15e-0126-46a4-a5ce-d1f3c5485a48 2024-06-27T03:14:03.987135280Z [2024-06-27T03:14:03.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:14:03.988121307Z [2024-06-27T03:14:03.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:12:00+00:00, run_id=scheduled__2024-06-27T03:12:00+00:00, run_start_date=2024-06-27 03:14:01.100639+00:00, run_end_date=2024-06-27 03:14:03.987234+00:00, run_duration=2.886595, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:12:00+00:00, data_interval_end=2024-06-27 03:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:14:04.013618192Z [2024-06-27T03:14:04.013+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:14:00+00:00, run_after=2024-06-27T03:16:00+00:00 2024-06-27T03:14:04.183640937Z [2024-06-27T03:14:04.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:12:00+00:00 exited with status success for try_number 1 2024-06-27T03:14:04.189219999Z [2024-06-27T03:14:04.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:12:00+00:00, map_index=-1, run_start_date=2024-06-27 03:14:02.438763+00:00, run_end_date=2024-06-27 03:14:03.462057+00:00, run_duration=1.023294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:14:01.284974+00:00, queued_by_job_id=2, pid=601 2024-06-27T03:14:04.406373329Z [2024-06-27T03:14:04.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:14:04.406570654Z [2024-06-27T03:14:04.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:13:00+00:00, run_id=scheduled__2024-06-27T03:13:00+00:00, run_start_date=2024-06-27 03:14:01.130298+00:00, run_end_date=2024-06-27 03:14:04.406272+00:00, run_duration=3.275974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:13:00+00:00, data_interval_end=2024-06-27 03:14:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:14:04.418800748Z [2024-06-27T03:14:04.418+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:14:00+00:00, run_after=2024-06-27T03:15:00+00:00 2024-06-27T03:14:04.483886321Z [2024-06-27T03:14:04.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:13:00+00:00 exited with status success for try_number 1 2024-06-27T03:14:04.490816601Z [2024-06-27T03:14:04.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:13:00+00:00, map_index=-1, run_start_date=2024-06-27 03:14:03.638850+00:00, run_end_date=2024-06-27 03:14:04.291352+00:00, run_duration=0.652502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:14:01.284974+00:00, queued_by_job_id=2, pid=620 2024-06-27T03:14:05.606189936Z [2024-06-27T03:14:05.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:13:00+00:00 exited with status failed for try_number 1 2024-06-27T03:14:05.606302605Z [2024-06-27T03:14:05.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff17604e-b0ec-4a59-af64-45253357189f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:13:00+00:00 exited with status failed for try_number 1 2024-06-27T03:14:05.614412188Z [2024-06-27T03:14:05.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:13:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:14:01.284974+00:00, queued_by_job_id=2, pid=None 2024-06-27T03:14:05.614926009Z [2024-06-27T03:14:05.614+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:14:05.617926865Z [2024-06-27T03:14:05.617+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:14:05.632633891Z [2024-06-27T03:14:05.632+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240627T031300, start_date=, end_date=20240627T031405 2024-06-27T03:14:05.641237931Z [2024-06-27T03:14:05.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:13:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:14:01.284974+00:00, queued_by_job_id=2, pid=None 2024-06-27T03:14:05.641490465Z [2024-06-27T03:14:05.640+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:14:05.643216561Z [2024-06-27T03:14:05.642+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:14:05.653929400Z [2024-06-27T03:14:05.653+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_ff17604e-b0ec-4a59-af64-45253357189f, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240627T031300, start_date=, end_date=20240627T031405 2024-06-27T03:14:06.721987670Z [2024-06-27T03:14:06.721+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:14:06.722559262Z [2024-06-27T03:14:06.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:13:00+00:00, run_id=scheduled__2024-06-27T03:13:00+00:00, run_start_date=2024-06-27 03:14:01.103745+00:00, run_end_date=2024-06-27 03:14:06.722040+00:00, run_duration=5.618295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:13:00+00:00, data_interval_end=2024-06-27 03:14:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:14:06.734354409Z [2024-06-27T03:14:06.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:14:00+00:00, run_after=2024-06-27T03:15:00+00:00 2024-06-27T03:14:06.780013829Z [2024-06-27T03:14:06.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:13:00+00:00 exited with status success for try_number 1 2024-06-27T03:14:06.785295488Z [2024-06-27T03:14:06.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:13:00+00:00, map_index=-1, run_start_date=2024-06-27 03:14:05.137943+00:00, run_end_date=2024-06-27 03:14:06.436639+00:00, run_duration=1.298696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:14:01.284974+00:00, queued_by_job_id=2, pid=689 2024-06-27T03:14:07.087523248Z [2024-06-27T03:14:07.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:14:07.088127001Z [2024-06-27T03:14:07.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:13:00+00:00, run_id=scheduled__2024-06-27T03:13:00+00:00, run_start_date=2024-06-27 03:14:01.113989+00:00, run_end_date=2024-06-27 03:14:07.087398+00:00, run_duration=5.973409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:13:00+00:00, data_interval_end=2024-06-27 03:14:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:14:07.098529829Z [2024-06-27T03:14:07.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:14:00+00:00, run_after=2024-06-27T03:15:00+00:00 2024-06-27T03:14:07.127889641Z [2024-06-27T03:14:07.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:13:00+00:00 exited with status success for try_number 1 2024-06-27T03:14:07.133108725Z [2024-06-27T03:14:07.132+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:13:00+00:00, map_index=-1, run_start_date=2024-06-27 03:14:04.742522+00:00, run_end_date=2024-06-27 03:14:06.817727+00:00, run_duration=2.075205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:14:01.284974+00:00, queued_by_job_id=2, pid=643 2024-06-27T03:15:00.060053982Z [2024-06-27T03:15:00.059+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:15:00.073657083Z [2024-06-27T03:15:00.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:15:00+00:00, run_after=2024-06-27T03:16:00+00:00 2024-06-27T03:15:00.086593866Z [2024-06-27T03:15:00.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:15:00+00:00, run_after=2024-06-27T03:20:00+00:00 2024-06-27T03:15:00.103162333Z [2024-06-27T03:15:00.102+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:15:00+00:00, run_after=2024-06-27T03:16:00+00:00 2024-06-27T03:15:00.223824167Z [2024-06-27T03:15:00.222+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:15:00.223849807Z 2024-06-27T03:15:00.223856147Z 2024-06-27T03:15:00.223860282Z 2024-06-27T03:15:00.223887807Z 2024-06-27T03:15:00.223891954Z [2024-06-27T03:15:00.223+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:15:00.223895711Z [2024-06-27T03:15:00.223+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:15:00.223899409Z [2024-06-27T03:15:00.223+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:15:00.223903109Z [2024-06-27T03:15:00.223+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:15:00.223976673Z [2024-06-27T03:15:00.223+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:15:00.223986072Z 2024-06-27T03:15:00.223990814Z 2024-06-27T03:15:00.224022189Z 2024-06-27T03:15:00.224027098Z 2024-06-27T03:15:00.228511619Z [2024-06-27T03:15:00.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T03:15:00.228577466Z [2024-06-27T03:15:00.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:15:00.229043498Z [2024-06-27T03:15:00.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:15:00.229155109Z [2024-06-27T03:15:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:15:00.229317903Z [2024-06-27T03:15:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:15:00.229385967Z [2024-06-27T03:15:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:15:00.229613087Z [2024-06-27T03:15:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:15:00.229686459Z [2024-06-27T03:15:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:15:00.807438133Z [2024-06-27T03:15:00.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:00.807496834Z [2024-06-27T03:15:00.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:14:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:00.807508067Z [2024-06-27T03:15:00.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:14:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:00.807544016Z [2024-06-27T03:15:00.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:14:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:00.827332244Z [2024-06-27T03:15:00.826+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f968502-ddcd-456d-b150-0aff4643ff11 2024-06-27T03:15:00.827370495Z [2024-06-27T03:15:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa0c3620-960a-4595-af3c-9d94898a62cc 2024-06-27T03:15:00.827467589Z [2024-06-27T03:15:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b08d3ad-6ea2-4df4-b017-9b2c03f9d65b 2024-06-27T03:15:00.827555910Z [2024-06-27T03:15:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1142319b-2774-4f7b-81df-82f68a5b3c20 2024-06-27T03:15:03.254704723Z [2024-06-27T03:15:03.254+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:15:03.255461596Z [2024-06-27T03:15:03.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:14:00+00:00, run_id=scheduled__2024-06-27T03:14:00+00:00, run_start_date=2024-06-27 03:15:00.118727+00:00, run_end_date=2024-06-27 03:15:03.254855+00:00, run_duration=3.136128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:14:00+00:00, data_interval_end=2024-06-27 03:15:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:15:03.297869825Z [2024-06-27T03:15:03.292+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:15:00+00:00, run_after=2024-06-27T03:16:00+00:00 2024-06-27T03:15:03.416330137Z [2024-06-27T03:15:03.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:14:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:03.423934838Z [2024-06-27T03:15:03.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:14:00+00:00, map_index=-1, run_start_date=2024-06-27 03:15:01.610800+00:00, run_end_date=2024-06-27 03:15:02.220321+00:00, run_duration=0.609521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:00.224754+00:00, queued_by_job_id=2, pid=734 2024-06-27T03:15:03.590125766Z [2024-06-27T03:15:03.589+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T03:15:04.622799844Z [2024-06-27T03:15:04.622+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:15:04.622822610Z 2024-06-27T03:15:04.623137479Z [2024-06-27T03:15:04.622+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:15:04.624357943Z [2024-06-27T03:15:04.624+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:15:04.624366418Z 2024-06-27T03:15:04.628561978Z [2024-06-27T03:15:04.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:15:04.628903268Z [2024-06-27T03:15:04.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:15:04.684239990Z [2024-06-27T03:15:04.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:04.684442876Z [2024-06-27T03:15:04.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:04.691320028Z [2024-06-27T03:15:04.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc29c125-d35a-4ec0-8e52-a0c21282b531 2024-06-27T03:15:04.691566009Z [2024-06-27T03:15:04.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:10:00+00:00, map_index=-1, run_start_date=2024-06-27 03:15:03.125939+00:00, run_end_date=2024-06-27 03:15:03.599525+00:00, run_duration=0.473586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:00.224754+00:00, queued_by_job_id=2, pid=774 2024-06-27T03:15:04.738430923Z [2024-06-27T03:15:04.738+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:15:04.742095803Z [2024-06-27T03:15:04.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:14:00+00:00, run_id=scheduled__2024-06-27T03:14:00+00:00, run_start_date=2024-06-27 03:15:00.115831+00:00, run_end_date=2024-06-27 03:15:04.741300+00:00, run_duration=4.625469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:14:00+00:00, data_interval_end=2024-06-27 03:15:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:15:04.766733768Z [2024-06-27T03:15:04.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:15:00+00:00, run_after=2024-06-27T03:16:00+00:00 2024-06-27T03:15:04.836185242Z [2024-06-27T03:15:04.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:14:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:04.844008265Z [2024-06-27T03:15:04.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:14:00+00:00, map_index=-1, run_start_date=2024-06-27 03:15:02.678269+00:00, run_end_date=2024-06-27 03:15:04.554626+00:00, run_duration=1.876357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:00.224754+00:00, queued_by_job_id=2, pid=755 2024-06-27T03:15:05.902318786Z [2024-06-27T03:15:05.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:15:05.902963589Z [2024-06-27T03:15:05.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:14:00+00:00, run_id=scheduled__2024-06-27T03:14:00+00:00, run_start_date=2024-06-27 03:15:00.117053+00:00, run_end_date=2024-06-27 03:15:05.902203+00:00, run_duration=5.78515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:14:00+00:00, data_interval_end=2024-06-27 03:15:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:15:05.913658575Z [2024-06-27T03:15:05.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:15:00+00:00, run_after=2024-06-27T03:16:00+00:00 2024-06-27T03:15:05.959248125Z [2024-06-27T03:15:05.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:14:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:05.971355320Z [2024-06-27T03:15:05.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:14:00+00:00, map_index=-1, run_start_date=2024-06-27 03:15:03.460825+00:00, run_end_date=2024-06-27 03:15:04.874779+00:00, run_duration=1.413954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:00.224754+00:00, queued_by_job_id=2, pid=786 2024-06-27T03:15:07.092612680Z [2024-06-27T03:15:07.092+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:15:07.092651781Z 2024-06-27T03:15:07.092715127Z [2024-06-27T03:15:07.092+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:15:07.093504308Z [2024-06-27T03:15:07.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:15:07.093517904Z 2024-06-27T03:15:07.096018305Z [2024-06-27T03:15:07.095+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T03:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T03:15:07.096100922Z [2024-06-27T03:15:07.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T03:15:07.160185473Z [2024-06-27T03:15:07.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:07.160226916Z [2024-06-27T03:15:07.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:07.168705734Z [2024-06-27T03:15:07.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T03:10:00+00:00, map_index=-1, run_start_date=2024-06-27 03:15:06.435754+00:00, run_end_date=2024-06-27 03:15:06.840323+00:00, run_duration=0.404569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:04.625054+00:00, queued_by_job_id=2, pid=813 2024-06-27T03:15:07.169686757Z [2024-06-27T03:15:07.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06ae3d43-0f3c-457b-9c29-9b28abd09175 2024-06-27T03:15:09.847809197Z [2024-06-27T03:15:09.847+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:15:09.847838859Z 2024-06-27T03:15:09.848470508Z [2024-06-27T03:15:09.848+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:15:09.849294637Z [2024-06-27T03:15:09.849+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:15:09.849309800Z 2024-06-27T03:15:09.851863892Z [2024-06-27T03:15:09.851+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:15:09.852216156Z [2024-06-27T03:15:09.852+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:15:09.913830504Z [2024-06-27T03:15:09.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:09.913930808Z [2024-06-27T03:15:09.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:09.925813593Z [2024-06-27T03:15:09.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T03:10:00+00:00, map_index=0, run_start_date=2024-06-27 03:15:09.054216+00:00, run_end_date=2024-06-27 03:15:09.430950+00:00, run_duration=0.376734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:07.093896+00:00, queued_by_job_id=2, pid=825 2024-06-27T03:15:09.925928003Z [2024-06-27T03:15:09.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34de5f55-0c8d-4a2c-9fbc-ceb25a2b3fe8 2024-06-27T03:15:12.235534761Z [2024-06-27T03:15:12.235+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:15:12.236051360Z [2024-06-27T03:15:12.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:10:00+00:00, run_id=scheduled__2024-06-27T03:10:00+00:00, run_start_date=2024-06-27 03:15:00.114408+00:00, run_end_date=2024-06-27 03:15:12.235496+00:00, run_duration=12.121088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:10:00+00:00, data_interval_end=2024-06-27 03:15:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T03:15:12.244837860Z [2024-06-27T03:15:12.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:15:00+00:00, run_after=2024-06-27T03:20:00+00:00 2024-06-27T03:15:13.358497629Z [2024-06-27T03:15:13.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:13.366684639Z [2024-06-27T03:15:13.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T03:10:00+00:00, map_index=-1, run_start_date=2024-06-27 03:15:11.741523+00:00, run_end_date=2024-06-27 03:15:12.198513+00:00, run_duration=0.45699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:09.849855+00:00, queued_by_job_id=2, pid=837 2024-06-27T03:15:28.887736742Z [2024-06-27T03:15:28.887+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:15:00+00:00, run_after=2024-06-27T03:16:00+00:00 2024-06-27T03:15:28.961590371Z [2024-06-27T03:15:28.961+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:15:28.961614740Z 2024-06-27T03:15:28.961859227Z [2024-06-27T03:15:28.961+0000] {scheduler_job.py:425} INFO - DAG vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:15:28.962460992Z [2024-06-27T03:15:28.962+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:15:28.962472427Z 2024-06-27T03:15:28.964955983Z [2024-06-27T03:15:28.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:15:28.965182955Z [2024-06-27T03:15:28.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:15:29.099528694Z [2024-06-27T03:15:29.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:14:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:29.116217210Z [2024-06-27T03:15:29.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5381a386-7fb7-4339-8752-a28351178d33 2024-06-27T03:15:32.580187762Z [2024-06-27T03:15:32.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:15:32.582760354Z [2024-06-27T03:15:32.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, execution_date=2024-06-27 03:14:00+00:00, run_id=scheduled__2024-06-27T03:14:00+00:00, run_start_date=2024-06-27 03:15:28.912004+00:00, run_end_date=2024-06-27 03:15:32.581177+00:00, run_duration=3.669173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:14:00+00:00, data_interval_end=2024-06-27 03:15:00+00:00, dag_hash=0da0d9047a23bbd832bfe7e890e66e1d 2024-06-27T03:15:32.599359405Z [2024-06-27T03:15:32.599+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:15:00+00:00, run_after=2024-06-27T03:16:00+00:00 2024-06-27T03:15:32.629875614Z [2024-06-27T03:15:32.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:14:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:32.636038829Z [2024-06-27T03:15:32.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:14:00+00:00, map_index=-1, run_start_date=2024-06-27 03:15:30.922365+00:00, run_end_date=2024-06-27 03:15:32.235432+00:00, run_duration=1.313067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:28.962858+00:00, queued_by_job_id=2, pid=849 2024-06-27T03:15:35.813374353Z [2024-06-27T03:15:35.812+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:15:35.881965799Z [2024-06-27T03:15:35.881+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:15:35.881992002Z 2024-06-27T03:15:35.882139706Z [2024-06-27T03:15:35.881+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:15:35.884809682Z [2024-06-27T03:15:35.884+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:15:35.884827396Z 2024-06-27T03:15:35.888394239Z [2024-06-27T03:15:35.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:15:35.888915125Z [2024-06-27T03:15:35.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:15:35.952972390Z [2024-06-27T03:15:35.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:14:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:35.958803332Z [2024-06-27T03:15:35.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f9a5373-1e05-4a5d-a2cd-f631473f1618 2024-06-27T03:15:40.380572582Z [2024-06-27T03:15:40.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:15:00+00:00, run_after=2024-06-27T03:20:00+00:00 2024-06-27T03:15:40.428672900Z [2024-06-27T03:15:40.428+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:15:40.428948764Z [2024-06-27T03:15:40.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, execution_date=2024-06-27 03:14:00+00:00, run_id=scheduled__2024-06-27T03:14:00+00:00, run_start_date=2024-06-27 03:15:35.829910+00:00, run_end_date=2024-06-27 03:15:40.428448+00:00, run_duration=4.598538, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:14:00+00:00, data_interval_end=2024-06-27 03:15:00+00:00, dag_hash=43a8069a4032189c1833f10cc110392a 2024-06-27T03:15:40.440063334Z [2024-06-27T03:15:40.439+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:15:00+00:00, run_after=2024-06-27T03:16:00+00:00 2024-06-27T03:15:40.455888689Z [2024-06-27T03:15:40.455+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:15:40.455931115Z 2024-06-27T03:15:40.455955973Z [2024-06-27T03:15:40.455+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:15:40.456712176Z [2024-06-27T03:15:40.456+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:15:40.456729606Z 2024-06-27T03:15:40.459918025Z [2024-06-27T03:15:40.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T03:15:40.460396525Z [2024-06-27T03:15:40.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:15:40.525676722Z [2024-06-27T03:15:40.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:40.525895571Z [2024-06-27T03:15:40.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:14:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:40.540024018Z [2024-06-27T03:15:40.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:14:00+00:00, map_index=-1, run_start_date=2024-06-27 03:15:37.513926+00:00, run_end_date=2024-06-27 03:15:39.187464+00:00, run_duration=1.673538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:35.885231+00:00, queued_by_job_id=2, pid=884 2024-06-27T03:15:40.540186528Z [2024-06-27T03:15:40.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85f4de64-e99b-4610-b3a9-c547183c0c47 2024-06-27T03:15:42.852404259Z [2024-06-27T03:15:42.852+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:15:42.852437875Z 2024-06-27T03:15:42.852684108Z [2024-06-27T03:15:42.852+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:15:42.853373633Z [2024-06-27T03:15:42.853+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:15:42.853398700Z 2024-06-27T03:15:42.857241707Z [2024-06-27T03:15:42.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='split_metrics', run_id='scheduled__2024-06-27T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:15:42.857754296Z [2024-06-27T03:15:42.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'split_metrics', 'scheduled__2024-06-27T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:15:42.922996905Z [2024-06-27T03:15:42.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.split_metrics run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:42.923548543Z [2024-06-27T03:15:42.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:42.929813753Z [2024-06-27T03:15:42.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2b85f2f-938b-40e2-b7b4-441370fe6988 2024-06-27T03:15:42.930107428Z [2024-06-27T03:15:42.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:10:00+00:00, map_index=-1, run_start_date=2024-06-27 03:15:42.223884+00:00, run_end_date=2024-06-27 03:15:42.672512+00:00, run_duration=0.448628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:40.457103+00:00, queued_by_job_id=2, pid=905 2024-06-27T03:15:45.261326694Z [2024-06-27T03:15:45.260+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:15:45.261369813Z 2024-06-27T03:15:45.261788074Z [2024-06-27T03:15:45.261+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:15:45.263244677Z [2024-06-27T03:15:45.262+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:15:45.263309160Z 2024-06-27T03:15:45.268119777Z [2024-06-27T03:15:45.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='collect_metrics', run_id='scheduled__2024-06-27T03:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T03:15:45.268635592Z [2024-06-27T03:15:45.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'collect_metrics', 'scheduled__2024-06-27T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T03:15:45.339713465Z [2024-06-27T03:15:45.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.collect_metrics run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:45.339860053Z [2024-06-27T03:15:45.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.split_metrics run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:45.348878795Z [2024-06-27T03:15:45.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=split_metrics, run_id=scheduled__2024-06-27T03:10:00+00:00, map_index=-1, run_start_date=2024-06-27 03:15:44.530955+00:00, run_end_date=2024-06-27 03:15:44.927190+00:00, run_duration=0.396235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:42.853812+00:00, queued_by_job_id=2, pid=926 2024-06-27T03:15:45.349492757Z [2024-06-27T03:15:45.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66a9173b-3e57-489a-bc9a-e567682e4639 2024-06-27T03:15:47.958232068Z [2024-06-27T03:15:47.957+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:15:47.958267399Z 2024-06-27T03:15:47.958490289Z [2024-06-27T03:15:47.958+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:15:47.959111379Z [2024-06-27T03:15:47.958+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:15:47.959139751Z 2024-06-27T03:15:47.962089741Z [2024-06-27T03:15:47.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='send_prometheus', run_id='scheduled__2024-06-27T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:15:47.962265670Z [2024-06-27T03:15:47.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'send_prometheus', 'scheduled__2024-06-27T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:15:48.028513199Z [2024-06-27T03:15:48.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.send_prometheus run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status queued for try_number 1 2024-06-27T03:15:48.029620601Z [2024-06-27T03:15:48.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.collect_metrics run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:48.035945696Z [2024-06-27T03:15:48.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=collect_metrics, run_id=scheduled__2024-06-27T03:10:00+00:00, map_index=0, run_start_date=2024-06-27 03:15:46.892544+00:00, run_end_date=2024-06-27 03:15:47.301569+00:00, run_duration=0.409025, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:45.264649+00:00, queued_by_job_id=2, pid=938 2024-06-27T03:15:48.036358394Z [2024-06-27T03:15:48.036+0000] {scheduler_job.py:635} INFO - Setting external_id for to a04b3f35-c4d0-4671-b4b1-57147fb68cd5 2024-06-27T03:15:50.439328358Z [2024-06-27T03:15:50.438+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:15:50.439675676Z [2024-06-27T03:15:50.439+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, execution_date=2024-06-27 03:10:00+00:00, run_id=scheduled__2024-06-27T03:10:00+00:00, run_start_date=2024-06-27 03:15:40.397937+00:00, run_end_date=2024-06-27 03:15:50.439195+00:00, run_duration=10.041258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:10:00+00:00, data_interval_end=2024-06-27 03:15:00+00:00, dag_hash=51eef277fbd286eb615ec8013058cb22 2024-06-27T03:15:50.445771145Z [2024-06-27T03:15:50.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:15:00+00:00, run_after=2024-06-27T03:20:00+00:00 2024-06-27T03:15:50.486455066Z [2024-06-27T03:15:50.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.send_prometheus run_id=scheduled__2024-06-27T03:10:00+00:00 exited with status success for try_number 1 2024-06-27T03:15:50.499026959Z [2024-06-27T03:15:50.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=send_prometheus, run_id=scheduled__2024-06-27T03:10:00+00:00, map_index=-1, run_start_date=2024-06-27 03:15:49.918141+00:00, run_end_date=2024-06-27 03:15:50.256308+00:00, run_duration=0.338167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:15:47.959470+00:00, queued_by_job_id=2, pid=950 2024-06-27T03:16:00.505139448Z [2024-06-27T03:16:00.504+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:16:00.515700194Z [2024-06-27T03:16:00.513+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:16:00.523272215Z [2024-06-27T03:16:00.522+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:16:00.537824997Z [2024-06-27T03:16:00.537+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:16:00+00:00, run_after=2024-06-27T03:17:00+00:00 2024-06-27T03:16:00.551220755Z [2024-06-27T03:16:00.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:16:00+00:00, run_after=2024-06-27T03:17:00+00:00 2024-06-27T03:16:00.567716827Z [2024-06-27T03:16:00.567+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:16:00+00:00, run_after=2024-06-27T03:17:00+00:00 2024-06-27T03:16:00.676064059Z [2024-06-27T03:16:00.675+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-06-27T03:16:00.676092875Z 2024-06-27T03:16:00.676101810Z 2024-06-27T03:16:00.676108447Z 2024-06-27T03:16:00.676115511Z 2024-06-27T03:16:00.676141900Z 2024-06-27T03:16:00.676147928Z 2024-06-27T03:16:00.676644435Z [2024-06-27T03:16:00.676+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:16:00.677162627Z [2024-06-27T03:16:00.676+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:16:00.677611258Z [2024-06-27T03:16:00.677+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:16:00.678019498Z [2024-06-27T03:16:00.677+0000] {scheduler_job.py:425} INFO - DAG vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:16:00.678459969Z [2024-06-27T03:16:00.678+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:16:00.678872810Z [2024-06-27T03:16:00.678+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:16:00.680223099Z [2024-06-27T03:16:00.679+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:16:00.680241051Z 2024-06-27T03:16:00.680248721Z 2024-06-27T03:16:00.680256345Z 2024-06-27T03:16:00.680263195Z 2024-06-27T03:16:00.680269779Z 2024-06-27T03:16:00.680275505Z 2024-06-27T03:16:00.688848700Z [2024-06-27T03:16:00.688+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:16:00.689521099Z [2024-06-27T03:16:00.689+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:16:00.689983419Z [2024-06-27T03:16:00.689+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:16:00.690244551Z [2024-06-27T03:16:00.689+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:16:00.690676960Z [2024-06-27T03:16:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:16:00.691445396Z [2024-06-27T03:16:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:16:00.691906237Z [2024-06-27T03:16:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:16:00.692517638Z [2024-06-27T03:16:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:16:00.693123722Z [2024-06-27T03:16:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:16:00.693399927Z [2024-06-27T03:16:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:16:00.693979878Z [2024-06-27T03:16:00.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:16:00.694333913Z [2024-06-27T03:16:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:16:01.341045817Z [2024-06-27T03:16:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:14:00+00:00 exited with status queued for try_number 1 2024-06-27T03:16:01.341222671Z [2024-06-27T03:16:01.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status queued for try_number 1 2024-06-27T03:16:01.341358594Z [2024-06-27T03:16:01.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status queued for try_number 1 2024-06-27T03:16:01.341503784Z [2024-06-27T03:16:01.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status queued for try_number 1 2024-06-27T03:16:01.341662507Z [2024-06-27T03:16:01.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status queued for try_number 1 2024-06-27T03:16:01.347878598Z [2024-06-27T03:16:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status queued for try_number 1 2024-06-27T03:16:01.373802095Z [2024-06-27T03:16:01.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6844113b-23b0-4168-b1b8-4d158e9e4003 2024-06-27T03:16:01.374012798Z [2024-06-27T03:16:01.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4190bab8-449b-4af2-b6b7-cc75fd91aaa5 2024-06-27T03:16:01.374210013Z [2024-06-27T03:16:01.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2734ef4-159b-4944-9e4b-785bf7bc73e2 2024-06-27T03:16:01.374449576Z [2024-06-27T03:16:01.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cb0917f-52aa-4696-aff8-905a347e8da4 2024-06-27T03:16:01.374638041Z [2024-06-27T03:16:01.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26f63fbb-a851-42e2-8929-15b5ccebde68 2024-06-27T03:16:01.374798750Z [2024-06-27T03:16:01.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d4c5a8f-77bc-4f42-a102-41bd0c876bfb 2024-06-27T03:16:03.448266402Z [2024-06-27T03:16:03.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:16:03.448277394Z [2024-06-27T03:16:03.435+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:14:00+00:00, run_id=scheduled__2024-06-27T03:14:00+00:00, run_start_date=2024-06-27 03:16:00.577726+00:00, run_end_date=2024-06-27 03:16:03.435440+00:00, run_duration=2.857714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:14:00+00:00, data_interval_end=2024-06-27 03:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:16:03.461904545Z [2024-06-27T03:16:03.461+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:16:00+00:00, run_after=2024-06-27T03:18:00+00:00 2024-06-27T03:16:03.520241678Z [2024-06-27T03:16:03.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:16:03.521209706Z [2024-06-27T03:16:03.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:15:00+00:00, run_id=scheduled__2024-06-27T03:15:00+00:00, run_start_date=2024-06-27 03:16:00.580074+00:00, run_end_date=2024-06-27 03:16:03.520871+00:00, run_duration=2.940797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:15:00+00:00, data_interval_end=2024-06-27 03:16:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:16:03.553562101Z [2024-06-27T03:16:03.553+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:16:00+00:00, run_after=2024-06-27T03:17:00+00:00 2024-06-27T03:16:03.688976839Z [2024-06-27T03:16:03.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:14:00+00:00 exited with status success for try_number 1 2024-06-27T03:16:03.689593404Z [2024-06-27T03:16:03.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status success for try_number 1 2024-06-27T03:16:03.699398127Z [2024-06-27T03:16:03.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:14:00+00:00, map_index=-1, run_start_date=2024-06-27 03:16:02.229826+00:00, run_end_date=2024-06-27 03:16:02.755149+00:00, run_duration=0.525323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:16:00.683810+00:00, queued_by_job_id=2, pid=957 2024-06-27T03:16:03.699818414Z [2024-06-27T03:16:03.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:15:00+00:00, map_index=-1, run_start_date=2024-06-27 03:16:02.571902+00:00, run_end_date=2024-06-27 03:16:03.234785+00:00, run_duration=0.662883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:16:00.683810+00:00, queued_by_job_id=2, pid=968 2024-06-27T03:16:06.015210055Z [2024-06-27T03:16:06.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:16:06.016310684Z [2024-06-27T03:16:06.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, execution_date=2024-06-27 03:15:00+00:00, run_id=scheduled__2024-06-27T03:15:00+00:00, run_start_date=2024-06-27 03:16:00.582093+00:00, run_end_date=2024-06-27 03:16:06.015667+00:00, run_duration=5.433574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:15:00+00:00, data_interval_end=2024-06-27 03:16:00+00:00, dag_hash=43a8069a4032189c1833f10cc110392a 2024-06-27T03:16:06.029290946Z [2024-06-27T03:16:06.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:16:00+00:00, run_after=2024-06-27T03:17:00+00:00 2024-06-27T03:16:06.037604177Z [2024-06-27T03:16:06.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:16:06.038233859Z [2024-06-27T03:16:06.037+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:15:00+00:00, run_id=scheduled__2024-06-27T03:15:00+00:00, run_start_date=2024-06-27 03:16:00.582994+00:00, run_end_date=2024-06-27 03:16:06.037814+00:00, run_duration=5.45482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:15:00+00:00, data_interval_end=2024-06-27 03:16:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:16:06.058432153Z [2024-06-27T03:16:06.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:16:00+00:00, run_after=2024-06-27T03:17:00+00:00 2024-06-27T03:16:06.106478430Z [2024-06-27T03:16:06.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status success for try_number 1 2024-06-27T03:16:06.106546717Z [2024-06-27T03:16:06.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status success for try_number 1 2024-06-27T03:16:06.115231211Z [2024-06-27T03:16:06.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:15:00+00:00, map_index=-1, run_start_date=2024-06-27 03:16:04.121483+00:00, run_end_date=2024-06-27 03:16:05.650447+00:00, run_duration=1.528964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:16:00.683810+00:00, queued_by_job_id=2, pid=1018 2024-06-27T03:16:06.115509805Z [2024-06-27T03:16:06.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:15:00+00:00, map_index=-1, run_start_date=2024-06-27 03:16:03.706601+00:00, run_end_date=2024-06-27 03:16:05.714479+00:00, run_duration=2.007878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:16:00.683810+00:00, queued_by_job_id=2, pid=999 2024-06-27T03:16:07.173983789Z [2024-06-27T03:16:07.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:16:07.174362555Z [2024-06-27T03:16:07.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:15:00+00:00, run_id=scheduled__2024-06-27T03:15:00+00:00, run_start_date=2024-06-27 03:16:00.578985+00:00, run_end_date=2024-06-27 03:16:07.173922+00:00, run_duration=6.594937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:15:00+00:00, data_interval_end=2024-06-27 03:16:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:16:07.191092345Z [2024-06-27T03:16:07.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:16:00+00:00, run_after=2024-06-27T03:17:00+00:00 2024-06-27T03:16:07.205919686Z [2024-06-27T03:16:07.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:16:07.206503276Z [2024-06-27T03:16:07.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, execution_date=2024-06-27 03:15:00+00:00, run_id=scheduled__2024-06-27T03:15:00+00:00, run_start_date=2024-06-27 03:16:00.581157+00:00, run_end_date=2024-06-27 03:16:07.205705+00:00, run_duration=6.624548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:15:00+00:00, data_interval_end=2024-06-27 03:16:00+00:00, dag_hash=0da0d9047a23bbd832bfe7e890e66e1d 2024-06-27T03:16:07.218548565Z [2024-06-27T03:16:07.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:16:00+00:00, run_after=2024-06-27T03:17:00+00:00 2024-06-27T03:16:07.247668702Z [2024-06-27T03:16:07.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status success for try_number 1 2024-06-27T03:16:07.247712104Z [2024-06-27T03:16:07.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status success for try_number 1 2024-06-27T03:16:07.255801028Z [2024-06-27T03:16:07.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:15:00+00:00, map_index=-1, run_start_date=2024-06-27 03:16:04.261387+00:00, run_end_date=2024-06-27 03:16:06.255881+00:00, run_duration=1.994494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:16:00.683810+00:00, queued_by_job_id=2, pid=1028 2024-06-27T03:16:07.256884565Z [2024-06-27T03:16:07.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:15:00+00:00, map_index=-1, run_start_date=2024-06-27 03:16:04.723879+00:00, run_end_date=2024-06-27 03:16:06.267434+00:00, run_duration=1.543555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:16:00.683810+00:00, queued_by_job_id=2, pid=1047 2024-06-27T03:17:00.916791824Z [2024-06-27T03:17:00.916+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:17:00+00:00, run_after=2024-06-27T03:18:00+00:00 2024-06-27T03:17:00.935175759Z [2024-06-27T03:17:00.934+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:17:00+00:00, run_after=2024-06-27T03:18:00+00:00 2024-06-27T03:17:00.952544795Z [2024-06-27T03:17:00.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:17:00+00:00, run_after=2024-06-27T03:18:00+00:00 2024-06-27T03:17:00.962511713Z [2024-06-27T03:17:00.962+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:17:00.975370634Z [2024-06-27T03:17:00.975+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:17:01.148507321Z [2024-06-27T03:17:01.148+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T03:17:01.148534043Z 2024-06-27T03:17:01.148538080Z 2024-06-27T03:17:01.148541845Z 2024-06-27T03:17:01.148545697Z 2024-06-27T03:17:01.148566295Z 2024-06-27T03:17:01.149166999Z [2024-06-27T03:17:01.148+0000] {scheduler_job.py:425} INFO - DAG vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:17:01.149494505Z [2024-06-27T03:17:01.149+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:17:01.149711527Z [2024-06-27T03:17:01.149+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:17:01.149953378Z [2024-06-27T03:17:01.149+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:17:01.150079352Z [2024-06-27T03:17:01.149+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:17:01.150833917Z [2024-06-27T03:17:01.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:17:01.150847089Z 2024-06-27T03:17:01.150851159Z 2024-06-27T03:17:01.150855520Z 2024-06-27T03:17:01.150859207Z 2024-06-27T03:17:01.150862901Z 2024-06-27T03:17:01.155923979Z [2024-06-27T03:17:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:17:01.156217231Z [2024-06-27T03:17:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:17:01.156554054Z [2024-06-27T03:17:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:17:01.156747857Z [2024-06-27T03:17:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:17:01.157155594Z [2024-06-27T03:17:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:17:01.157411548Z [2024-06-27T03:17:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:17:01.157779683Z [2024-06-27T03:17:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:17:01.157987566Z [2024-06-27T03:17:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:17:01.158351752Z [2024-06-27T03:17:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:17:01.158713832Z [2024-06-27T03:17:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:17:01.690258752Z [2024-06-27T03:17:01.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:16:00+00:00 exited with status queued for try_number 1 2024-06-27T03:17:01.693350854Z [2024-06-27T03:17:01.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:16:00+00:00 exited with status queued for try_number 1 2024-06-27T03:17:01.693636552Z [2024-06-27T03:17:01.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:16:00+00:00 exited with status queued for try_number 1 2024-06-27T03:17:01.693820412Z [2024-06-27T03:17:01.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:16:00+00:00 exited with status queued for try_number 1 2024-06-27T03:17:01.694239593Z [2024-06-27T03:17:01.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:16:00+00:00 exited with status queued for try_number 1 2024-06-27T03:17:01.711128266Z [2024-06-27T03:17:01.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3add4a99-cabe-43e8-88c1-0ed0d2fbe082 2024-06-27T03:17:01.711396452Z [2024-06-27T03:17:01.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 088f24ea-893e-4aa1-9051-4713021e3f30 2024-06-27T03:17:01.711716056Z [2024-06-27T03:17:01.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee421f2e-f6e0-47f2-81b8-32ad1c7cca44 2024-06-27T03:17:01.711939191Z [2024-06-27T03:17:01.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 783a71cc-58ad-412a-8f53-1a2fec834ac2 2024-06-27T03:17:01.712220995Z [2024-06-27T03:17:01.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb7ac4b9-12eb-4a97-9bcd-d50428cdf768 2024-06-27T03:17:03.219492584Z [2024-06-27T03:17:03.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:17:03.219855382Z [2024-06-27T03:17:03.219+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:16:00+00:00, run_id=scheduled__2024-06-27T03:16:00+00:00, run_start_date=2024-06-27 03:17:00.991598+00:00, run_end_date=2024-06-27 03:17:03.219381+00:00, run_duration=2.227783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:16:00+00:00, data_interval_end=2024-06-27 03:17:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:17:03.232302329Z [2024-06-27T03:17:03.231+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:17:00+00:00, run_after=2024-06-27T03:18:00+00:00 2024-06-27T03:17:03.299553461Z [2024-06-27T03:17:03.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:16:00+00:00 exited with status success for try_number 1 2024-06-27T03:17:03.309126687Z [2024-06-27T03:17:03.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:16:00+00:00, map_index=-1, run_start_date=2024-06-27 03:17:02.394882+00:00, run_end_date=2024-06-27 03:17:03.005023+00:00, run_duration=0.610141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:17:01.152447+00:00, queued_by_job_id=2, pid=1094 2024-06-27T03:17:06.174844797Z [2024-06-27T03:17:06.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:17:06.176934347Z [2024-06-27T03:17:06.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, execution_date=2024-06-27 03:16:00+00:00, run_id=scheduled__2024-06-27T03:16:00+00:00, run_start_date=2024-06-27 03:17:00.989756+00:00, run_end_date=2024-06-27 03:17:06.174722+00:00, run_duration=5.184966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:16:00+00:00, data_interval_end=2024-06-27 03:17:00+00:00, dag_hash=0da0d9047a23bbd832bfe7e890e66e1d 2024-06-27T03:17:06.184863197Z [2024-06-27T03:17:06.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:17:00+00:00, run_after=2024-06-27T03:18:00+00:00 2024-06-27T03:17:06.192561285Z [2024-06-27T03:17:06.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:17:06.192974575Z [2024-06-27T03:17:06.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:16:00+00:00, run_id=scheduled__2024-06-27T03:16:00+00:00, run_start_date=2024-06-27 03:17:00.993079+00:00, run_end_date=2024-06-27 03:17:06.192478+00:00, run_duration=5.199399, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:16:00+00:00, data_interval_end=2024-06-27 03:17:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:17:06.201994340Z [2024-06-27T03:17:06.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:17:00+00:00, run_after=2024-06-27T03:18:00+00:00 2024-06-27T03:17:06.254324829Z [2024-06-27T03:17:06.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:16:00+00:00 exited with status success for try_number 1 2024-06-27T03:17:06.254583879Z [2024-06-27T03:17:06.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:16:00+00:00 exited with status success for try_number 1 2024-06-27T03:17:06.262144254Z [2024-06-27T03:17:06.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:16:00+00:00, map_index=-1, run_start_date=2024-06-27 03:17:04.015180+00:00, run_end_date=2024-06-27 03:17:05.732811+00:00, run_duration=1.717631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:17:01.152447+00:00, queued_by_job_id=2, pid=1121 2024-06-27T03:17:06.262464617Z [2024-06-27T03:17:06.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:16:00+00:00, map_index=-1, run_start_date=2024-06-27 03:17:04.588330+00:00, run_end_date=2024-06-27 03:17:05.967675+00:00, run_duration=1.379345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:17:01.152447+00:00, queued_by_job_id=2, pid=1155 2024-06-27T03:17:07.321013823Z [2024-06-27T03:17:07.320+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:17:07.321593654Z [2024-06-27T03:17:07.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, execution_date=2024-06-27 03:16:00+00:00, run_id=scheduled__2024-06-27T03:16:00+00:00, run_start_date=2024-06-27 03:17:00.995824+00:00, run_end_date=2024-06-27 03:17:07.320887+00:00, run_duration=6.325063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:16:00+00:00, data_interval_end=2024-06-27 03:17:00+00:00, dag_hash=43a8069a4032189c1833f10cc110392a 2024-06-27T03:17:07.342199763Z [2024-06-27T03:17:07.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:17:00+00:00, run_after=2024-06-27T03:18:00+00:00 2024-06-27T03:17:07.357310540Z [2024-06-27T03:17:07.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:17:07.357503852Z [2024-06-27T03:17:07.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:16:00+00:00, run_id=scheduled__2024-06-27T03:16:00+00:00, run_start_date=2024-06-27 03:17:00.994410+00:00, run_end_date=2024-06-27 03:17:07.357139+00:00, run_duration=6.362729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:16:00+00:00, data_interval_end=2024-06-27 03:17:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:17:07.372847478Z [2024-06-27T03:17:07.372+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:17:00+00:00, run_after=2024-06-27T03:18:00+00:00 2024-06-27T03:17:07.432828990Z [2024-06-27T03:17:07.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:16:00+00:00 exited with status success for try_number 1 2024-06-27T03:17:07.433151270Z [2024-06-27T03:17:07.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:16:00+00:00 exited with status success for try_number 1 2024-06-27T03:17:07.447762568Z [2024-06-27T03:17:07.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:16:00+00:00, map_index=-1, run_start_date=2024-06-27 03:17:04.626144+00:00, run_end_date=2024-06-27 03:17:06.434410+00:00, run_duration=1.808266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:17:01.152447+00:00, queued_by_job_id=2, pid=1156 2024-06-27T03:17:07.448559784Z [2024-06-27T03:17:07.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:16:00+00:00, map_index=-1, run_start_date=2024-06-27 03:17:04.385055+00:00, run_end_date=2024-06-27 03:17:06.410887+00:00, run_duration=2.025832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:17:01.152447+00:00, queued_by_job_id=2, pid=1145 2024-06-27T03:18:00.186501956Z [2024-06-27T03:18:00.185+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:18:00.202126147Z [2024-06-27T03:18:00.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:18:00+00:00, run_after=2024-06-27T03:19:00+00:00 2024-06-27T03:18:00.218119979Z [2024-06-27T03:18:00.217+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:18:00.242239825Z [2024-06-27T03:18:00.241+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:18:00+00:00, run_after=2024-06-27T03:19:00+00:00 2024-06-27T03:18:00.251230109Z [2024-06-27T03:18:00.250+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:18:00.264839385Z [2024-06-27T03:18:00.264+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:18:00+00:00, run_after=2024-06-27T03:19:00+00:00 2024-06-27T03:18:00.371111252Z [2024-06-27T03:18:00.370+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-06-27T03:18:00.371150369Z 2024-06-27T03:18:00.371159350Z 2024-06-27T03:18:00.371166525Z 2024-06-27T03:18:00.371173886Z 2024-06-27T03:18:00.371180863Z 2024-06-27T03:18:00.371188248Z 2024-06-27T03:18:00.371264751Z [2024-06-27T03:18:00.370+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:18:00.371548638Z [2024-06-27T03:18:00.371+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:18:00.371726162Z [2024-06-27T03:18:00.371+0000] {scheduler_job.py:425} INFO - DAG vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:18:00.371882794Z [2024-06-27T03:18:00.371+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:18:00.372007864Z [2024-06-27T03:18:00.371+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:18:00.372131037Z [2024-06-27T03:18:00.371+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:18:00.372903958Z [2024-06-27T03:18:00.372+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:18:00.372919291Z 2024-06-27T03:18:00.372927032Z 2024-06-27T03:18:00.372934116Z 2024-06-27T03:18:00.372941127Z 2024-06-27T03:18:00.372948047Z 2024-06-27T03:18:00.372955497Z 2024-06-27T03:18:00.379271520Z [2024-06-27T03:18:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:18:00.379367760Z [2024-06-27T03:18:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:18:00.379692437Z [2024-06-27T03:18:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:18:00.379786357Z [2024-06-27T03:18:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:18:00.380065766Z [2024-06-27T03:18:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:18:00.380273046Z [2024-06-27T03:18:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:18:00.380605850Z [2024-06-27T03:18:00.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:18:00.380835500Z [2024-06-27T03:18:00.380+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:18:00.381226237Z [2024-06-27T03:18:00.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:18:00.381550405Z [2024-06-27T03:18:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:18:00.381988379Z [2024-06-27T03:18:00.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:18:00.382176113Z [2024-06-27T03:18:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:18:00.970181836Z [2024-06-27T03:18:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:16:00+00:00 exited with status queued for try_number 1 2024-06-27T03:18:00.970334937Z [2024-06-27T03:18:00.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:17:00+00:00 exited with status queued for try_number 1 2024-06-27T03:18:00.970546697Z [2024-06-27T03:18:00.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:17:00+00:00 exited with status queued for try_number 1 2024-06-27T03:18:00.970765634Z [2024-06-27T03:18:00.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:17:00+00:00 exited with status queued for try_number 1 2024-06-27T03:18:00.970834988Z [2024-06-27T03:18:00.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:17:00+00:00 exited with status queued for try_number 1 2024-06-27T03:18:00.970997106Z [2024-06-27T03:18:00.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:17:00+00:00 exited with status queued for try_number 1 2024-06-27T03:18:00.979762533Z [2024-06-27T03:18:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3db67721-0f13-4a3b-beb6-87f3113a18e0 2024-06-27T03:18:00.980104786Z [2024-06-27T03:18:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38e12207-4e61-4a50-b194-9c17fb3bcc9c 2024-06-27T03:18:00.980973938Z [2024-06-27T03:18:00.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98a7486f-7139-45ec-b304-2d3efc8ce958 2024-06-27T03:18:00.981213699Z [2024-06-27T03:18:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to f701da2e-6f26-492a-bccf-7075897364c6 2024-06-27T03:18:00.981444691Z [2024-06-27T03:18:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1c7d865-147d-4525-adeb-2a8f601ce7e7 2024-06-27T03:18:00.981701579Z [2024-06-27T03:18:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 322b4989-6f33-4737-bc15-d01b88610726 2024-06-27T03:18:02.449944749Z [2024-06-27T03:18:02.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:18:02.450297184Z [2024-06-27T03:18:02.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:16:00+00:00, run_id=scheduled__2024-06-27T03:16:00+00:00, run_start_date=2024-06-27 03:18:00.274353+00:00, run_end_date=2024-06-27 03:18:02.449820+00:00, run_duration=2.175467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:16:00+00:00, data_interval_end=2024-06-27 03:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:18:02.464036101Z [2024-06-27T03:18:02.463+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:18:00+00:00, run_after=2024-06-27T03:20:00+00:00 2024-06-27T03:18:02.600237458Z [2024-06-27T03:18:02.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:16:00+00:00 exited with status success for try_number 1 2024-06-27T03:18:02.619736628Z [2024-06-27T03:18:02.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:16:00+00:00, map_index=-1, run_start_date=2024-06-27 03:18:01.807924+00:00, run_end_date=2024-06-27 03:18:02.283143+00:00, run_duration=0.475219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:18:00.374815+00:00, queued_by_job_id=2, pid=1213 2024-06-27T03:18:03.681294343Z [2024-06-27T03:18:03.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:18:03.682456649Z [2024-06-27T03:18:03.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:17:00+00:00, run_id=scheduled__2024-06-27T03:17:00+00:00, run_start_date=2024-06-27 03:18:00.277769+00:00, run_end_date=2024-06-27 03:18:03.681786+00:00, run_duration=3.404017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:17:00+00:00, data_interval_end=2024-06-27 03:18:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:18:03.699930404Z [2024-06-27T03:18:03.699+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:18:00+00:00, run_after=2024-06-27T03:19:00+00:00 2024-06-27T03:18:03.806354540Z [2024-06-27T03:18:03.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:17:00+00:00 exited with status success for try_number 1 2024-06-27T03:18:03.818170372Z [2024-06-27T03:18:03.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:17:00+00:00, map_index=-1, run_start_date=2024-06-27 03:18:01.939288+00:00, run_end_date=2024-06-27 03:18:02.660072+00:00, run_duration=0.720784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:18:00.374815+00:00, queued_by_job_id=2, pid=1214 2024-06-27T03:18:06.347641448Z [2024-06-27T03:18:06.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:18:06.348194419Z [2024-06-27T03:18:06.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, execution_date=2024-06-27 03:17:00+00:00, run_id=scheduled__2024-06-27T03:17:00+00:00, run_start_date=2024-06-27 03:18:00.278696+00:00, run_end_date=2024-06-27 03:18:06.347855+00:00, run_duration=6.069159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:17:00+00:00, data_interval_end=2024-06-27 03:18:00+00:00, dag_hash=43a8069a4032189c1833f10cc110392a 2024-06-27T03:18:06.365150028Z [2024-06-27T03:18:06.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:18:00+00:00, run_after=2024-06-27T03:19:00+00:00 2024-06-27T03:18:06.384871699Z [2024-06-27T03:18:06.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:18:06.384899140Z [2024-06-27T03:18:06.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, execution_date=2024-06-27 03:17:00+00:00, run_id=scheduled__2024-06-27T03:17:00+00:00, run_start_date=2024-06-27 03:18:00.276646+00:00, run_end_date=2024-06-27 03:18:06.379542+00:00, run_duration=6.102896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:17:00+00:00, data_interval_end=2024-06-27 03:18:00+00:00, dag_hash=0da0d9047a23bbd832bfe7e890e66e1d 2024-06-27T03:18:06.408234475Z [2024-06-27T03:18:06.404+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:18:00+00:00, run_after=2024-06-27T03:19:00+00:00 2024-06-27T03:18:06.416643092Z [2024-06-27T03:18:06.414+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:18:06.416663630Z [2024-06-27T03:18:06.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:17:00+00:00, run_id=scheduled__2024-06-27T03:17:00+00:00, run_start_date=2024-06-27 03:18:00.279613+00:00, run_end_date=2024-06-27 03:18:06.415110+00:00, run_duration=6.135497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:17:00+00:00, data_interval_end=2024-06-27 03:18:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:18:06.425680819Z [2024-06-27T03:18:06.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:18:00+00:00, run_after=2024-06-27T03:19:00+00:00 2024-06-27T03:18:06.482069287Z [2024-06-27T03:18:06.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:17:00+00:00 exited with status success for try_number 1 2024-06-27T03:18:06.491082569Z [2024-06-27T03:18:06.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:17:00+00:00, map_index=-1, run_start_date=2024-06-27 03:18:04.202411+00:00, run_end_date=2024-06-27 03:18:05.781815+00:00, run_duration=1.579404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:18:00.374815+00:00, queued_by_job_id=2, pid=1275 2024-06-27T03:18:07.549117816Z [2024-06-27T03:18:07.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:18:07.549526905Z [2024-06-27T03:18:07.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:17:00+00:00, run_id=scheduled__2024-06-27T03:17:00+00:00, run_start_date=2024-06-27 03:18:00.275623+00:00, run_end_date=2024-06-27 03:18:07.548870+00:00, run_duration=7.273247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:17:00+00:00, data_interval_end=2024-06-27 03:18:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:18:07.561252680Z [2024-06-27T03:18:07.560+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:18:00+00:00, run_after=2024-06-27T03:19:00+00:00 2024-06-27T03:18:07.605309096Z [2024-06-27T03:18:07.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:17:00+00:00 exited with status success for try_number 1 2024-06-27T03:18:07.605978135Z [2024-06-27T03:18:07.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:17:00+00:00 exited with status success for try_number 1 2024-06-27T03:18:07.606177374Z [2024-06-27T03:18:07.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:17:00+00:00 exited with status success for try_number 1 2024-06-27T03:18:07.621223832Z [2024-06-27T03:18:07.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:17:00+00:00, map_index=-1, run_start_date=2024-06-27 03:18:03.587055+00:00, run_end_date=2024-06-27 03:18:06.269900+00:00, run_duration=2.682845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:18:00.374815+00:00, queued_by_job_id=2, pid=1246 2024-06-27T03:18:07.621948398Z [2024-06-27T03:18:07.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:17:00+00:00, map_index=-1, run_start_date=2024-06-27 03:18:04.522578+00:00, run_end_date=2024-06-27 03:18:06.306350+00:00, run_duration=1.783772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:18:00.374815+00:00, queued_by_job_id=2, pid=1303 2024-06-27T03:18:07.622833105Z [2024-06-27T03:18:07.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:17:00+00:00, map_index=-1, run_start_date=2024-06-27 03:18:03.988438+00:00, run_end_date=2024-06-27 03:18:06.383413+00:00, run_duration=2.394975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:18:00.374815+00:00, queued_by_job_id=2, pid=1265 2024-06-27T03:19:00.179587902Z [2024-06-27T03:19:00.179+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:19:00.190320374Z [2024-06-27T03:19:00.190+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:19:00.203634498Z [2024-06-27T03:19:00.203+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:19:00+00:00, run_after=2024-06-27T03:20:00+00:00 2024-06-27T03:19:00.239826655Z [2024-06-27T03:19:00.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:19:00+00:00, run_after=2024-06-27T03:20:00+00:00 2024-06-27T03:19:00.254211123Z [2024-06-27T03:19:00.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd to 2024-06-27T03:19:00+00:00, run_after=2024-06-27T03:20:00+00:00 2024-06-27T03:19:00.351106201Z [2024-06-27T03:19:00.350+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T03:19:00.351141539Z 2024-06-27T03:19:00.351146731Z 2024-06-27T03:19:00.351152270Z 2024-06-27T03:19:00.351157432Z 2024-06-27T03:19:00.351161726Z 2024-06-27T03:19:00.351386174Z [2024-06-27T03:19:00.351+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:19:00.351731104Z [2024-06-27T03:19:00.351+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:19:00.351999532Z [2024-06-27T03:19:00.351+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:19:00.352265548Z [2024-06-27T03:19:00.352+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:19:00.352648845Z [2024-06-27T03:19:00.352+0000] {scheduler_job.py:425} INFO - DAG vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd has 0/16 running and queued tasks 2024-06-27T03:19:00.353829961Z [2024-06-27T03:19:00.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:19:00.353849206Z 2024-06-27T03:19:00.353854356Z 2024-06-27T03:19:00.353859066Z 2024-06-27T03:19:00.353863706Z 2024-06-27T03:19:00.353868641Z 2024-06-27T03:19:00.360642973Z [2024-06-27T03:19:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:19:00.361128487Z [2024-06-27T03:19:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:19:00.361703148Z [2024-06-27T03:19:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:19:00.361996019Z [2024-06-27T03:19:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:19:00.362429543Z [2024-06-27T03:19:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:19:00.362692017Z [2024-06-27T03:19:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:19:00.363168356Z [2024-06-27T03:19:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:19:00.363445702Z [2024-06-27T03:19:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:19:00.363745639Z [2024-06-27T03:19:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:19:00.363954562Z [2024-06-27T03:19:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:19:00.877004126Z [2024-06-27T03:19:00.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:18:00+00:00 exited with status queued for try_number 1 2024-06-27T03:19:00.877416174Z [2024-06-27T03:19:00.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:18:00+00:00 exited with status queued for try_number 1 2024-06-27T03:19:00.877699940Z [2024-06-27T03:19:00.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:18:00+00:00 exited with status queued for try_number 1 2024-06-27T03:19:00.877988710Z [2024-06-27T03:19:00.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:18:00+00:00 exited with status queued for try_number 1 2024-06-27T03:19:00.878285614Z [2024-06-27T03:19:00.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:18:00+00:00 exited with status queued for try_number 1 2024-06-27T03:19:00.892013363Z [2024-06-27T03:19:00.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to a47af8cb-bd78-4c9d-9cdb-f6967eabcfd4 2024-06-27T03:19:00.892335590Z [2024-06-27T03:19:00.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f8603d8-94dd-41d5-9f1d-4617997aec9f 2024-06-27T03:19:00.892576194Z [2024-06-27T03:19:00.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to 564613fc-5892-4bb7-88ba-5d393ffe2fdd 2024-06-27T03:19:00.892815484Z [2024-06-27T03:19:00.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35e3f913-c958-4714-a910-f29fb26b1414 2024-06-27T03:19:00.893068549Z [2024-06-27T03:19:00.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80cdfb0a-388b-4d6f-8ee5-39d1533239a6 2024-06-27T03:19:02.860457988Z [2024-06-27T03:19:02.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:19:02.860850473Z [2024-06-27T03:19:02.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:18:00+00:00, run_id=scheduled__2024-06-27T03:18:00+00:00, run_start_date=2024-06-27 03:19:00.266572+00:00, run_end_date=2024-06-27 03:19:02.860432+00:00, run_duration=2.59386, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:18:00+00:00, data_interval_end=2024-06-27 03:19:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:19:02.882017063Z [2024-06-27T03:19:02.881+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:19:00+00:00, run_after=2024-06-27T03:20:00+00:00 2024-06-27T03:19:02.948786934Z [2024-06-27T03:19:02.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:18:00+00:00 exited with status success for try_number 1 2024-06-27T03:19:02.948858617Z [2024-06-27T03:19:02.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:18:00+00:00 exited with status failed for try_number 1 2024-06-27T03:19:02.960435287Z [2024-06-27T03:19:02.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:18:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:19:00.355344+00:00, queued_by_job_id=2, pid=None 2024-06-27T03:19:02.961187723Z [2024-06-27T03:19:02.960+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:19:02.965006344Z [2024-06-27T03:19:02.964+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:19:02.981064540Z [2024-06-27T03:19:02.980+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240627T031800, start_date=, end_date=20240627T031902 2024-06-27T03:19:02.994563602Z [2024-06-27T03:19:02.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:18:00+00:00, map_index=-1, run_start_date=2024-06-27 03:19:01.518846+00:00, run_end_date=2024-06-27 03:19:02.063476+00:00, run_duration=0.54463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:19:00.355344+00:00, queued_by_job_id=2, pid=1340 2024-06-27T03:19:04.149921083Z [2024-06-27T03:19:04.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:18:00+00:00 exited with status failed for try_number 1 2024-06-27T03:19:04.156925836Z [2024-06-27T03:19:04.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:18:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:19:00.355344+00:00, queued_by_job_id=2, pid=None 2024-06-27T03:19:04.157416424Z [2024-06-27T03:19:04.157+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:19:04.159885834Z [2024-06-27T03:19:04.159+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:19:04.174863571Z [2024-06-27T03:19:04.174+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_55e0cf51-5f3a-43fa-b4b2-c6c97d50d2cd, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240627T031800, start_date=, end_date=20240627T031904 2024-06-27T03:19:05.965401944Z [2024-06-27T03:19:05.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:19:05.965877450Z [2024-06-27T03:19:05.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:18:00+00:00, run_id=scheduled__2024-06-27T03:18:00+00:00, run_start_date=2024-06-27 03:19:00.267918+00:00, run_end_date=2024-06-27 03:19:05.965332+00:00, run_duration=5.697414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:18:00+00:00, data_interval_end=2024-06-27 03:19:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:19:05.982516820Z [2024-06-27T03:19:05.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:19:00+00:00, run_after=2024-06-27T03:20:00+00:00 2024-06-27T03:19:05.994005822Z [2024-06-27T03:19:05.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:19:05.994031558Z [2024-06-27T03:19:05.993+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:18:00+00:00, run_id=scheduled__2024-06-27T03:18:00+00:00, run_start_date=2024-06-27 03:19:00.272621+00:00, run_end_date=2024-06-27 03:19:05.993244+00:00, run_duration=5.720623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:18:00+00:00, data_interval_end=2024-06-27 03:19:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:19:06.008118368Z [2024-06-27T03:19:06.007+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:19:00+00:00, run_after=2024-06-27T03:20:00+00:00 2024-06-27T03:19:06.084318429Z [2024-06-27T03:19:06.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:18:00+00:00 exited with status success for try_number 1 2024-06-27T03:19:06.084403926Z [2024-06-27T03:19:06.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:18:00+00:00 exited with status success for try_number 1 2024-06-27T03:19:06.095623786Z [2024-06-27T03:19:06.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:18:00+00:00, map_index=-1, run_start_date=2024-06-27 03:19:03.069178+00:00, run_end_date=2024-06-27 03:19:05.260537+00:00, run_duration=2.191359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:19:00.355344+00:00, queued_by_job_id=2, pid=1391 2024-06-27T03:19:06.096012081Z [2024-06-27T03:19:06.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:18:00+00:00, map_index=-1, run_start_date=2024-06-27 03:19:02.716143+00:00, run_end_date=2024-06-27 03:19:05.849275+00:00, run_duration=3.133132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:19:00.355344+00:00, queued_by_job_id=2, pid=1381 2024-06-27T03:20:00.127155180Z [2024-06-27T03:20:00.126+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:20:00+00:00, run_after=2024-06-27T03:21:00+00:00 2024-06-27T03:20:00.145264452Z [2024-06-27T03:20:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:20:00+00:00, run_after=2024-06-27T03:21:00+00:00 2024-06-27T03:20:00.158288326Z [2024-06-27T03:20:00.157+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:20:00+00:00, run_after=2024-06-27T03:25:00+00:00 2024-06-27T03:20:00.166739331Z [2024-06-27T03:20:00.166+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:20:00.173019498Z [2024-06-27T03:20:00.172+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:20:00.268443334Z [2024-06-27T03:20:00.268+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T03:20:00.268470702Z 2024-06-27T03:20:00.268474508Z 2024-06-27T03:20:00.268478381Z 2024-06-27T03:20:00.268481849Z 2024-06-27T03:20:00.268484956Z 2024-06-27T03:20:00.268524405Z [2024-06-27T03:20:00.268+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:20:00.268682831Z [2024-06-27T03:20:00.268+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:20:00.268812490Z [2024-06-27T03:20:00.268+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:20:00.268951873Z [2024-06-27T03:20:00.268+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:20:00.269071043Z [2024-06-27T03:20:00.268+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:20:00.269767485Z [2024-06-27T03:20:00.269+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:20:00.269779675Z 2024-06-27T03:20:00.269783921Z 2024-06-27T03:20:00.269787362Z 2024-06-27T03:20:00.269790608Z 2024-06-27T03:20:00.269793843Z 2024-06-27T03:20:00.273840524Z [2024-06-27T03:20:00.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T03:20:00.274017398Z [2024-06-27T03:20:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:20:00.274295676Z [2024-06-27T03:20:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:20:00.274436255Z [2024-06-27T03:20:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:20:00.274651262Z [2024-06-27T03:20:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:20:00.274788758Z [2024-06-27T03:20:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:20:00.275059739Z [2024-06-27T03:20:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:20:00.275166239Z [2024-06-27T03:20:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:20:00.275478090Z [2024-06-27T03:20:00.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:20:00.275662941Z [2024-06-27T03:20:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:20:00.673459958Z [2024-06-27T03:20:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status queued for try_number 1 2024-06-27T03:20:00.673835028Z [2024-06-27T03:20:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:18:00+00:00 exited with status queued for try_number 1 2024-06-27T03:20:00.674114245Z [2024-06-27T03:20:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:19:00+00:00 exited with status queued for try_number 1 2024-06-27T03:20:00.674402954Z [2024-06-27T03:20:00.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:19:00+00:00 exited with status queued for try_number 1 2024-06-27T03:20:00.674687862Z [2024-06-27T03:20:00.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:19:00+00:00 exited with status queued for try_number 1 2024-06-27T03:20:00.687765943Z [2024-06-27T03:20:00.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to a851bd9f-69a3-4f2d-b028-fdbcc2d3e60d 2024-06-27T03:20:00.688175946Z [2024-06-27T03:20:00.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to 971b7777-d750-496d-937e-db8295912584 2024-06-27T03:20:00.688542367Z [2024-06-27T03:20:00.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfe3334a-6e08-4ea9-950b-f2baad00fcd4 2024-06-27T03:20:00.688848891Z [2024-06-27T03:20:00.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9518f018-cd58-4efe-bcbc-f1e7440f53c0 2024-06-27T03:20:00.689375478Z [2024-06-27T03:20:00.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to 401b9e3d-6d0b-4412-bf3d-406b67b7e6c5 2024-06-27T03:20:02.127827749Z [2024-06-27T03:20:02.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:20:02.128187836Z [2024-06-27T03:20:02.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:18:00+00:00, run_id=scheduled__2024-06-27T03:18:00+00:00, run_start_date=2024-06-27 03:20:00.189857+00:00, run_end_date=2024-06-27 03:20:02.127830+00:00, run_duration=1.937973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:18:00+00:00, data_interval_end=2024-06-27 03:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:20:02.147335359Z [2024-06-27T03:20:02.147+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:20:00+00:00, run_after=2024-06-27T03:22:00+00:00 2024-06-27T03:20:02.224548536Z [2024-06-27T03:20:02.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:18:00+00:00 exited with status success for try_number 1 2024-06-27T03:20:02.232218919Z [2024-06-27T03:20:02.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:18:00+00:00, map_index=-1, run_start_date=2024-06-27 03:20:01.394121+00:00, run_end_date=2024-06-27 03:20:01.908724+00:00, run_duration=0.514603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:20:00.270733+00:00, queued_by_job_id=2, pid=1446 2024-06-27T03:20:03.293048509Z [2024-06-27T03:20:03.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:20:03.293337929Z [2024-06-27T03:20:03.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:19:00+00:00, run_id=scheduled__2024-06-27T03:19:00+00:00, run_start_date=2024-06-27 03:20:00.191104+00:00, run_end_date=2024-06-27 03:20:03.292951+00:00, run_duration=3.101847, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:19:00+00:00, data_interval_end=2024-06-27 03:20:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:20:03.306660922Z [2024-06-27T03:20:03.306+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:20:00+00:00, run_after=2024-06-27T03:21:00+00:00 2024-06-27T03:20:03.392958366Z [2024-06-27T03:20:03.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:19:00+00:00 exited with status success for try_number 1 2024-06-27T03:20:03.392988140Z [2024-06-27T03:20:03.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:19:00+00:00, map_index=-1, run_start_date=2024-06-27 03:20:01.766440+00:00, run_end_date=2024-06-27 03:20:02.370665+00:00, run_duration=0.604225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:20:00.270733+00:00, queued_by_job_id=2, pid=1459 2024-06-27T03:20:03.722487899Z [2024-06-27T03:20:03.722+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T03:20:04.775096370Z [2024-06-27T03:20:04.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:20:04.775553275Z [2024-06-27T03:20:04.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:19:00+00:00, run_id=scheduled__2024-06-27T03:19:00+00:00, run_start_date=2024-06-27 03:20:00.192213+00:00, run_end_date=2024-06-27 03:20:04.774983+00:00, run_duration=4.58277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:19:00+00:00, data_interval_end=2024-06-27 03:20:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:20:04.784445028Z [2024-06-27T03:20:04.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:20:00+00:00, run_after=2024-06-27T03:21:00+00:00 2024-06-27T03:20:04.832958360Z [2024-06-27T03:20:04.832+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:20:04.832992234Z 2024-06-27T03:20:04.833009680Z [2024-06-27T03:20:04.832+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:20:04.833794021Z [2024-06-27T03:20:04.833+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:20:04.833813961Z 2024-06-27T03:20:04.836562806Z [2024-06-27T03:20:04.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:20:04.836617395Z [2024-06-27T03:20:04.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:20:04.903942506Z [2024-06-27T03:20:04.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status queued for try_number 1 2024-06-27T03:20:04.904226174Z [2024-06-27T03:20:04.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status success for try_number 1 2024-06-27T03:20:04.904579776Z [2024-06-27T03:20:04.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:19:00+00:00 exited with status success for try_number 1 2024-06-27T03:20:04.921507308Z [2024-06-27T03:20:04.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:19:00+00:00, map_index=-1, run_start_date=2024-06-27 03:20:03.108027+00:00, run_end_date=2024-06-27 03:20:04.649331+00:00, run_duration=1.541304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:20:00.270733+00:00, queued_by_job_id=2, pid=1506 2024-06-27T03:20:04.924684993Z [2024-06-27T03:20:04.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:15:00+00:00, map_index=-1, run_start_date=2024-06-27 03:20:03.243256+00:00, run_end_date=2024-06-27 03:20:03.780172+00:00, run_duration=0.536916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:20:00.270733+00:00, queued_by_job_id=2, pid=1516 2024-06-27T03:20:04.924991615Z [2024-06-27T03:20:04.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfbabea2-2de1-474b-b17c-047937a95124 2024-06-27T03:20:04.986581007Z [2024-06-27T03:20:04.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:20:04.987288927Z [2024-06-27T03:20:04.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:19:00+00:00, run_id=scheduled__2024-06-27T03:19:00+00:00, run_start_date=2024-06-27 03:20:00.193436+00:00, run_end_date=2024-06-27 03:20:04.986869+00:00, run_duration=4.793433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:19:00+00:00, data_interval_end=2024-06-27 03:20:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:20:05.000459019Z [2024-06-27T03:20:05.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:20:00+00:00, run_after=2024-06-27T03:21:00+00:00 2024-06-27T03:20:05.436440654Z [2024-06-27T03:20:05.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:19:00+00:00 exited with status success for try_number 1 2024-06-27T03:20:05.446859752Z [2024-06-27T03:20:05.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:19:00+00:00, map_index=-1, run_start_date=2024-06-27 03:20:02.720939+00:00, run_end_date=2024-06-27 03:20:04.904097+00:00, run_duration=2.183158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:20:00.270733+00:00, queued_by_job_id=2, pid=1496 2024-06-27T03:20:08.312035764Z [2024-06-27T03:20:08.309+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:20:08.312073872Z 2024-06-27T03:20:08.312524616Z [2024-06-27T03:20:08.312+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:20:08.313841303Z [2024-06-27T03:20:08.313+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:20:08.313858643Z 2024-06-27T03:20:08.318130504Z [2024-06-27T03:20:08.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T03:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T03:20:08.318571106Z [2024-06-27T03:20:08.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T03:20:08.420683763Z [2024-06-27T03:20:08.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status queued for try_number 1 2024-06-27T03:20:08.421581267Z [2024-06-27T03:20:08.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status success for try_number 1 2024-06-27T03:20:08.434636809Z [2024-06-27T03:20:08.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9e9175b-1b0f-45e4-bda0-ac7168d2ba25 2024-06-27T03:20:08.435082329Z [2024-06-27T03:20:08.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T03:15:00+00:00, map_index=-1, run_start_date=2024-06-27 03:20:06.790079+00:00, run_end_date=2024-06-27 03:20:07.187753+00:00, run_duration=0.397674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:20:04.834116+00:00, queued_by_job_id=2, pid=1546 2024-06-27T03:20:13.441179247Z [2024-06-27T03:20:13.440+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:20:13.441225408Z 2024-06-27T03:20:13.441613231Z [2024-06-27T03:20:13.441+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:20:13.443325756Z [2024-06-27T03:20:13.442+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:20:13.443342647Z 2024-06-27T03:20:13.449993991Z [2024-06-27T03:20:13.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:20:13.450602563Z [2024-06-27T03:20:13.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:20:13.527140641Z [2024-06-27T03:20:13.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status queued for try_number 1 2024-06-27T03:20:13.527185188Z [2024-06-27T03:20:13.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status success for try_number 1 2024-06-27T03:20:13.535290468Z [2024-06-27T03:20:13.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T03:15:00+00:00, map_index=0, run_start_date=2024-06-27 03:20:10.385634+00:00, run_end_date=2024-06-27 03:20:12.343859+00:00, run_duration=1.958225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:20:08.314928+00:00, queued_by_job_id=2, pid=1558 2024-06-27T03:20:13.535742259Z [2024-06-27T03:20:13.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb94d4ba-9e65-4ec7-a85b-116770f7702a 2024-06-27T03:20:15.739730287Z [2024-06-27T03:20:15.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:20:15.739957328Z [2024-06-27T03:20:15.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:15:00+00:00, run_id=scheduled__2024-06-27T03:15:00+00:00, run_start_date=2024-06-27 03:20:00.185777+00:00, run_end_date=2024-06-27 03:20:15.739557+00:00, run_duration=15.55378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:15:00+00:00, data_interval_end=2024-06-27 03:20:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T03:20:15.753538214Z [2024-06-27T03:20:15.752+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:20:00+00:00, run_after=2024-06-27T03:25:00+00:00 2024-06-27T03:20:16.890713079Z [2024-06-27T03:20:16.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:15:00+00:00 exited with status success for try_number 1 2024-06-27T03:20:16.898895121Z [2024-06-27T03:20:16.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T03:15:00+00:00, map_index=-1, run_start_date=2024-06-27 03:20:15.321449+00:00, run_end_date=2024-06-27 03:20:15.701548+00:00, run_duration=0.380099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:20:13.445087+00:00, queued_by_job_id=2, pid=1579 2024-06-27T03:21:00.064808741Z [2024-06-27T03:21:00.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:21:00+00:00, run_after=2024-06-27T03:22:00+00:00 2024-06-27T03:21:00.089381197Z [2024-06-27T03:21:00.089+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:21:00+00:00, run_after=2024-06-27T03:22:00+00:00 2024-06-27T03:21:00.098662568Z [2024-06-27T03:21:00.098+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:21:00.166738002Z [2024-06-27T03:21:00.166+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:21:00.166764691Z 2024-06-27T03:21:00.166768481Z 2024-06-27T03:21:00.166771630Z 2024-06-27T03:21:00.167093377Z [2024-06-27T03:21:00.166+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:21:00.167308058Z [2024-06-27T03:21:00.167+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:21:00.167508359Z [2024-06-27T03:21:00.167+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:21:00.169013459Z [2024-06-27T03:21:00.168+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:21:00.169029094Z 2024-06-27T03:21:00.169032500Z 2024-06-27T03:21:00.169035963Z 2024-06-27T03:21:00.173432802Z [2024-06-27T03:21:00.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:21:00.173501984Z [2024-06-27T03:21:00.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:21:00.173945768Z [2024-06-27T03:21:00.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:21:00.173967506Z [2024-06-27T03:21:00.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:21:00.174172965Z [2024-06-27T03:21:00.174+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:21:00.174240206Z [2024-06-27T03:21:00.174+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:21:00.389406803Z [2024-06-27T03:21:00.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status queued for try_number 1 2024-06-27T03:21:00.389469908Z [2024-06-27T03:21:00.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status queued for try_number 1 2024-06-27T03:21:00.389559102Z [2024-06-27T03:21:00.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status queued for try_number 1 2024-06-27T03:21:00.396860812Z [2024-06-27T03:21:00.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3aa5de96-0e8e-4be7-911a-df9741384c43 2024-06-27T03:21:00.396919237Z [2024-06-27T03:21:00.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc6a5bd7-d331-423b-a317-408ba6ce35e7 2024-06-27T03:21:00.397017300Z [2024-06-27T03:21:00.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b32c753-ff07-401c-a416-8d07545fbdff 2024-06-27T03:21:01.572568926Z [2024-06-27T03:21:01.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:21:01.573023833Z [2024-06-27T03:21:01.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:20:00+00:00, run_id=scheduled__2024-06-27T03:20:00+00:00, run_start_date=2024-06-27 03:21:00.109264+00:00, run_end_date=2024-06-27 03:21:01.572463+00:00, run_duration=1.463199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:20:00+00:00, data_interval_end=2024-06-27 03:21:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:21:01.589221084Z [2024-06-27T03:21:01.588+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:21:00+00:00, run_after=2024-06-27T03:22:00+00:00 2024-06-27T03:21:01.649617948Z [2024-06-27T03:21:01.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status success for try_number 1 2024-06-27T03:21:01.658878704Z [2024-06-27T03:21:01.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:20:00+00:00, map_index=-1, run_start_date=2024-06-27 03:21:00.983816+00:00, run_end_date=2024-06-27 03:21:01.426540+00:00, run_duration=0.442724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:21:00.170056+00:00, queued_by_job_id=2, pid=1605 2024-06-27T03:21:04.148408238Z [2024-06-27T03:21:04.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:21:04.150088021Z [2024-06-27T03:21:04.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:20:00+00:00, run_id=scheduled__2024-06-27T03:20:00+00:00, run_start_date=2024-06-27 03:21:00.110597+00:00, run_end_date=2024-06-27 03:21:04.148242+00:00, run_duration=4.037645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:20:00+00:00, data_interval_end=2024-06-27 03:21:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:21:04.165725328Z [2024-06-27T03:21:04.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:21:00+00:00, run_after=2024-06-27T03:22:00+00:00 2024-06-27T03:21:04.172852642Z [2024-06-27T03:21:04.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:21:04.173061316Z [2024-06-27T03:21:04.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:20:00+00:00, run_id=scheduled__2024-06-27T03:20:00+00:00, run_start_date=2024-06-27 03:21:00.111619+00:00, run_end_date=2024-06-27 03:21:04.172722+00:00, run_duration=4.061103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:20:00+00:00, data_interval_end=2024-06-27 03:21:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:21:04.183125971Z [2024-06-27T03:21:04.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:21:00+00:00, run_after=2024-06-27T03:22:00+00:00 2024-06-27T03:21:04.224441738Z [2024-06-27T03:21:04.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status success for try_number 1 2024-06-27T03:21:04.224818506Z [2024-06-27T03:21:04.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status success for try_number 1 2024-06-27T03:21:04.232644480Z [2024-06-27T03:21:04.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:20:00+00:00, map_index=-1, run_start_date=2024-06-27 03:21:02.225082+00:00, run_end_date=2024-06-27 03:21:03.568987+00:00, run_duration=1.343905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:21:00.170056+00:00, queued_by_job_id=2, pid=1635 2024-06-27T03:21:04.233073885Z [2024-06-27T03:21:04.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:20:00+00:00, map_index=-1, run_start_date=2024-06-27 03:21:02.346469+00:00, run_end_date=2024-06-27 03:21:03.999572+00:00, run_duration=1.653103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:21:00.170056+00:00, queued_by_job_id=2, pid=1636 2024-06-27T03:22:00.201319046Z [2024-06-27T03:22:00.200+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:22:00+00:00, run_after=2024-06-27T03:23:00+00:00 2024-06-27T03:22:00.214822435Z [2024-06-27T03:22:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:22:00+00:00, run_after=2024-06-27T03:23:00+00:00 2024-06-27T03:22:00.222674226Z [2024-06-27T03:22:00.222+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:22:00.229939794Z [2024-06-27T03:22:00.229+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:22:00.306289374Z [2024-06-27T03:22:00.305+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:22:00.306311633Z 2024-06-27T03:22:00.306315784Z 2024-06-27T03:22:00.306318944Z 2024-06-27T03:22:00.306321940Z 2024-06-27T03:22:00.307834410Z [2024-06-27T03:22:00.306+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:22:00.308064791Z [2024-06-27T03:22:00.307+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:22:00.308249507Z [2024-06-27T03:22:00.308+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:22:00.308418872Z [2024-06-27T03:22:00.308+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:22:00.309190772Z [2024-06-27T03:22:00.308+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:22:00.309203262Z 2024-06-27T03:22:00.309222944Z 2024-06-27T03:22:00.309226510Z 2024-06-27T03:22:00.309229593Z 2024-06-27T03:22:00.320469295Z [2024-06-27T03:22:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:22:00.320498389Z [2024-06-27T03:22:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:22:00.320503528Z [2024-06-27T03:22:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:22:00.320506783Z [2024-06-27T03:22:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:22:00.320510266Z [2024-06-27T03:22:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:22:00.320513353Z [2024-06-27T03:22:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:22:00.320516361Z [2024-06-27T03:22:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:22:00.320519464Z [2024-06-27T03:22:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:22:00.673889324Z [2024-06-27T03:22:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status queued for try_number 1 2024-06-27T03:22:00.676104835Z [2024-06-27T03:22:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:21:00+00:00 exited with status queued for try_number 1 2024-06-27T03:22:00.676214165Z [2024-06-27T03:22:00.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:21:00+00:00 exited with status queued for try_number 1 2024-06-27T03:22:00.676330377Z [2024-06-27T03:22:00.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:21:00+00:00 exited with status queued for try_number 1 2024-06-27T03:22:00.684730791Z [2024-06-27T03:22:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 801ce63f-ab61-4b15-b3d5-b7b35f232bc7 2024-06-27T03:22:00.684933245Z [2024-06-27T03:22:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e8ce4fc-e4f4-4697-9810-e5dee34f7e28 2024-06-27T03:22:00.685099144Z [2024-06-27T03:22:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 511b6b63-ff68-4fc6-a41f-5fb4ae9a8894 2024-06-27T03:22:00.685258894Z [2024-06-27T03:22:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cfca75f-d013-4d31-a0c1-09f405b6e30d 2024-06-27T03:22:03.006251491Z [2024-06-27T03:22:03.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:22:03.006456704Z [2024-06-27T03:22:03.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:20:00+00:00, run_id=scheduled__2024-06-27T03:20:00+00:00, run_start_date=2024-06-27 03:22:00.240631+00:00, run_end_date=2024-06-27 03:22:03.006020+00:00, run_duration=2.765389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:20:00+00:00, data_interval_end=2024-06-27 03:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:22:03.017301804Z [2024-06-27T03:22:03.016+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:22:00+00:00, run_after=2024-06-27T03:24:00+00:00 2024-06-27T03:22:03.026389970Z [2024-06-27T03:22:03.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:22:03.026706762Z [2024-06-27T03:22:03.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:21:00+00:00, run_id=scheduled__2024-06-27T03:21:00+00:00, run_start_date=2024-06-27 03:22:00.242137+00:00, run_end_date=2024-06-27 03:22:03.026285+00:00, run_duration=2.784148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:21:00+00:00, data_interval_end=2024-06-27 03:22:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:22:03.037737871Z [2024-06-27T03:22:03.037+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:22:00+00:00, run_after=2024-06-27T03:23:00+00:00 2024-06-27T03:22:03.099354829Z [2024-06-27T03:22:03.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status success for try_number 1 2024-06-27T03:22:03.099567203Z [2024-06-27T03:22:03.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:21:00+00:00 exited with status success for try_number 1 2024-06-27T03:22:03.110770628Z [2024-06-27T03:22:03.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:21:00+00:00, map_index=-1, run_start_date=2024-06-27 03:22:01.762976+00:00, run_end_date=2024-06-27 03:22:02.276380+00:00, run_duration=0.513404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:22:00.313855+00:00, queued_by_job_id=2, pid=1683 2024-06-27T03:22:03.111784943Z [2024-06-27T03:22:03.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:20:00+00:00, map_index=-1, run_start_date=2024-06-27 03:22:01.724895+00:00, run_end_date=2024-06-27 03:22:02.167496+00:00, run_duration=0.442601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:22:00.313855+00:00, queued_by_job_id=2, pid=1682 2024-06-27T03:22:05.317196179Z [2024-06-27T03:22:05.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:22:05.317826649Z [2024-06-27T03:22:05.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:21:00+00:00, run_id=scheduled__2024-06-27T03:21:00+00:00, run_start_date=2024-06-27 03:22:00.243213+00:00, run_end_date=2024-06-27 03:22:05.317230+00:00, run_duration=5.074017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:21:00+00:00, data_interval_end=2024-06-27 03:22:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:22:05.331254426Z [2024-06-27T03:22:05.330+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:22:00+00:00, run_after=2024-06-27T03:23:00+00:00 2024-06-27T03:22:05.400216831Z [2024-06-27T03:22:05.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:21:00+00:00 exited with status success for try_number 1 2024-06-27T03:22:05.407654096Z [2024-06-27T03:22:05.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:21:00+00:00, map_index=-1, run_start_date=2024-06-27 03:22:03.122493+00:00, run_end_date=2024-06-27 03:22:04.632491+00:00, run_duration=1.509998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:22:00.313855+00:00, queued_by_job_id=2, pid=1722 2024-06-27T03:22:05.577182275Z [2024-06-27T03:22:05.576+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:22:05.577671623Z [2024-06-27T03:22:05.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:21:00+00:00, run_id=scheduled__2024-06-27T03:21:00+00:00, run_start_date=2024-06-27 03:22:00.244310+00:00, run_end_date=2024-06-27 03:22:05.577287+00:00, run_duration=5.332977, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:21:00+00:00, data_interval_end=2024-06-27 03:22:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:22:05.588059490Z [2024-06-27T03:22:05.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:22:00+00:00, run_after=2024-06-27T03:23:00+00:00 2024-06-27T03:22:05.615257812Z [2024-06-27T03:22:05.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:21:00+00:00 exited with status success for try_number 1 2024-06-27T03:22:05.620353682Z [2024-06-27T03:22:05.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:21:00+00:00, map_index=-1, run_start_date=2024-06-27 03:22:03.129051+00:00, run_end_date=2024-06-27 03:22:05.377738+00:00, run_duration=2.248687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:22:00.313855+00:00, queued_by_job_id=2, pid=1723 2024-06-27T03:23:01.025672599Z [2024-06-27T03:23:01.025+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:23:01.043366272Z [2024-06-27T03:23:01.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:23:00+00:00, run_after=2024-06-27T03:24:00+00:00 2024-06-27T03:23:01.076539793Z [2024-06-27T03:23:01.076+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:23:00+00:00, run_after=2024-06-27T03:24:00+00:00 2024-06-27T03:23:01.225025584Z [2024-06-27T03:23:01.224+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:23:01.225063107Z 2024-06-27T03:23:01.225068107Z 2024-06-27T03:23:01.225072390Z 2024-06-27T03:23:01.225437000Z [2024-06-27T03:23:01.224+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:23:01.225821870Z [2024-06-27T03:23:01.225+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:23:01.226184621Z [2024-06-27T03:23:01.225+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:23:01.227349432Z [2024-06-27T03:23:01.227+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:23:01.227361002Z 2024-06-27T03:23:01.227364751Z 2024-06-27T03:23:01.227368148Z 2024-06-27T03:23:01.232219682Z [2024-06-27T03:23:01.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:23:01.233058082Z [2024-06-27T03:23:01.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:23:01.233602003Z [2024-06-27T03:23:01.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:23:01.234123591Z [2024-06-27T03:23:01.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:23:01.234610590Z [2024-06-27T03:23:01.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:23:01.235092880Z [2024-06-27T03:23:01.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:23:01.532378382Z [2024-06-27T03:23:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:22:00+00:00 exited with status queued for try_number 1 2024-06-27T03:23:01.532475239Z [2024-06-27T03:23:01.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:22:00+00:00 exited with status queued for try_number 1 2024-06-27T03:23:01.532662716Z [2024-06-27T03:23:01.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:22:00+00:00 exited with status queued for try_number 1 2024-06-27T03:23:01.540578443Z [2024-06-27T03:23:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 395cc917-4a5e-47c4-a327-f5a4e929e5e4 2024-06-27T03:23:01.540822269Z [2024-06-27T03:23:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0401f2f4-2fb4-4306-ad03-54b38ee2b934 2024-06-27T03:23:01.540975591Z [2024-06-27T03:23:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to bea69261-181c-48c7-a43b-6b8f96c78bc6 2024-06-27T03:23:02.739968436Z [2024-06-27T03:23:02.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:23:02.739997720Z [2024-06-27T03:23:02.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:22:00+00:00, run_id=scheduled__2024-06-27T03:22:00+00:00, run_start_date=2024-06-27 03:23:01.118198+00:00, run_end_date=2024-06-27 03:23:02.726850+00:00, run_duration=1.608652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:22:00+00:00, data_interval_end=2024-06-27 03:23:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:23:02.752891815Z [2024-06-27T03:23:02.747+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:23:00+00:00, run_after=2024-06-27T03:24:00+00:00 2024-06-27T03:23:03.798900770Z [2024-06-27T03:23:03.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:22:00+00:00 exited with status success for try_number 1 2024-06-27T03:23:03.805366705Z [2024-06-27T03:23:03.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:22:00+00:00, map_index=-1, run_start_date=2024-06-27 03:23:02.139056+00:00, run_end_date=2024-06-27 03:23:02.571300+00:00, run_duration=0.432244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:23:01.228298+00:00, queued_by_job_id=2, pid=1767 2024-06-27T03:23:05.046753502Z [2024-06-27T03:23:05.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:23:05.047079437Z [2024-06-27T03:23:05.046+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:22:00+00:00, run_id=scheduled__2024-06-27T03:22:00+00:00, run_start_date=2024-06-27 03:23:01.116258+00:00, run_end_date=2024-06-27 03:23:05.046640+00:00, run_duration=3.930382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:22:00+00:00, data_interval_end=2024-06-27 03:23:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:23:05.056814029Z [2024-06-27T03:23:05.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:23:00+00:00, run_after=2024-06-27T03:24:00+00:00 2024-06-27T03:23:05.100681418Z [2024-06-27T03:23:05.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:22:00+00:00 exited with status success for try_number 1 2024-06-27T03:23:05.105804773Z [2024-06-27T03:23:05.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:22:00+00:00, map_index=-1, run_start_date=2024-06-27 03:23:03.520632+00:00, run_end_date=2024-06-27 03:23:04.949679+00:00, run_duration=1.429047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:23:01.228298+00:00, queued_by_job_id=2, pid=1797 2024-06-27T03:23:06.808124023Z [2024-06-27T03:23:06.807+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:23:06.808629887Z [2024-06-27T03:23:06.808+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:22:00+00:00, run_id=scheduled__2024-06-27T03:22:00+00:00, run_start_date=2024-06-27 03:23:01.113674+00:00, run_end_date=2024-06-27 03:23:06.808230+00:00, run_duration=5.694556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:22:00+00:00, data_interval_end=2024-06-27 03:23:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:23:06.819347547Z [2024-06-27T03:23:06.818+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:23:00+00:00, run_after=2024-06-27T03:24:00+00:00 2024-06-27T03:23:06.863639384Z [2024-06-27T03:23:06.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:22:00+00:00 exited with status success for try_number 1 2024-06-27T03:23:06.872363946Z [2024-06-27T03:23:06.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:22:00+00:00, map_index=-1, run_start_date=2024-06-27 03:23:03.544071+00:00, run_end_date=2024-06-27 03:23:06.108620+00:00, run_duration=2.564549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:23:01.228298+00:00, queued_by_job_id=2, pid=1798 2024-06-27T03:24:00.222498302Z [2024-06-27T03:24:00.222+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:24:00.247900259Z [2024-06-27T03:24:00.247+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:24:00+00:00, run_after=2024-06-27T03:25:00+00:00 2024-06-27T03:24:00.258119185Z [2024-06-27T03:24:00.257+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:24:00.272571594Z [2024-06-27T03:24:00.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:24:00+00:00, run_after=2024-06-27T03:25:00+00:00 2024-06-27T03:24:00.362893070Z [2024-06-27T03:24:00.362+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:24:00.362920411Z 2024-06-27T03:24:00.362928449Z 2024-06-27T03:24:00.362931934Z 2024-06-27T03:24:00.362935282Z 2024-06-27T03:24:00.363151963Z [2024-06-27T03:24:00.362+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:24:00.363456231Z [2024-06-27T03:24:00.363+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:24:00.363601447Z [2024-06-27T03:24:00.363+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:24:00.363842749Z [2024-06-27T03:24:00.363+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:24:00.364497422Z [2024-06-27T03:24:00.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:24:00.364509079Z 2024-06-27T03:24:00.364513585Z 2024-06-27T03:24:00.364517020Z 2024-06-27T03:24:00.364520307Z 2024-06-27T03:24:00.368681339Z [2024-06-27T03:24:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:24:00.368975729Z [2024-06-27T03:24:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:24:00.369476590Z [2024-06-27T03:24:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:24:00.369700465Z [2024-06-27T03:24:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:24:00.370031081Z [2024-06-27T03:24:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:24:00.370160625Z [2024-06-27T03:24:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:24:00.370448138Z [2024-06-27T03:24:00.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:24:00.370575583Z [2024-06-27T03:24:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:24:00.732286989Z [2024-06-27T03:24:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:22:00+00:00 exited with status queued for try_number 1 2024-06-27T03:24:00.732541868Z [2024-06-27T03:24:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:23:00+00:00 exited with status queued for try_number 1 2024-06-27T03:24:00.732650033Z [2024-06-27T03:24:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:23:00+00:00 exited with status queued for try_number 1 2024-06-27T03:24:00.732779007Z [2024-06-27T03:24:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:23:00+00:00 exited with status queued for try_number 1 2024-06-27T03:24:00.743907289Z [2024-06-27T03:24:00.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5963ed0b-1532-4c31-82f9-66d04c289c03 2024-06-27T03:24:00.744212282Z [2024-06-27T03:24:00.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebf64ba6-f991-43a8-8efc-a66e7f439f91 2024-06-27T03:24:00.744375147Z [2024-06-27T03:24:00.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to fec1266b-77d3-4ebc-81c0-428c65575c22 2024-06-27T03:24:00.744527057Z [2024-06-27T03:24:00.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to d78396aa-bd88-4229-8eab-23ab38f5a886 2024-06-27T03:24:02.315251608Z [2024-06-27T03:24:02.314+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:24:02.315491983Z [2024-06-27T03:24:02.315+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:23:00+00:00, run_id=scheduled__2024-06-27T03:23:00+00:00, run_start_date=2024-06-27 03:24:00.290489+00:00, run_end_date=2024-06-27 03:24:02.315169+00:00, run_duration=2.02468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:23:00+00:00, data_interval_end=2024-06-27 03:24:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:24:02.327193566Z [2024-06-27T03:24:02.326+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:24:00+00:00, run_after=2024-06-27T03:25:00+00:00 2024-06-27T03:24:02.377581909Z [2024-06-27T03:24:02.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:23:00+00:00 exited with status success for try_number 1 2024-06-27T03:24:02.383174935Z [2024-06-27T03:24:02.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:23:00+00:00, map_index=-1, run_start_date=2024-06-27 03:24:01.597537+00:00, run_end_date=2024-06-27 03:24:02.125697+00:00, run_duration=0.52816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:24:00.365625+00:00, queued_by_job_id=2, pid=1843 2024-06-27T03:24:03.439899997Z [2024-06-27T03:24:03.439+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:24:03.440083811Z [2024-06-27T03:24:03.439+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:22:00+00:00, run_id=scheduled__2024-06-27T03:22:00+00:00, run_start_date=2024-06-27 03:24:00.288958+00:00, run_end_date=2024-06-27 03:24:03.439807+00:00, run_duration=3.150849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:22:00+00:00, data_interval_end=2024-06-27 03:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:24:03.448491059Z [2024-06-27T03:24:03.447+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:24:00+00:00, run_after=2024-06-27T03:26:00+00:00 2024-06-27T03:24:03.513991843Z [2024-06-27T03:24:03.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:22:00+00:00 exited with status success for try_number 1 2024-06-27T03:24:03.520669414Z [2024-06-27T03:24:03.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:22:00+00:00, map_index=-1, run_start_date=2024-06-27 03:24:01.723039+00:00, run_end_date=2024-06-27 03:24:02.311960+00:00, run_duration=0.588921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:24:00.365625+00:00, queued_by_job_id=2, pid=1844 2024-06-27T03:24:05.371356161Z [2024-06-27T03:24:05.370+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:24:05.371859959Z [2024-06-27T03:24:05.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:23:00+00:00, run_id=scheduled__2024-06-27T03:23:00+00:00, run_start_date=2024-06-27 03:24:00.291723+00:00, run_end_date=2024-06-27 03:24:05.371363+00:00, run_duration=5.07964, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:23:00+00:00, data_interval_end=2024-06-27 03:24:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:24:05.385485683Z [2024-06-27T03:24:05.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:24:00+00:00, run_after=2024-06-27T03:25:00+00:00 2024-06-27T03:24:05.394232984Z [2024-06-27T03:24:05.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:24:05.394483131Z [2024-06-27T03:24:05.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:23:00+00:00, run_id=scheduled__2024-06-27T03:23:00+00:00, run_start_date=2024-06-27 03:24:00.292720+00:00, run_end_date=2024-06-27 03:24:05.394167+00:00, run_duration=5.101447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:23:00+00:00, data_interval_end=2024-06-27 03:24:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:24:05.408582855Z [2024-06-27T03:24:05.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:24:00+00:00, run_after=2024-06-27T03:25:00+00:00 2024-06-27T03:24:05.447760140Z [2024-06-27T03:24:05.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:23:00+00:00 exited with status success for try_number 1 2024-06-27T03:24:05.447797443Z [2024-06-27T03:24:05.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:23:00+00:00 exited with status success for try_number 1 2024-06-27T03:24:05.458703951Z [2024-06-27T03:24:05.458+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:23:00+00:00, map_index=-1, run_start_date=2024-06-27 03:24:02.972117+00:00, run_end_date=2024-06-27 03:24:04.792621+00:00, run_duration=1.820504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:24:00.365625+00:00, queued_by_job_id=2, pid=1876 2024-06-27T03:24:05.459498533Z [2024-06-27T03:24:05.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:23:00+00:00, map_index=-1, run_start_date=2024-06-27 03:24:03.256245+00:00, run_end_date=2024-06-27 03:24:05.016869+00:00, run_duration=1.760624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:24:00.365625+00:00, queued_by_job_id=2, pid=1884 2024-06-27T03:25:00.328043532Z [2024-06-27T03:25:00.327+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:25:00.344076665Z [2024-06-27T03:25:00.343+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:25:00+00:00, run_after=2024-06-27T03:26:00+00:00 2024-06-27T03:25:00.360418829Z [2024-06-27T03:25:00.360+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:25:00+00:00, run_after=2024-06-27T03:26:00+00:00 2024-06-27T03:25:00.377846752Z [2024-06-27T03:25:00.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:25:00+00:00, run_after=2024-06-27T03:30:00+00:00 2024-06-27T03:25:00.487767822Z [2024-06-27T03:25:00.487+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:25:00.487813562Z 2024-06-27T03:25:00.487823887Z 2024-06-27T03:25:00.487832661Z 2024-06-27T03:25:00.487841089Z 2024-06-27T03:25:00.487850302Z [2024-06-27T03:25:00.487+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:25:00.487902360Z [2024-06-27T03:25:00.487+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:25:00.487911693Z [2024-06-27T03:25:00.487+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:25:00.487927721Z [2024-06-27T03:25:00.487+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:25:00.488980404Z [2024-06-27T03:25:00.488+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:25:00.489005183Z 2024-06-27T03:25:00.489014816Z 2024-06-27T03:25:00.489023186Z 2024-06-27T03:25:00.489031840Z 2024-06-27T03:25:00.493623591Z [2024-06-27T03:25:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T03:25:00.493661274Z [2024-06-27T03:25:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:25:00.493960660Z [2024-06-27T03:25:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:25:00.494076050Z [2024-06-27T03:25:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:25:00.494437689Z [2024-06-27T03:25:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:25:00.494564570Z [2024-06-27T03:25:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:25:00.494803511Z [2024-06-27T03:25:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:25:00.494874342Z [2024-06-27T03:25:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:25:00.763323492Z [2024-06-27T03:25:00.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status queued for try_number 1 2024-06-27T03:25:00.763537523Z [2024-06-27T03:25:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:24:00+00:00 exited with status queued for try_number 1 2024-06-27T03:25:00.763635126Z [2024-06-27T03:25:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:24:00+00:00 exited with status queued for try_number 1 2024-06-27T03:25:00.763830682Z [2024-06-27T03:25:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:24:00+00:00 exited with status queued for try_number 1 2024-06-27T03:25:00.771601810Z [2024-06-27T03:25:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4174fb24-4518-46cd-9821-974225595973 2024-06-27T03:25:00.771814540Z [2024-06-27T03:25:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to d093bc01-36bf-412a-ad33-f1fe80c28e33 2024-06-27T03:25:00.772045353Z [2024-06-27T03:25:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0eda5f06-0c84-4a39-ad56-b13d5bb41c3e 2024-06-27T03:25:00.772219281Z [2024-06-27T03:25:00.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4975b50-f288-496d-a863-13a805018681 2024-06-27T03:25:01.997475937Z [2024-06-27T03:25:01.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:25:01.997843632Z [2024-06-27T03:25:01.997+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:24:00+00:00, run_id=scheduled__2024-06-27T03:24:00+00:00, run_start_date=2024-06-27 03:25:00.391649+00:00, run_end_date=2024-06-27 03:25:01.997432+00:00, run_duration=1.605783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:24:00+00:00, data_interval_end=2024-06-27 03:25:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:25:02.016922473Z [2024-06-27T03:25:02.016+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:25:00+00:00, run_after=2024-06-27T03:26:00+00:00 2024-06-27T03:25:02.310793348Z [2024-06-27T03:25:02.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:24:00+00:00 exited with status success for try_number 1 2024-06-27T03:25:02.318797411Z [2024-06-27T03:25:02.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:24:00+00:00, map_index=-1, run_start_date=2024-06-27 03:25:01.427604+00:00, run_end_date=2024-06-27 03:25:01.929415+00:00, run_duration=0.501811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:25:00.490358+00:00, queued_by_job_id=2, pid=1930 2024-06-27T03:25:03.840579006Z [2024-06-27T03:25:03.840+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:25:03.840620976Z 2024-06-27T03:25:03.840625244Z [2024-06-27T03:25:03.840+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:25:03.841237286Z [2024-06-27T03:25:03.840+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:25:03.841253209Z 2024-06-27T03:25:03.844211308Z [2024-06-27T03:25:03.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:25:03.844292289Z [2024-06-27T03:25:03.844+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:25:03.899424130Z [2024-06-27T03:25:03.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status queued for try_number 1 2024-06-27T03:25:03.899513026Z [2024-06-27T03:25:03.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status success for try_number 1 2024-06-27T03:25:03.917176393Z [2024-06-27T03:25:03.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:20:00+00:00, map_index=-1, run_start_date=2024-06-27 03:25:02.944844+00:00, run_end_date=2024-06-27 03:25:03.435279+00:00, run_duration=0.490435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:25:00.490358+00:00, queued_by_job_id=2, pid=1970 2024-06-27T03:25:03.917666620Z [2024-06-27T03:25:03.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3332ae8a-5903-4888-8ef8-782ed0023d54 2024-06-27T03:25:03.931639144Z [2024-06-27T03:25:03.931+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T03:25:05.870286659Z [2024-06-27T03:25:05.869+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:25:05.871010152Z [2024-06-27T03:25:05.870+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:24:00+00:00, run_id=scheduled__2024-06-27T03:24:00+00:00, run_start_date=2024-06-27 03:25:00.390269+00:00, run_end_date=2024-06-27 03:25:05.870621+00:00, run_duration=5.480352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:24:00+00:00, data_interval_end=2024-06-27 03:25:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:25:05.890622366Z [2024-06-27T03:25:05.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:25:00+00:00, run_after=2024-06-27T03:26:00+00:00 2024-06-27T03:25:05.907180085Z [2024-06-27T03:25:05.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:25:05.908067266Z [2024-06-27T03:25:05.907+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:24:00+00:00, run_id=scheduled__2024-06-27T03:24:00+00:00, run_start_date=2024-06-27 03:25:00.392985+00:00, run_end_date=2024-06-27 03:25:05.907142+00:00, run_duration=5.514157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:24:00+00:00, data_interval_end=2024-06-27 03:25:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:25:05.930611014Z [2024-06-27T03:25:05.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:25:00+00:00, run_after=2024-06-27T03:26:00+00:00 2024-06-27T03:25:05.991961379Z [2024-06-27T03:25:05.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:24:00+00:00 exited with status success for try_number 1 2024-06-27T03:25:05.992478376Z [2024-06-27T03:25:05.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:24:00+00:00 exited with status success for try_number 1 2024-06-27T03:25:06.008174917Z [2024-06-27T03:25:06.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:24:00+00:00, map_index=-1, run_start_date=2024-06-27 03:25:03.157732+00:00, run_end_date=2024-06-27 03:25:05.076630+00:00, run_duration=1.918898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:25:00.490358+00:00, queued_by_job_id=2, pid=1971 2024-06-27T03:25:06.008786489Z [2024-06-27T03:25:06.008+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:24:00+00:00, map_index=-1, run_start_date=2024-06-27 03:25:03.158065+00:00, run_end_date=2024-06-27 03:25:05.572073+00:00, run_duration=2.414008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:25:00.490358+00:00, queued_by_job_id=2, pid=1972 2024-06-27T03:25:07.106063663Z [2024-06-27T03:25:07.105+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:25:07.106101384Z 2024-06-27T03:25:07.106538414Z [2024-06-27T03:25:07.106+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:25:07.107666441Z [2024-06-27T03:25:07.107+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:25:07.107682362Z 2024-06-27T03:25:07.111562178Z [2024-06-27T03:25:07.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T03:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T03:25:07.112029321Z [2024-06-27T03:25:07.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T03:25:07.182103619Z [2024-06-27T03:25:07.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status queued for try_number 1 2024-06-27T03:25:07.182143112Z [2024-06-27T03:25:07.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status success for try_number 1 2024-06-27T03:25:07.188813901Z [2024-06-27T03:25:07.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to b09425f6-f935-41c1-b41d-116ba22c2c8b 2024-06-27T03:25:07.189068811Z [2024-06-27T03:25:07.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T03:20:00+00:00, map_index=-1, run_start_date=2024-06-27 03:25:05.745042+00:00, run_end_date=2024-06-27 03:25:06.131793+00:00, run_duration=0.386751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:25:03.841568+00:00, queued_by_job_id=2, pid=2011 2024-06-27T03:25:09.746169881Z [2024-06-27T03:25:09.745+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:25:09.746204363Z 2024-06-27T03:25:09.746212616Z [2024-06-27T03:25:09.746+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:25:09.750386078Z [2024-06-27T03:25:09.750+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:25:09.750425940Z 2024-06-27T03:25:09.757692440Z [2024-06-27T03:25:09.757+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:25:09.757748467Z [2024-06-27T03:25:09.757+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:25:09.889754228Z [2024-06-27T03:25:09.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status queued for try_number 1 2024-06-27T03:25:09.889775315Z [2024-06-27T03:25:09.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status success for try_number 1 2024-06-27T03:25:09.895331494Z [2024-06-27T03:25:09.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ed8b818-32d3-4a60-9139-530ea4d76515 2024-06-27T03:25:09.895459680Z [2024-06-27T03:25:09.895+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T03:20:00+00:00, map_index=0, run_start_date=2024-06-27 03:25:09.156133+00:00, run_end_date=2024-06-27 03:25:09.572360+00:00, run_duration=0.416227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:25:07.108272+00:00, queued_by_job_id=2, pid=2023 2024-06-27T03:25:12.465976998Z [2024-06-27T03:25:12.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:25:12.466574982Z [2024-06-27T03:25:12.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:20:00+00:00, run_id=scheduled__2024-06-27T03:20:00+00:00, run_start_date=2024-06-27 03:25:00.388259+00:00, run_end_date=2024-06-27 03:25:12.466063+00:00, run_duration=12.077804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:20:00+00:00, data_interval_end=2024-06-27 03:25:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T03:25:12.478975511Z [2024-06-27T03:25:12.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:25:00+00:00, run_after=2024-06-27T03:30:00+00:00 2024-06-27T03:25:12.528419533Z [2024-06-27T03:25:12.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:20:00+00:00 exited with status success for try_number 1 2024-06-27T03:25:12.538454183Z [2024-06-27T03:25:12.537+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T03:20:00+00:00, map_index=-1, run_start_date=2024-06-27 03:25:11.614829+00:00, run_end_date=2024-06-27 03:25:12.003218+00:00, run_duration=0.388389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:25:09.750766+00:00, queued_by_job_id=2, pid=2035 2024-06-27T03:26:00.385296931Z [2024-06-27T03:26:00.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:26:00+00:00, run_after=2024-06-27T03:27:00+00:00 2024-06-27T03:26:00.410253273Z [2024-06-27T03:26:00.409+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:26:00+00:00, run_after=2024-06-27T03:27:00+00:00 2024-06-27T03:26:00.427430898Z [2024-06-27T03:26:00.426+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:26:00.439277484Z [2024-06-27T03:26:00.438+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:26:00.563426187Z [2024-06-27T03:26:00.562+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:26:00.563469233Z 2024-06-27T03:26:00.563480207Z 2024-06-27T03:26:00.563488861Z 2024-06-27T03:26:00.563497265Z 2024-06-27T03:26:00.563624176Z [2024-06-27T03:26:00.563+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:26:00.563915357Z [2024-06-27T03:26:00.563+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:26:00.564206032Z [2024-06-27T03:26:00.563+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:26:00.564455832Z [2024-06-27T03:26:00.564+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:26:00.565400383Z [2024-06-27T03:26:00.565+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:26:00.565417993Z 2024-06-27T03:26:00.565436188Z 2024-06-27T03:26:00.565440527Z 2024-06-27T03:26:00.565444239Z 2024-06-27T03:26:00.570269878Z [2024-06-27T03:26:00.569+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:26:00.570451675Z [2024-06-27T03:26:00.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:26:00.571125555Z [2024-06-27T03:26:00.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:26:00.571350451Z [2024-06-27T03:26:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:26:00.571699937Z [2024-06-27T03:26:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:26:00.571948000Z [2024-06-27T03:26:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:26:00.572388801Z [2024-06-27T03:26:00.572+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:26:00.572641620Z [2024-06-27T03:26:00.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:26:00.971958889Z [2024-06-27T03:26:00.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:24:00+00:00 exited with status queued for try_number 1 2024-06-27T03:26:00.972210006Z [2024-06-27T03:26:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status queued for try_number 1 2024-06-27T03:26:00.972427277Z [2024-06-27T03:26:00.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status queued for try_number 1 2024-06-27T03:26:00.972616036Z [2024-06-27T03:26:00.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status queued for try_number 1 2024-06-27T03:26:00.994271417Z [2024-06-27T03:26:00.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd49c92d-4254-467d-bc7e-25006c0024b8 2024-06-27T03:26:00.996575349Z [2024-06-27T03:26:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to a48dfad5-6af3-41c2-9075-8b809587b194 2024-06-27T03:26:00.996990086Z [2024-06-27T03:26:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77dd02fe-7bfc-466a-aedb-60dc2a287344 2024-06-27T03:26:00.997328255Z [2024-06-27T03:26:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5971f159-5270-4047-841d-155510fefd5e 2024-06-27T03:26:02.254192300Z [2024-06-27T03:26:02.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:26:02.255183647Z [2024-06-27T03:26:02.254+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:24:00+00:00, run_id=scheduled__2024-06-27T03:24:00+00:00, run_start_date=2024-06-27 03:26:00.454553+00:00, run_end_date=2024-06-27 03:26:02.254539+00:00, run_duration=1.799986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:24:00+00:00, data_interval_end=2024-06-27 03:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:26:02.271837373Z [2024-06-27T03:26:02.271+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:26:00+00:00, run_after=2024-06-27T03:28:00+00:00 2024-06-27T03:26:02.340579722Z [2024-06-27T03:26:02.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:24:00+00:00 exited with status success for try_number 1 2024-06-27T03:26:02.340985485Z [2024-06-27T03:26:02.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status success for try_number 1 2024-06-27T03:26:02.350035138Z [2024-06-27T03:26:02.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:25:00+00:00, map_index=-1, run_start_date=2024-06-27 03:26:01.668720+00:00, run_end_date=2024-06-27 03:26:02.163564+00:00, run_duration=0.494844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:26:00.566370+00:00, queued_by_job_id=2, pid=2063 2024-06-27T03:26:02.350925017Z [2024-06-27T03:26:02.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:24:00+00:00, map_index=-1, run_start_date=2024-06-27 03:26:01.565181+00:00, run_end_date=2024-06-27 03:26:02.017859+00:00, run_duration=0.452678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:26:00.566370+00:00, queued_by_job_id=2, pid=2062 2024-06-27T03:26:03.339210553Z [2024-06-27T03:26:03.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:26:03.339641432Z [2024-06-27T03:26:03.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:25:00+00:00, run_id=scheduled__2024-06-27T03:25:00+00:00, run_start_date=2024-06-27 03:26:00.459673+00:00, run_end_date=2024-06-27 03:26:03.339147+00:00, run_duration=2.879474, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:25:00+00:00, data_interval_end=2024-06-27 03:26:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:26:03.354281248Z [2024-06-27T03:26:03.353+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:26:00+00:00, run_after=2024-06-27T03:27:00+00:00 2024-06-27T03:26:05.231228238Z [2024-06-27T03:26:05.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:26:05.231737373Z [2024-06-27T03:26:05.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:25:00+00:00, run_id=scheduled__2024-06-27T03:25:00+00:00, run_start_date=2024-06-27 03:26:00.457285+00:00, run_end_date=2024-06-27 03:26:05.231039+00:00, run_duration=4.773754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:25:00+00:00, data_interval_end=2024-06-27 03:26:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:26:05.247185277Z [2024-06-27T03:26:05.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:26:00+00:00, run_after=2024-06-27T03:27:00+00:00 2024-06-27T03:26:05.256007421Z [2024-06-27T03:26:05.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:26:05.256270568Z [2024-06-27T03:26:05.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:25:00+00:00, run_id=scheduled__2024-06-27T03:25:00+00:00, run_start_date=2024-06-27 03:26:00.461929+00:00, run_end_date=2024-06-27 03:26:05.255827+00:00, run_duration=4.793898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:25:00+00:00, data_interval_end=2024-06-27 03:26:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:26:05.266218318Z [2024-06-27T03:26:05.265+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:26:00+00:00, run_after=2024-06-27T03:27:00+00:00 2024-06-27T03:26:05.302412840Z [2024-06-27T03:26:05.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status success for try_number 1 2024-06-27T03:26:05.302897527Z [2024-06-27T03:26:05.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status success for try_number 1 2024-06-27T03:26:05.316008470Z [2024-06-27T03:26:05.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:25:00+00:00, map_index=-1, run_start_date=2024-06-27 03:26:03.072036+00:00, run_end_date=2024-06-27 03:26:04.622067+00:00, run_duration=1.550031, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:26:00.566370+00:00, queued_by_job_id=2, pid=2103 2024-06-27T03:26:05.316578575Z [2024-06-27T03:26:05.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:25:00+00:00, map_index=-1, run_start_date=2024-06-27 03:26:02.986441+00:00, run_end_date=2024-06-27 03:26:04.975783+00:00, run_duration=1.989342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:26:00.566370+00:00, queued_by_job_id=2, pid=2102 2024-06-27T03:27:00.303054215Z [2024-06-27T03:27:00.302+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:27:00.330441429Z [2024-06-27T03:27:00.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:27:00+00:00, run_after=2024-06-27T03:28:00+00:00 2024-06-27T03:27:00.356385517Z [2024-06-27T03:27:00.355+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:27:00+00:00, run_after=2024-06-27T03:28:00+00:00 2024-06-27T03:27:00.446139727Z [2024-06-27T03:27:00.445+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:27:00.446172941Z 2024-06-27T03:27:00.446179223Z 2024-06-27T03:27:00.446184025Z 2024-06-27T03:27:00.446254191Z [2024-06-27T03:27:00.446+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:27:00.446497493Z [2024-06-27T03:27:00.446+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:27:00.446647534Z [2024-06-27T03:27:00.446+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:27:00.447322044Z [2024-06-27T03:27:00.447+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:27:00.447336892Z 2024-06-27T03:27:00.447342610Z 2024-06-27T03:27:00.447347217Z 2024-06-27T03:27:00.450459784Z [2024-06-27T03:27:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:27:00.450606666Z [2024-06-27T03:27:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:27:00.451474593Z [2024-06-27T03:27:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:27:00.451488958Z [2024-06-27T03:27:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:27:00.451493909Z [2024-06-27T03:27:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:27:00.451520956Z [2024-06-27T03:27:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:27:00.703067736Z [2024-06-27T03:27:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:26:00+00:00 exited with status queued for try_number 1 2024-06-27T03:27:00.703645609Z [2024-06-27T03:27:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:26:00+00:00 exited with status queued for try_number 1 2024-06-27T03:27:00.703899156Z [2024-06-27T03:27:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:26:00+00:00 exited with status queued for try_number 1 2024-06-27T03:27:00.715361393Z [2024-06-27T03:27:00.714+0000] {scheduler_job.py:635} INFO - Setting external_id for to 028c379b-c050-4478-be8e-6dd1ae4e025e 2024-06-27T03:27:00.715555725Z [2024-06-27T03:27:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29fb7fe5-ef82-47aa-a77f-43304b11bcbc 2024-06-27T03:27:00.715827769Z [2024-06-27T03:27:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71c49787-7152-4226-82d9-8b6622e5cca0 2024-06-27T03:27:03.023594840Z [2024-06-27T03:27:03.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:27:03.023930555Z [2024-06-27T03:27:03.023+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:26:00+00:00, run_id=scheduled__2024-06-27T03:26:00+00:00, run_start_date=2024-06-27 03:27:00.376293+00:00, run_end_date=2024-06-27 03:27:03.023439+00:00, run_duration=2.647146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:26:00+00:00, data_interval_end=2024-06-27 03:27:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:27:03.037549160Z [2024-06-27T03:27:03.037+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:27:00+00:00, run_after=2024-06-27T03:28:00+00:00 2024-06-27T03:27:03.080268878Z [2024-06-27T03:27:03.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:26:00+00:00 exited with status success for try_number 1 2024-06-27T03:27:03.089066323Z [2024-06-27T03:27:03.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:26:00+00:00, map_index=-1, run_start_date=2024-06-27 03:27:01.515719+00:00, run_end_date=2024-06-27 03:27:01.884795+00:00, run_duration=0.369076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:27:00.448000+00:00, queued_by_job_id=2, pid=2147 2024-06-27T03:27:04.131778696Z [2024-06-27T03:27:04.131+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:27:04.132143035Z [2024-06-27T03:27:04.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:26:00+00:00, run_id=scheduled__2024-06-27T03:26:00+00:00, run_start_date=2024-06-27 03:27:00.374735+00:00, run_end_date=2024-06-27 03:27:04.131615+00:00, run_duration=3.75688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:26:00+00:00, data_interval_end=2024-06-27 03:27:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:27:04.150784056Z [2024-06-27T03:27:04.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:27:00+00:00, run_after=2024-06-27T03:28:00+00:00 2024-06-27T03:27:04.349372173Z [2024-06-27T03:27:04.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:26:00+00:00 exited with status success for try_number 1 2024-06-27T03:27:04.358574738Z [2024-06-27T03:27:04.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:26:00+00:00, map_index=-1, run_start_date=2024-06-27 03:27:02.525754+00:00, run_end_date=2024-06-27 03:27:04.076906+00:00, run_duration=1.551152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:27:00.448000+00:00, queued_by_job_id=2, pid=2178 2024-06-27T03:27:05.434176093Z [2024-06-27T03:27:05.433+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:27:05.434551364Z [2024-06-27T03:27:05.434+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:26:00+00:00, run_id=scheduled__2024-06-27T03:26:00+00:00, run_start_date=2024-06-27 03:27:00.373008+00:00, run_end_date=2024-06-27 03:27:05.434174+00:00, run_duration=5.061166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:26:00+00:00, data_interval_end=2024-06-27 03:27:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:27:05.452807420Z [2024-06-27T03:27:05.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:27:00+00:00, run_after=2024-06-27T03:28:00+00:00 2024-06-27T03:27:05.514426496Z [2024-06-27T03:27:05.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:26:00+00:00 exited with status success for try_number 1 2024-06-27T03:27:05.522198714Z [2024-06-27T03:27:05.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:26:00+00:00, map_index=-1, run_start_date=2024-06-27 03:27:02.413619+00:00, run_end_date=2024-06-27 03:27:04.850503+00:00, run_duration=2.436884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:27:00.448000+00:00, queued_by_job_id=2, pid=2177 2024-06-27T03:28:00.255506079Z [2024-06-27T03:28:00.254+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:28:00+00:00, run_after=2024-06-27T03:29:00+00:00 2024-06-27T03:28:00.265657639Z [2024-06-27T03:28:00.265+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:28:00.284741942Z [2024-06-27T03:28:00.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:28:00+00:00, run_after=2024-06-27T03:29:00+00:00 2024-06-27T03:28:00.295939994Z [2024-06-27T03:28:00.295+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:28:00.392589936Z [2024-06-27T03:28:00.392+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:28:00.392621709Z 2024-06-27T03:28:00.392628719Z 2024-06-27T03:28:00.392634368Z 2024-06-27T03:28:00.392639267Z 2024-06-27T03:28:00.392644288Z [2024-06-27T03:28:00.392+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:28:00.392658563Z [2024-06-27T03:28:00.392+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:28:00.392800296Z [2024-06-27T03:28:00.392+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:28:00.392857275Z [2024-06-27T03:28:00.392+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:28:00.393709409Z [2024-06-27T03:28:00.393+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:28:00.393727156Z 2024-06-27T03:28:00.393733224Z 2024-06-27T03:28:00.393737890Z 2024-06-27T03:28:00.393742849Z 2024-06-27T03:28:00.398381812Z [2024-06-27T03:28:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:28:00.398415868Z [2024-06-27T03:28:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:28:00.398661635Z [2024-06-27T03:28:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:28:00.398698626Z [2024-06-27T03:28:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:28:00.398925797Z [2024-06-27T03:28:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:28:00.398943444Z [2024-06-27T03:28:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:28:00.399176761Z [2024-06-27T03:28:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:28:00.399190620Z [2024-06-27T03:28:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:28:00.923824851Z [2024-06-27T03:28:00.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:26:00+00:00 exited with status queued for try_number 1 2024-06-27T03:28:00.924129116Z [2024-06-27T03:28:00.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:27:00+00:00 exited with status queued for try_number 1 2024-06-27T03:28:00.924239031Z [2024-06-27T03:28:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:27:00+00:00 exited with status queued for try_number 1 2024-06-27T03:28:00.924365916Z [2024-06-27T03:28:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:27:00+00:00 exited with status queued for try_number 1 2024-06-27T03:28:00.945593979Z [2024-06-27T03:28:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8039c3c5-3b9d-428e-adac-d7db32e91c04 2024-06-27T03:28:00.946067133Z [2024-06-27T03:28:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to de843b37-872d-44a8-8f34-1d2cc84c1164 2024-06-27T03:28:00.946392950Z [2024-06-27T03:28:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fa13d7b-9659-4273-afc2-e1bb6d95a2e7 2024-06-27T03:28:00.946571513Z [2024-06-27T03:28:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e456052-f87a-4f43-9888-367960d0b8f9 2024-06-27T03:28:02.244914922Z [2024-06-27T03:28:02.244+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:28:02.245160981Z [2024-06-27T03:28:02.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:26:00+00:00, run_id=scheduled__2024-06-27T03:26:00+00:00, run_start_date=2024-06-27 03:28:00.312283+00:00, run_end_date=2024-06-27 03:28:02.244845+00:00, run_duration=1.932562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:26:00+00:00, data_interval_end=2024-06-27 03:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:28:02.255661784Z [2024-06-27T03:28:02.255+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:28:00+00:00, run_after=2024-06-27T03:30:00+00:00 2024-06-27T03:28:02.264226769Z [2024-06-27T03:28:02.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:28:02.264584595Z [2024-06-27T03:28:02.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:27:00+00:00, run_id=scheduled__2024-06-27T03:27:00+00:00, run_start_date=2024-06-27 03:28:00.314310+00:00, run_end_date=2024-06-27 03:28:02.264142+00:00, run_duration=1.949832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:27:00+00:00, data_interval_end=2024-06-27 03:28:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:28:02.276790742Z [2024-06-27T03:28:02.276+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:28:00+00:00, run_after=2024-06-27T03:29:00+00:00 2024-06-27T03:28:02.339290416Z [2024-06-27T03:28:02.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:26:00+00:00 exited with status success for try_number 1 2024-06-27T03:28:02.339565056Z [2024-06-27T03:28:02.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:27:00+00:00 exited with status success for try_number 1 2024-06-27T03:28:02.348184767Z [2024-06-27T03:28:02.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:26:00+00:00, map_index=-1, run_start_date=2024-06-27 03:28:01.478292+00:00, run_end_date=2024-06-27 03:28:01.943888+00:00, run_duration=0.465596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:28:00.394750+00:00, queued_by_job_id=2, pid=2223 2024-06-27T03:28:02.348559879Z [2024-06-27T03:28:02.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:27:00+00:00, map_index=-1, run_start_date=2024-06-27 03:28:01.306389+00:00, run_end_date=2024-06-27 03:28:01.759625+00:00, run_duration=0.453236, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:28:00.394750+00:00, queued_by_job_id=2, pid=2222 2024-06-27T03:28:04.514193190Z [2024-06-27T03:28:04.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:28:04.514331202Z [2024-06-27T03:28:04.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:27:00+00:00, run_id=scheduled__2024-06-27T03:27:00+00:00, run_start_date=2024-06-27 03:28:00.317407+00:00, run_end_date=2024-06-27 03:28:04.514079+00:00, run_duration=4.196672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:27:00+00:00, data_interval_end=2024-06-27 03:28:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:28:04.522547162Z [2024-06-27T03:28:04.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:28:00+00:00, run_after=2024-06-27T03:29:00+00:00 2024-06-27T03:28:04.570409434Z [2024-06-27T03:28:04.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:27:00+00:00 exited with status success for try_number 1 2024-06-27T03:28:04.577018842Z [2024-06-27T03:28:04.576+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:27:00+00:00, map_index=-1, run_start_date=2024-06-27 03:28:02.622046+00:00, run_end_date=2024-06-27 03:28:04.246956+00:00, run_duration=1.62491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:28:00.394750+00:00, queued_by_job_id=2, pid=2262 2024-06-27T03:28:05.625944337Z [2024-06-27T03:28:05.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:28:05.626330982Z [2024-06-27T03:28:05.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:27:00+00:00, run_id=scheduled__2024-06-27T03:27:00+00:00, run_start_date=2024-06-27 03:28:00.315914+00:00, run_end_date=2024-06-27 03:28:05.625944+00:00, run_duration=5.31003, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:27:00+00:00, data_interval_end=2024-06-27 03:28:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:28:05.638574253Z [2024-06-27T03:28:05.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:28:00+00:00, run_after=2024-06-27T03:29:00+00:00 2024-06-27T03:28:05.679643914Z [2024-06-27T03:28:05.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:27:00+00:00 exited with status success for try_number 1 2024-06-27T03:28:05.686696012Z [2024-06-27T03:28:05.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:27:00+00:00, map_index=-1, run_start_date=2024-06-27 03:28:02.860886+00:00, run_end_date=2024-06-27 03:28:05.215380+00:00, run_duration=2.354494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:28:00.394750+00:00, queued_by_job_id=2, pid=2263 2024-06-27T03:29:00.997037682Z [2024-06-27T03:29:00.996+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:29:00+00:00, run_after=2024-06-27T03:30:00+00:00 2024-06-27T03:29:01.015845648Z [2024-06-27T03:29:01.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:29:00+00:00, run_after=2024-06-27T03:30:00+00:00 2024-06-27T03:29:01.024796994Z [2024-06-27T03:29:01.024+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:29:01.140655049Z [2024-06-27T03:29:01.137+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:29:01.140742926Z 2024-06-27T03:29:01.140763868Z 2024-06-27T03:29:01.140769315Z 2024-06-27T03:29:01.140775307Z [2024-06-27T03:29:01.137+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:29:01.140782185Z [2024-06-27T03:29:01.138+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:29:01.140787362Z [2024-06-27T03:29:01.138+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:29:01.147282392Z [2024-06-27T03:29:01.141+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:29:01.147307094Z 2024-06-27T03:29:01.147312249Z 2024-06-27T03:29:01.147320271Z 2024-06-27T03:29:01.147327370Z [2024-06-27T03:29:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:29:01.147334234Z [2024-06-27T03:29:01.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:29:01.148181496Z [2024-06-27T03:29:01.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:29:01.148346414Z [2024-06-27T03:29:01.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:29:01.148365048Z [2024-06-27T03:29:01.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:29:01.148851891Z [2024-06-27T03:29:01.148+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:29:01.527017683Z [2024-06-27T03:29:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:28:00+00:00 exited with status queued for try_number 1 2024-06-27T03:29:01.527181013Z [2024-06-27T03:29:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:28:00+00:00 exited with status queued for try_number 1 2024-06-27T03:29:01.527339581Z [2024-06-27T03:29:01.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:28:00+00:00 exited with status queued for try_number 1 2024-06-27T03:29:01.538032987Z [2024-06-27T03:29:01.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4585206c-e696-42ca-91c4-5cb069f0c774 2024-06-27T03:29:01.538288299Z [2024-06-27T03:29:01.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to b05ce00c-c073-44e0-adc8-683fa2fd5a4c 2024-06-27T03:29:01.538618820Z [2024-06-27T03:29:01.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57fe827a-a0c0-4009-b84f-4ced01e93758 2024-06-27T03:29:03.016179342Z [2024-06-27T03:29:03.015+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:29:03.016850493Z [2024-06-27T03:29:03.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:28:00+00:00, run_id=scheduled__2024-06-27T03:28:00+00:00, run_start_date=2024-06-27 03:29:01.035758+00:00, run_end_date=2024-06-27 03:29:03.016111+00:00, run_duration=1.980353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:28:00+00:00, data_interval_end=2024-06-27 03:29:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:29:03.032428900Z [2024-06-27T03:29:03.032+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:29:00+00:00, run_after=2024-06-27T03:30:00+00:00 2024-06-27T03:29:03.129751227Z [2024-06-27T03:29:03.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:28:00+00:00 exited with status success for try_number 1 2024-06-27T03:29:03.141152198Z [2024-06-27T03:29:03.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:28:00+00:00, map_index=-1, run_start_date=2024-06-27 03:29:02.050298+00:00, run_end_date=2024-06-27 03:29:02.454229+00:00, run_duration=0.403931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:29:01.143081+00:00, queued_by_job_id=2, pid=2307 2024-06-27T03:29:05.316599792Z [2024-06-27T03:29:05.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:29:05.317178625Z [2024-06-27T03:29:05.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:28:00+00:00, run_id=scheduled__2024-06-27T03:28:00+00:00, run_start_date=2024-06-27 03:29:01.037207+00:00, run_end_date=2024-06-27 03:29:05.316707+00:00, run_duration=4.2795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:28:00+00:00, data_interval_end=2024-06-27 03:29:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:29:05.341968531Z [2024-06-27T03:29:05.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:29:00+00:00, run_after=2024-06-27T03:30:00+00:00 2024-06-27T03:29:05.353662921Z [2024-06-27T03:29:05.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:29:05.354626203Z [2024-06-27T03:29:05.353+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:28:00+00:00, run_id=scheduled__2024-06-27T03:28:00+00:00, run_start_date=2024-06-27 03:29:01.038356+00:00, run_end_date=2024-06-27 03:29:05.353693+00:00, run_duration=4.315337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:28:00+00:00, data_interval_end=2024-06-27 03:29:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:29:05.378370625Z [2024-06-27T03:29:05.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:29:00+00:00, run_after=2024-06-27T03:30:00+00:00 2024-06-27T03:29:05.418651582Z [2024-06-27T03:29:05.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:28:00+00:00 exited with status success for try_number 1 2024-06-27T03:29:05.418944557Z [2024-06-27T03:29:05.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:28:00+00:00 exited with status success for try_number 1 2024-06-27T03:29:05.429852527Z [2024-06-27T03:29:05.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:28:00+00:00, map_index=-1, run_start_date=2024-06-27 03:29:03.255346+00:00, run_end_date=2024-06-27 03:29:04.634201+00:00, run_duration=1.378855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:29:01.143081+00:00, queued_by_job_id=2, pid=2338 2024-06-27T03:29:05.430171865Z [2024-06-27T03:29:05.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:28:00+00:00, map_index=-1, run_start_date=2024-06-27 03:29:03.211830+00:00, run_end_date=2024-06-27 03:29:05.116198+00:00, run_duration=1.904368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:29:01.143081+00:00, queued_by_job_id=2, pid=2337 2024-06-27T03:30:01.035123777Z [2024-06-27T03:30:01.034+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:30:00+00:00, run_after=2024-06-27T03:35:00+00:00 2024-06-27T03:30:01.061223590Z [2024-06-27T03:30:01.060+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:30:00+00:00, run_after=2024-06-27T03:31:00+00:00 2024-06-27T03:30:01.107098829Z [2024-06-27T03:30:01.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:30:00+00:00, run_after=2024-06-27T03:31:00+00:00 2024-06-27T03:30:01.127205896Z [2024-06-27T03:30:01.125+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:30:01.138969646Z [2024-06-27T03:30:01.138+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:30:01.248882789Z [2024-06-27T03:30:01.248+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T03:30:01.248923988Z 2024-06-27T03:30:01.248931012Z 2024-06-27T03:30:01.248937482Z 2024-06-27T03:30:01.248943129Z 2024-06-27T03:30:01.248964582Z 2024-06-27T03:30:01.249152563Z [2024-06-27T03:30:01.248+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:30:01.249467006Z [2024-06-27T03:30:01.249+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:30:01.249669073Z [2024-06-27T03:30:01.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:30:01.249876634Z [2024-06-27T03:30:01.249+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:30:01.250012269Z [2024-06-27T03:30:01.249+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:30:01.251251595Z [2024-06-27T03:30:01.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:30:01.251331010Z 2024-06-27T03:30:01.251339388Z 2024-06-27T03:30:01.251344405Z 2024-06-27T03:30:01.251348383Z 2024-06-27T03:30:01.251352288Z 2024-06-27T03:30:01.258381052Z [2024-06-27T03:30:01.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T03:30:01.258649461Z [2024-06-27T03:30:01.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:30:01.259044890Z [2024-06-27T03:30:01.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:30:01.259292511Z [2024-06-27T03:30:01.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:30:01.259626109Z [2024-06-27T03:30:01.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:30:01.259784792Z [2024-06-27T03:30:01.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:30:01.260082378Z [2024-06-27T03:30:01.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:30:01.260233038Z [2024-06-27T03:30:01.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:30:01.260520468Z [2024-06-27T03:30:01.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:30:01.260670117Z [2024-06-27T03:30:01.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:30:01.660238420Z [2024-06-27T03:30:01.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status queued for try_number 1 2024-06-27T03:30:01.660459752Z [2024-06-27T03:30:01.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:28:00+00:00 exited with status queued for try_number 1 2024-06-27T03:30:01.660639164Z [2024-06-27T03:30:01.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:29:00+00:00 exited with status queued for try_number 1 2024-06-27T03:30:01.660811219Z [2024-06-27T03:30:01.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:29:00+00:00 exited with status queued for try_number 1 2024-06-27T03:30:01.661027378Z [2024-06-27T03:30:01.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:29:00+00:00 exited with status queued for try_number 1 2024-06-27T03:30:01.678633105Z [2024-06-27T03:30:01.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0d43f31-f2e7-41ec-b91d-28a2d272ef73 2024-06-27T03:30:01.681234959Z [2024-06-27T03:30:01.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54e27d23-fe5b-4749-aa06-36ce49b516d9 2024-06-27T03:30:01.681569721Z [2024-06-27T03:30:01.681+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ac86f2c-1f6e-4136-ac55-ec4f2859a371 2024-06-27T03:30:01.681953029Z [2024-06-27T03:30:01.681+0000] {scheduler_job.py:635} INFO - Setting external_id for to 835f2519-bccb-4a0b-a6c5-b67f48fc037d 2024-06-27T03:30:01.682292537Z [2024-06-27T03:30:01.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to 362c9287-8290-436a-9687-11a2cd7fbfeb 2024-06-27T03:30:04.009254805Z [2024-06-27T03:30:04.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:30:04.009536053Z [2024-06-27T03:30:04.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:28:00+00:00, run_id=scheduled__2024-06-27T03:28:00+00:00, run_start_date=2024-06-27 03:30:01.151111+00:00, run_end_date=2024-06-27 03:30:04.009132+00:00, run_duration=2.858021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:28:00+00:00, data_interval_end=2024-06-27 03:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:30:04.017707905Z [2024-06-27T03:30:04.017+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:30:00+00:00, run_after=2024-06-27T03:32:00+00:00 2024-06-27T03:30:04.024841857Z [2024-06-27T03:30:04.024+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:30:04.024989905Z [2024-06-27T03:30:04.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:29:00+00:00, run_id=scheduled__2024-06-27T03:29:00+00:00, run_start_date=2024-06-27 03:30:01.152402+00:00, run_end_date=2024-06-27 03:30:04.024704+00:00, run_duration=2.872302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:29:00+00:00, data_interval_end=2024-06-27 03:30:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:30:04.035095146Z [2024-06-27T03:30:04.034+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:30:00+00:00, run_after=2024-06-27T03:31:00+00:00 2024-06-27T03:30:04.104173731Z [2024-06-27T03:30:04.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:28:00+00:00 exited with status success for try_number 1 2024-06-27T03:30:04.104205286Z [2024-06-27T03:30:04.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:29:00+00:00 exited with status success for try_number 1 2024-06-27T03:30:04.112281011Z [2024-06-27T03:30:04.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:28:00+00:00, map_index=-1, run_start_date=2024-06-27 03:30:02.696909+00:00, run_end_date=2024-06-27 03:30:03.496879+00:00, run_duration=0.79997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:30:01.252696+00:00, queued_by_job_id=2, pid=2386 2024-06-27T03:30:04.112400768Z [2024-06-27T03:30:04.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:29:00+00:00, map_index=-1, run_start_date=2024-06-27 03:30:02.636777+00:00, run_end_date=2024-06-27 03:30:03.662650+00:00, run_duration=1.025873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:30:01.252696+00:00, queued_by_job_id=2, pid=2385 2024-06-27T03:30:04.124577811Z [2024-06-27T03:30:04.124+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T03:30:05.216229102Z [2024-06-27T03:30:05.214+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:30:05.216276178Z 2024-06-27T03:30:05.216282494Z [2024-06-27T03:30:05.214+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:30:05.216288026Z [2024-06-27T03:30:05.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:30:05.216292390Z 2024-06-27T03:30:05.218101653Z [2024-06-27T03:30:05.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:30:05.218442800Z [2024-06-27T03:30:05.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:30:05.317684189Z [2024-06-27T03:30:05.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status queued for try_number 1 2024-06-27T03:30:05.317723686Z [2024-06-27T03:30:05.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status success for try_number 1 2024-06-27T03:30:05.320744044Z [2024-06-27T03:30:05.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa991c80-1c2e-4a06-a4fc-26d81218fe18 2024-06-27T03:30:05.320983864Z [2024-06-27T03:30:05.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:25:00+00:00, map_index=-1, run_start_date=2024-06-27 03:30:04.625640+00:00, run_end_date=2024-06-27 03:30:05.075008+00:00, run_duration=0.449368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:30:01.252696+00:00, queued_by_job_id=2, pid=2446 2024-06-27T03:30:06.364120143Z [2024-06-27T03:30:06.363+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:30:06.364924951Z [2024-06-27T03:30:06.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:29:00+00:00, run_id=scheduled__2024-06-27T03:29:00+00:00, run_start_date=2024-06-27 03:30:01.153649+00:00, run_end_date=2024-06-27 03:30:06.364442+00:00, run_duration=5.210793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:29:00+00:00, data_interval_end=2024-06-27 03:30:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:30:06.378823340Z [2024-06-27T03:30:06.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:30:00+00:00, run_after=2024-06-27T03:31:00+00:00 2024-06-27T03:30:06.384882774Z [2024-06-27T03:30:06.384+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:30:06.391069522Z [2024-06-27T03:30:06.385+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:29:00+00:00, run_id=scheduled__2024-06-27T03:29:00+00:00, run_start_date=2024-06-27 03:30:01.154612+00:00, run_end_date=2024-06-27 03:30:06.384539+00:00, run_duration=5.229927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:29:00+00:00, data_interval_end=2024-06-27 03:30:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:30:06.425564686Z [2024-06-27T03:30:06.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:30:00+00:00, run_after=2024-06-27T03:31:00+00:00 2024-06-27T03:30:06.505077660Z [2024-06-27T03:30:06.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:29:00+00:00 exited with status success for try_number 1 2024-06-27T03:30:06.505285591Z [2024-06-27T03:30:06.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:29:00+00:00 exited with status success for try_number 1 2024-06-27T03:30:06.516196683Z [2024-06-27T03:30:06.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:29:00+00:00, map_index=-1, run_start_date=2024-06-27 03:30:04.137902+00:00, run_end_date=2024-06-27 03:30:05.672612+00:00, run_duration=1.53471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:30:01.252696+00:00, queued_by_job_id=2, pid=2417 2024-06-27T03:30:06.517301174Z [2024-06-27T03:30:06.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:29:00+00:00, map_index=-1, run_start_date=2024-06-27 03:30:04.458317+00:00, run_end_date=2024-06-27 03:30:06.212593+00:00, run_duration=1.754276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:30:01.252696+00:00, queued_by_job_id=2, pid=2436 2024-06-27T03:30:07.898329022Z [2024-06-27T03:30:07.897+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:30:07.898407913Z 2024-06-27T03:30:07.898872213Z [2024-06-27T03:30:07.898+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:30:07.900942272Z [2024-06-27T03:30:07.900+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:30:07.900986282Z 2024-06-27T03:30:07.905596434Z [2024-06-27T03:30:07.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T03:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T03:30:07.905916000Z [2024-06-27T03:30:07.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T03:30:07.970505993Z [2024-06-27T03:30:07.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status queued for try_number 1 2024-06-27T03:30:07.970866167Z [2024-06-27T03:30:07.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status success for try_number 1 2024-06-27T03:30:07.978964740Z [2024-06-27T03:30:07.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ebdf754-fd06-4404-9cf9-1c9788d7f26a 2024-06-27T03:30:07.979456820Z [2024-06-27T03:30:07.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T03:25:00+00:00, map_index=-1, run_start_date=2024-06-27 03:30:07.107124+00:00, run_end_date=2024-06-27 03:30:07.485883+00:00, run_duration=0.378759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:30:05.215608+00:00, queued_by_job_id=2, pid=2475 2024-06-27T03:30:10.570726282Z [2024-06-27T03:30:10.570+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:30:10.570776798Z 2024-06-27T03:30:10.570902937Z [2024-06-27T03:30:10.570+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:30:10.571661837Z [2024-06-27T03:30:10.571+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:30:10.571698168Z 2024-06-27T03:30:10.574408911Z [2024-06-27T03:30:10.574+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:30:10.574556474Z [2024-06-27T03:30:10.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:30:10.645778478Z [2024-06-27T03:30:10.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status queued for try_number 1 2024-06-27T03:30:10.645845835Z [2024-06-27T03:30:10.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status success for try_number 1 2024-06-27T03:30:10.653021475Z [2024-06-27T03:30:10.652+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0c8b99f-3cfc-48dd-a070-498d8ddc183a 2024-06-27T03:30:10.653102154Z [2024-06-27T03:30:10.652+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T03:25:00+00:00, map_index=0, run_start_date=2024-06-27 03:30:09.845683+00:00, run_end_date=2024-06-27 03:30:10.260528+00:00, run_duration=0.414845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:30:07.901571+00:00, queued_by_job_id=2, pid=2487 2024-06-27T03:30:13.402500139Z [2024-06-27T03:30:13.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:30:13.402722129Z [2024-06-27T03:30:13.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:25:00+00:00, run_id=scheduled__2024-06-27T03:25:00+00:00, run_start_date=2024-06-27 03:30:01.149536+00:00, run_end_date=2024-06-27 03:30:13.402338+00:00, run_duration=12.252802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:25:00+00:00, data_interval_end=2024-06-27 03:30:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T03:30:13.414873788Z [2024-06-27T03:30:13.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:30:00+00:00, run_after=2024-06-27T03:35:00+00:00 2024-06-27T03:30:13.471562047Z [2024-06-27T03:30:13.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:25:00+00:00 exited with status success for try_number 1 2024-06-27T03:30:13.479948029Z [2024-06-27T03:30:13.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T03:25:00+00:00, map_index=-1, run_start_date=2024-06-27 03:30:12.400952+00:00, run_end_date=2024-06-27 03:30:12.888158+00:00, run_duration=0.487206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:30:10.571715+00:00, queued_by_job_id=2, pid=2499 2024-06-27T03:31:00.260013458Z [2024-06-27T03:31:00.259+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:31:00+00:00, run_after=2024-06-27T03:32:00+00:00 2024-06-27T03:31:00.274375940Z [2024-06-27T03:31:00.272+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:31:00.293235872Z [2024-06-27T03:31:00.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:31:00+00:00, run_after=2024-06-27T03:32:00+00:00 2024-06-27T03:31:00.372593870Z [2024-06-27T03:31:00.372+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:31:00.372618905Z 2024-06-27T03:31:00.372622876Z 2024-06-27T03:31:00.372626196Z 2024-06-27T03:31:00.373236231Z [2024-06-27T03:31:00.372+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:31:00.373643765Z [2024-06-27T03:31:00.373+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:31:00.374001498Z [2024-06-27T03:31:00.373+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:31:00.375482350Z [2024-06-27T03:31:00.375+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:31:00.375506023Z 2024-06-27T03:31:00.375509653Z 2024-06-27T03:31:00.375512765Z 2024-06-27T03:31:00.381155805Z [2024-06-27T03:31:00.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:31:00.381498431Z [2024-06-27T03:31:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:31:00.381929743Z [2024-06-27T03:31:00.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:31:00.382173608Z [2024-06-27T03:31:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:31:00.382597719Z [2024-06-27T03:31:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:31:00.382852926Z [2024-06-27T03:31:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:31:00.737824284Z [2024-06-27T03:31:00.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status queued for try_number 1 2024-06-27T03:31:00.738002187Z [2024-06-27T03:31:00.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status queued for try_number 1 2024-06-27T03:31:00.738420578Z [2024-06-27T03:31:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status queued for try_number 1 2024-06-27T03:31:00.754107260Z [2024-06-27T03:31:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e6eb5e2-d67d-48eb-a075-41ac65f90cfb 2024-06-27T03:31:00.754923598Z [2024-06-27T03:31:00.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4173d1a4-bd62-43a8-810b-5e259cb6eae6 2024-06-27T03:31:00.755125538Z [2024-06-27T03:31:00.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80c4ac0a-ef62-4a4c-a6ad-dde97426995d 2024-06-27T03:31:02.050370128Z [2024-06-27T03:31:02.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:31:02.051754143Z [2024-06-27T03:31:02.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:30:00+00:00, run_id=scheduled__2024-06-27T03:30:00+00:00, run_start_date=2024-06-27 03:31:00.305808+00:00, run_end_date=2024-06-27 03:31:02.051339+00:00, run_duration=1.745531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:30:00+00:00, data_interval_end=2024-06-27 03:31:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:31:02.062751051Z [2024-06-27T03:31:02.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:31:00+00:00, run_after=2024-06-27T03:32:00+00:00 2024-06-27T03:31:02.116290963Z [2024-06-27T03:31:02.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status success for try_number 1 2024-06-27T03:31:02.125236771Z [2024-06-27T03:31:02.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:30:00+00:00, map_index=-1, run_start_date=2024-06-27 03:31:01.433230+00:00, run_end_date=2024-06-27 03:31:01.930893+00:00, run_duration=0.497663, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:31:00.377435+00:00, queued_by_job_id=2, pid=2525 2024-06-27T03:31:04.256081974Z [2024-06-27T03:31:04.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:31:04.256397087Z [2024-06-27T03:31:04.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:30:00+00:00, run_id=scheduled__2024-06-27T03:30:00+00:00, run_start_date=2024-06-27 03:31:00.308616+00:00, run_end_date=2024-06-27 03:31:04.255956+00:00, run_duration=3.94734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:30:00+00:00, data_interval_end=2024-06-27 03:31:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:31:04.271606447Z [2024-06-27T03:31:04.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:31:00+00:00, run_after=2024-06-27T03:32:00+00:00 2024-06-27T03:31:04.331674696Z [2024-06-27T03:31:04.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status success for try_number 1 2024-06-27T03:31:04.339750492Z [2024-06-27T03:31:04.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:30:00+00:00, map_index=-1, run_start_date=2024-06-27 03:31:02.539896+00:00, run_end_date=2024-06-27 03:31:03.953907+00:00, run_duration=1.414011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:31:00.377435+00:00, queued_by_job_id=2, pid=2546 2024-06-27T03:31:05.413928704Z [2024-06-27T03:31:05.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:31:05.414443648Z [2024-06-27T03:31:05.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:30:00+00:00, run_id=scheduled__2024-06-27T03:30:00+00:00, run_start_date=2024-06-27 03:31:00.307419+00:00, run_end_date=2024-06-27 03:31:05.413891+00:00, run_duration=5.106472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:30:00+00:00, data_interval_end=2024-06-27 03:31:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:31:05.425636625Z [2024-06-27T03:31:05.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:31:00+00:00, run_after=2024-06-27T03:32:00+00:00 2024-06-27T03:31:05.472268291Z [2024-06-27T03:31:05.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status success for try_number 1 2024-06-27T03:31:05.482744963Z [2024-06-27T03:31:05.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:30:00+00:00, map_index=-1, run_start_date=2024-06-27 03:31:02.901601+00:00, run_end_date=2024-06-27 03:31:04.699408+00:00, run_duration=1.797807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:31:00.377435+00:00, queued_by_job_id=2, pid=2554 2024-06-27T03:32:00.131475469Z [2024-06-27T03:32:00.130+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:32:00.150598468Z [2024-06-27T03:32:00.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:32:00+00:00, run_after=2024-06-27T03:33:00+00:00 2024-06-27T03:32:00.170805912Z [2024-06-27T03:32:00.170+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:32:00+00:00, run_after=2024-06-27T03:33:00+00:00 2024-06-27T03:32:00.180893443Z [2024-06-27T03:32:00.180+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:32:00.375238742Z [2024-06-27T03:32:00.374+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:32:00.375259608Z 2024-06-27T03:32:00.375264124Z 2024-06-27T03:32:00.375267435Z 2024-06-27T03:32:00.375298289Z 2024-06-27T03:32:00.375302100Z [2024-06-27T03:32:00.375+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:32:00.375325747Z [2024-06-27T03:32:00.375+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:32:00.375516413Z [2024-06-27T03:32:00.375+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:32:00.375608990Z [2024-06-27T03:32:00.375+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:32:00.376173740Z [2024-06-27T03:32:00.375+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:32:00.376241526Z 2024-06-27T03:32:00.376249299Z 2024-06-27T03:32:00.376255084Z 2024-06-27T03:32:00.376259358Z 2024-06-27T03:32:00.383828008Z [2024-06-27T03:32:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:32:00.383879565Z [2024-06-27T03:32:00.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:32:00.384096056Z [2024-06-27T03:32:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:32:00.384189484Z [2024-06-27T03:32:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:32:00.384314679Z [2024-06-27T03:32:00.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:32:00.384390235Z [2024-06-27T03:32:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:32:00.384568155Z [2024-06-27T03:32:00.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:32:00.384601253Z [2024-06-27T03:32:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:32:00.918789565Z [2024-06-27T03:32:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status queued for try_number 1 2024-06-27T03:32:00.918843379Z [2024-06-27T03:32:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:31:00+00:00 exited with status queued for try_number 1 2024-06-27T03:32:00.918944287Z [2024-06-27T03:32:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:31:00+00:00 exited with status queued for try_number 1 2024-06-27T03:32:00.919073365Z [2024-06-27T03:32:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:31:00+00:00 exited with status queued for try_number 1 2024-06-27T03:32:00.939624489Z [2024-06-27T03:32:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 139a7267-37d2-4f74-876c-85236cfc76b4 2024-06-27T03:32:00.939690975Z [2024-06-27T03:32:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 818b91d8-73aa-432a-85fd-b90ab410e9a7 2024-06-27T03:32:00.939906085Z [2024-06-27T03:32:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to de8ae331-1425-4ae7-a21e-c6b29eb2f8a0 2024-06-27T03:32:00.940058365Z [2024-06-27T03:32:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbb0b412-d2f9-457f-85dd-f3072966560e 2024-06-27T03:32:02.437995845Z [2024-06-27T03:32:02.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status success for try_number 1 2024-06-27T03:32:02.453482921Z [2024-06-27T03:32:02.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:30:00+00:00, map_index=-1, run_start_date=2024-06-27 03:32:01.542981+00:00, run_end_date=2024-06-27 03:32:02.192694+00:00, run_duration=0.649713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:32:00.380747+00:00, queued_by_job_id=2, pid=2590 2024-06-27T03:32:03.520135542Z [2024-06-27T03:32:03.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:32:03.521145314Z [2024-06-27T03:32:03.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:30:00+00:00, run_id=scheduled__2024-06-27T03:30:00+00:00, run_start_date=2024-06-27 03:32:00.197963+00:00, run_end_date=2024-06-27 03:32:03.520373+00:00, run_duration=3.32241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:30:00+00:00, data_interval_end=2024-06-27 03:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:32:03.538033038Z [2024-06-27T03:32:03.537+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:32:00+00:00, run_after=2024-06-27T03:34:00+00:00 2024-06-27T03:32:03.550451668Z [2024-06-27T03:32:03.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:32:03.551100274Z [2024-06-27T03:32:03.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:31:00+00:00, run_id=scheduled__2024-06-27T03:31:00+00:00, run_start_date=2024-06-27 03:32:00.203040+00:00, run_end_date=2024-06-27 03:32:03.550507+00:00, run_duration=3.347467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:31:00+00:00, data_interval_end=2024-06-27 03:32:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:32:03.575428407Z [2024-06-27T03:32:03.575+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:32:00+00:00, run_after=2024-06-27T03:33:00+00:00 2024-06-27T03:32:03.643626003Z [2024-06-27T03:32:03.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:31:00+00:00 exited with status success for try_number 1 2024-06-27T03:32:03.652685283Z [2024-06-27T03:32:03.652+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:31:00+00:00, map_index=-1, run_start_date=2024-06-27 03:32:01.966619+00:00, run_end_date=2024-06-27 03:32:02.578991+00:00, run_duration=0.612372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:32:00.380747+00:00, queued_by_job_id=2, pid=2601 2024-06-27T03:32:06.610687723Z [2024-06-27T03:32:06.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:32:06.611202501Z [2024-06-27T03:32:06.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:31:00+00:00, run_id=scheduled__2024-06-27T03:31:00+00:00, run_start_date=2024-06-27 03:32:00.199823+00:00, run_end_date=2024-06-27 03:32:06.610560+00:00, run_duration=6.410737, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:31:00+00:00, data_interval_end=2024-06-27 03:32:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:32:06.632343872Z [2024-06-27T03:32:06.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:32:00+00:00, run_after=2024-06-27T03:33:00+00:00 2024-06-27T03:32:06.642747226Z [2024-06-27T03:32:06.642+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:32:06.643106986Z [2024-06-27T03:32:06.642+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:31:00+00:00, run_id=scheduled__2024-06-27T03:31:00+00:00, run_start_date=2024-06-27 03:32:00.201707+00:00, run_end_date=2024-06-27 03:32:06.642565+00:00, run_duration=6.440858, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:31:00+00:00, data_interval_end=2024-06-27 03:32:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:32:06.669452217Z [2024-06-27T03:32:06.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:32:00+00:00, run_after=2024-06-27T03:33:00+00:00 2024-06-27T03:32:06.713354501Z [2024-06-27T03:32:06.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:31:00+00:00 exited with status success for try_number 1 2024-06-27T03:32:06.713499541Z [2024-06-27T03:32:06.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:31:00+00:00 exited with status success for try_number 1 2024-06-27T03:32:06.728196761Z [2024-06-27T03:32:06.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:31:00+00:00, map_index=-1, run_start_date=2024-06-27 03:32:02.995468+00:00, run_end_date=2024-06-27 03:32:06.350413+00:00, run_duration=3.354945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:32:00.380747+00:00, queued_by_job_id=2, pid=2629 2024-06-27T03:32:06.729053308Z [2024-06-27T03:32:06.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:31:00+00:00, map_index=-1, run_start_date=2024-06-27 03:32:03.829721+00:00, run_end_date=2024-06-27 03:32:06.179506+00:00, run_duration=2.349785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:32:00.380747+00:00, queued_by_job_id=2, pid=2648 2024-06-27T03:33:00.076266378Z [2024-06-27T03:33:00.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:33:00+00:00, run_after=2024-06-27T03:34:00+00:00 2024-06-27T03:33:00.083948041Z [2024-06-27T03:33:00.083+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:33:00.097904789Z [2024-06-27T03:33:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:33:00+00:00, run_after=2024-06-27T03:34:00+00:00 2024-06-27T03:33:00.175753007Z [2024-06-27T03:33:00.175+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:33:00.175799659Z 2024-06-27T03:33:00.175803618Z 2024-06-27T03:33:00.175807150Z 2024-06-27T03:33:00.175821806Z [2024-06-27T03:33:00.175+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:33:00.176115773Z [2024-06-27T03:33:00.175+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:33:00.176356473Z [2024-06-27T03:33:00.176+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:33:00.177619074Z [2024-06-27T03:33:00.176+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:33:00.177632211Z 2024-06-27T03:33:00.177636793Z 2024-06-27T03:33:00.177640015Z 2024-06-27T03:33:00.181128706Z [2024-06-27T03:33:00.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:33:00.181364124Z [2024-06-27T03:33:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:33:00.181686134Z [2024-06-27T03:33:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:33:00.181857994Z [2024-06-27T03:33:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:33:00.182153285Z [2024-06-27T03:33:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:33:00.182389971Z [2024-06-27T03:33:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:33:00.548674443Z [2024-06-27T03:33:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:32:00+00:00 exited with status queued for try_number 1 2024-06-27T03:33:00.548812983Z [2024-06-27T03:33:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:32:00+00:00 exited with status queued for try_number 1 2024-06-27T03:33:00.549043653Z [2024-06-27T03:33:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:32:00+00:00 exited with status queued for try_number 1 2024-06-27T03:33:00.567973175Z [2024-06-27T03:33:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 477af2ef-3da8-457f-b180-c4f6e7eef7e9 2024-06-27T03:33:00.568310030Z [2024-06-27T03:33:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5be1ae57-3a05-4815-bd45-4341d25ca9b2 2024-06-27T03:33:00.568546873Z [2024-06-27T03:33:00.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed0e6aee-b5df-40d3-becf-830681c55d79 2024-06-27T03:33:01.727757816Z [2024-06-27T03:33:01.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:33:01.728128214Z [2024-06-27T03:33:01.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:32:00+00:00, run_id=scheduled__2024-06-27T03:32:00+00:00, run_start_date=2024-06-27 03:33:00.108004+00:00, run_end_date=2024-06-27 03:33:01.727630+00:00, run_duration=1.619626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:32:00+00:00, data_interval_end=2024-06-27 03:33:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:33:01.738204382Z [2024-06-27T03:33:01.737+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:33:00+00:00, run_after=2024-06-27T03:34:00+00:00 2024-06-27T03:33:01.797550631Z [2024-06-27T03:33:01.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:32:00+00:00 exited with status success for try_number 1 2024-06-27T03:33:01.804320413Z [2024-06-27T03:33:01.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:32:00+00:00, map_index=-1, run_start_date=2024-06-27 03:33:01.192263+00:00, run_end_date=2024-06-27 03:33:01.556091+00:00, run_duration=0.363828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:33:00.178250+00:00, queued_by_job_id=2, pid=2683 2024-06-27T03:33:04.148333593Z [2024-06-27T03:33:04.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:33:04.148583796Z [2024-06-27T03:33:04.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:32:00+00:00, run_id=scheduled__2024-06-27T03:32:00+00:00, run_start_date=2024-06-27 03:33:00.110779+00:00, run_end_date=2024-06-27 03:33:04.148192+00:00, run_duration=4.037413, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:32:00+00:00, data_interval_end=2024-06-27 03:33:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:33:04.159804439Z [2024-06-27T03:33:04.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:33:00+00:00, run_after=2024-06-27T03:34:00+00:00 2024-06-27T03:33:04.199842311Z [2024-06-27T03:33:04.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:32:00+00:00 exited with status success for try_number 1 2024-06-27T03:33:04.207729986Z [2024-06-27T03:33:04.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:32:00+00:00, map_index=-1, run_start_date=2024-06-27 03:33:02.191111+00:00, run_end_date=2024-06-27 03:33:03.579245+00:00, run_duration=1.388134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:33:00.178250+00:00, queued_by_job_id=2, pid=2713 2024-06-27T03:33:05.264024571Z [2024-06-27T03:33:05.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:33:05.264283960Z [2024-06-27T03:33:05.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:32:00+00:00, run_id=scheduled__2024-06-27T03:32:00+00:00, run_start_date=2024-06-27 03:33:00.109559+00:00, run_end_date=2024-06-27 03:33:05.263863+00:00, run_duration=5.154304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:32:00+00:00, data_interval_end=2024-06-27 03:33:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:33:05.274966469Z [2024-06-27T03:33:05.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:33:00+00:00, run_after=2024-06-27T03:34:00+00:00 2024-06-27T03:33:05.318918714Z [2024-06-27T03:33:05.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:32:00+00:00 exited with status success for try_number 1 2024-06-27T03:33:05.326181636Z [2024-06-27T03:33:05.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:32:00+00:00, map_index=-1, run_start_date=2024-06-27 03:33:02.313560+00:00, run_end_date=2024-06-27 03:33:04.054825+00:00, run_duration=1.741265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:33:00.178250+00:00, queued_by_job_id=2, pid=2714 2024-06-27T03:34:00.461411094Z [2024-06-27T03:34:00.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:34:00+00:00, run_after=2024-06-27T03:35:00+00:00 2024-06-27T03:34:00.486892039Z [2024-06-27T03:34:00.486+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:34:00+00:00, run_after=2024-06-27T03:35:00+00:00 2024-06-27T03:34:00.497416226Z [2024-06-27T03:34:00.496+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:34:00.506034626Z [2024-06-27T03:34:00.505+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:34:00.593081875Z [2024-06-27T03:34:00.592+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:34:00.593104070Z 2024-06-27T03:34:00.593108792Z 2024-06-27T03:34:00.593112105Z 2024-06-27T03:34:00.593115203Z 2024-06-27T03:34:00.593126549Z [2024-06-27T03:34:00.592+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:34:00.593172167Z [2024-06-27T03:34:00.593+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:34:00.593255363Z [2024-06-27T03:34:00.593+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:34:00.593388584Z [2024-06-27T03:34:00.593+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:34:00.594016915Z [2024-06-27T03:34:00.593+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:34:00.594028236Z 2024-06-27T03:34:00.594031688Z 2024-06-27T03:34:00.594034686Z 2024-06-27T03:34:00.594037821Z 2024-06-27T03:34:00.597418399Z [2024-06-27T03:34:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:34:00.597485773Z [2024-06-27T03:34:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:34:00.597770189Z [2024-06-27T03:34:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:34:00.597861217Z [2024-06-27T03:34:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:34:00.598025503Z [2024-06-27T03:34:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:34:00.598097135Z [2024-06-27T03:34:00.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:34:00.598247318Z [2024-06-27T03:34:00.598+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:34:00.598320115Z [2024-06-27T03:34:00.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:34:01.108248613Z [2024-06-27T03:34:01.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:32:00+00:00 exited with status queued for try_number 1 2024-06-27T03:34:01.108277029Z [2024-06-27T03:34:01.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:33:00+00:00 exited with status queued for try_number 1 2024-06-27T03:34:01.108280952Z [2024-06-27T03:34:01.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:33:00+00:00 exited with status queued for try_number 1 2024-06-27T03:34:01.108284328Z [2024-06-27T03:34:01.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:33:00+00:00 exited with status queued for try_number 1 2024-06-27T03:34:01.134955711Z [2024-06-27T03:34:01.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3d61061-847a-46c1-b550-df1382057bdb 2024-06-27T03:34:01.141172004Z [2024-06-27T03:34:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to b76ed820-1e21-44ca-9fb2-5258b57c7fbb 2024-06-27T03:34:01.141185869Z [2024-06-27T03:34:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29151e10-f6b5-4388-8741-2abae016fcc8 2024-06-27T03:34:01.141190492Z [2024-06-27T03:34:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to fad99883-5fe2-4652-be12-295602051758 2024-06-27T03:34:02.419819859Z [2024-06-27T03:34:02.419+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:34:02.420430505Z [2024-06-27T03:34:02.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:32:00+00:00, run_id=scheduled__2024-06-27T03:32:00+00:00, run_start_date=2024-06-27 03:34:00.521466+00:00, run_end_date=2024-06-27 03:34:02.419874+00:00, run_duration=1.898408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:32:00+00:00, data_interval_end=2024-06-27 03:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:34:02.428403338Z [2024-06-27T03:34:02.428+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:34:00+00:00, run_after=2024-06-27T03:36:00+00:00 2024-06-27T03:34:02.441555349Z [2024-06-27T03:34:02.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:34:02.441838438Z [2024-06-27T03:34:02.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:33:00+00:00, run_id=scheduled__2024-06-27T03:33:00+00:00, run_start_date=2024-06-27 03:34:00.524289+00:00, run_end_date=2024-06-27 03:34:02.441515+00:00, run_duration=1.917226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:33:00+00:00, data_interval_end=2024-06-27 03:34:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:34:02.453186097Z [2024-06-27T03:34:02.452+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:34:00+00:00, run_after=2024-06-27T03:35:00+00:00 2024-06-27T03:34:02.503343407Z [2024-06-27T03:34:02.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:32:00+00:00 exited with status success for try_number 1 2024-06-27T03:34:02.510234036Z [2024-06-27T03:34:02.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:32:00+00:00, map_index=-1, run_start_date=2024-06-27 03:34:01.805299+00:00, run_end_date=2024-06-27 03:34:02.231308+00:00, run_duration=0.426009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:34:00.594760+00:00, queued_by_job_id=2, pid=2759 2024-06-27T03:34:02.964621386Z [2024-06-27T03:34:02.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:33:00+00:00 exited with status success for try_number 1 2024-06-27T03:34:02.970904836Z [2024-06-27T03:34:02.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:33:00+00:00, map_index=-1, run_start_date=2024-06-27 03:34:01.873706+00:00, run_end_date=2024-06-27 03:34:02.329713+00:00, run_duration=0.456007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:34:00.594760+00:00, queued_by_job_id=2, pid=2760 2024-06-27T03:34:05.154197381Z [2024-06-27T03:34:05.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:34:05.154676083Z [2024-06-27T03:34:05.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:33:00+00:00, run_id=scheduled__2024-06-27T03:33:00+00:00, run_start_date=2024-06-27 03:34:00.522977+00:00, run_end_date=2024-06-27 03:34:05.154259+00:00, run_duration=4.631282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:33:00+00:00, data_interval_end=2024-06-27 03:34:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:34:05.164879366Z [2024-06-27T03:34:05.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:34:00+00:00, run_after=2024-06-27T03:35:00+00:00 2024-06-27T03:34:06.251432579Z [2024-06-27T03:34:06.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:34:06.252025476Z [2024-06-27T03:34:06.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:33:00+00:00, run_id=scheduled__2024-06-27T03:33:00+00:00, run_start_date=2024-06-27 03:34:00.525578+00:00, run_end_date=2024-06-27 03:34:06.251621+00:00, run_duration=5.726043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:33:00+00:00, data_interval_end=2024-06-27 03:34:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:34:06.268958924Z [2024-06-27T03:34:06.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:34:00+00:00, run_after=2024-06-27T03:35:00+00:00 2024-06-27T03:34:06.303305573Z [2024-06-27T03:34:06.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:33:00+00:00 exited with status success for try_number 1 2024-06-27T03:34:06.303438748Z [2024-06-27T03:34:06.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:33:00+00:00 exited with status success for try_number 1 2024-06-27T03:34:06.309452935Z [2024-06-27T03:34:06.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:33:00+00:00, map_index=-1, run_start_date=2024-06-27 03:34:03.219576+00:00, run_end_date=2024-06-27 03:34:05.085759+00:00, run_duration=1.866183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:34:00.594760+00:00, queued_by_job_id=2, pid=2799 2024-06-27T03:34:06.309857739Z [2024-06-27T03:34:06.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:33:00+00:00, map_index=-1, run_start_date=2024-06-27 03:34:03.390352+00:00, run_end_date=2024-06-27 03:34:05.596325+00:00, run_duration=2.205973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:34:00.594760+00:00, queued_by_job_id=2, pid=2800 2024-06-27T03:35:00.951492304Z [2024-06-27T03:35:00.950+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:35:00+00:00, run_after=2024-06-27T03:40:00+00:00 2024-06-27T03:35:00.966297825Z [2024-06-27T03:35:00.965+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:35:00+00:00, run_after=2024-06-27T03:36:00+00:00 2024-06-27T03:35:00.982179494Z [2024-06-27T03:35:00.981+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:35:01.010227789Z [2024-06-27T03:35:01.009+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:35:00+00:00, run_after=2024-06-27T03:36:00+00:00 2024-06-27T03:35:01.154446302Z [2024-06-27T03:35:01.153+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:35:01.154486090Z 2024-06-27T03:35:01.154493438Z 2024-06-27T03:35:01.154499683Z 2024-06-27T03:35:01.154505646Z 2024-06-27T03:35:01.155868961Z [2024-06-27T03:35:01.155+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:35:01.157483818Z [2024-06-27T03:35:01.156+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:35:01.158425394Z [2024-06-27T03:35:01.157+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:35:01.158982901Z [2024-06-27T03:35:01.158+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:35:01.160679231Z [2024-06-27T03:35:01.160+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:35:01.160699975Z 2024-06-27T03:35:01.160706742Z 2024-06-27T03:35:01.160712488Z 2024-06-27T03:35:01.160718124Z 2024-06-27T03:35:01.168018498Z [2024-06-27T03:35:01.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T03:35:01.168622094Z [2024-06-27T03:35:01.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:35:01.170022994Z [2024-06-27T03:35:01.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:35:01.170494553Z [2024-06-27T03:35:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:35:01.171298102Z [2024-06-27T03:35:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:35:01.172100416Z [2024-06-27T03:35:01.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:35:01.173759756Z [2024-06-27T03:35:01.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:35:01.174117062Z [2024-06-27T03:35:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:35:01.514060901Z [2024-06-27T03:35:01.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status queued for try_number 1 2024-06-27T03:35:01.514190002Z [2024-06-27T03:35:01.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:34:00+00:00 exited with status queued for try_number 1 2024-06-27T03:35:01.514358100Z [2024-06-27T03:35:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:34:00+00:00 exited with status queued for try_number 1 2024-06-27T03:35:01.514424456Z [2024-06-27T03:35:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:34:00+00:00 exited with status queued for try_number 1 2024-06-27T03:35:01.529057902Z [2024-06-27T03:35:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4c65064-de6b-4f82-9284-ffb7afb38841 2024-06-27T03:35:01.529245385Z [2024-06-27T03:35:01.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc5c604e-32ce-4bc6-82d2-b507ba958848 2024-06-27T03:35:01.529433385Z [2024-06-27T03:35:01.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to 811e9b48-b6fb-4312-a31b-6a55a24eed12 2024-06-27T03:35:01.532154266Z [2024-06-27T03:35:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to be367ef3-dd2d-469e-bb01-9da182c1c138 2024-06-27T03:35:03.940283245Z [2024-06-27T03:35:03.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:35:03.940644106Z [2024-06-27T03:35:03.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:34:00+00:00, run_id=scheduled__2024-06-27T03:34:00+00:00, run_start_date=2024-06-27 03:35:01.025618+00:00, run_end_date=2024-06-27 03:35:03.940140+00:00, run_duration=2.914522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:34:00+00:00, data_interval_end=2024-06-27 03:35:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:35:03.953868339Z [2024-06-27T03:35:03.953+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:35:00+00:00, run_after=2024-06-27T03:36:00+00:00 2024-06-27T03:35:04.036335539Z [2024-06-27T03:35:04.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:34:00+00:00 exited with status success for try_number 1 2024-06-27T03:35:04.050002320Z [2024-06-27T03:35:04.049+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:34:00+00:00, map_index=-1, run_start_date=2024-06-27 03:35:02.247506+00:00, run_end_date=2024-06-27 03:35:03.088559+00:00, run_duration=0.841053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:35:01.163576+00:00, queued_by_job_id=2, pid=2845 2024-06-27T03:35:04.240145630Z [2024-06-27T03:35:04.239+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T03:35:05.357446091Z [2024-06-27T03:35:05.356+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:35:05.357481190Z 2024-06-27T03:35:05.357844195Z [2024-06-27T03:35:05.357+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:35:05.358889326Z [2024-06-27T03:35:05.358+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:35:05.358906310Z 2024-06-27T03:35:05.362474383Z [2024-06-27T03:35:05.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:35:05.362884461Z [2024-06-27T03:35:05.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:35:05.424679151Z [2024-06-27T03:35:05.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status queued for try_number 1 2024-06-27T03:35:05.426466858Z [2024-06-27T03:35:05.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status success for try_number 1 2024-06-27T03:35:05.434437113Z [2024-06-27T03:35:05.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a547e36-b8ac-464b-8ccf-9c3db27dec67 2024-06-27T03:35:05.434761245Z [2024-06-27T03:35:05.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:30:00+00:00, map_index=-1, run_start_date=2024-06-27 03:35:03.674870+00:00, run_end_date=2024-06-27 03:35:04.187364+00:00, run_duration=0.512494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:35:01.163576+00:00, queued_by_job_id=2, pid=2867 2024-06-27T03:35:06.613863266Z [2024-06-27T03:35:06.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:35:06.614313431Z [2024-06-27T03:35:06.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:34:00+00:00, run_id=scheduled__2024-06-27T03:34:00+00:00, run_start_date=2024-06-27 03:35:01.026835+00:00, run_end_date=2024-06-27 03:35:06.613685+00:00, run_duration=5.58685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:34:00+00:00, data_interval_end=2024-06-27 03:35:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:35:06.626620577Z [2024-06-27T03:35:06.626+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:35:00+00:00, run_after=2024-06-27T03:36:00+00:00 2024-06-27T03:35:06.641096296Z [2024-06-27T03:35:06.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:35:06.641565587Z [2024-06-27T03:35:06.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:34:00+00:00, run_id=scheduled__2024-06-27T03:34:00+00:00, run_start_date=2024-06-27 03:35:01.028100+00:00, run_end_date=2024-06-27 03:35:06.640963+00:00, run_duration=5.612863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:34:00+00:00, data_interval_end=2024-06-27 03:35:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:35:06.652218704Z [2024-06-27T03:35:06.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:35:00+00:00, run_after=2024-06-27T03:36:00+00:00 2024-06-27T03:35:06.722516593Z [2024-06-27T03:35:06.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:34:00+00:00 exited with status success for try_number 1 2024-06-27T03:35:06.722969629Z [2024-06-27T03:35:06.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:34:00+00:00 exited with status success for try_number 1 2024-06-27T03:35:06.735118493Z [2024-06-27T03:35:06.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:34:00+00:00, map_index=-1, run_start_date=2024-06-27 03:35:04.279862+00:00, run_end_date=2024-06-27 03:35:06.291036+00:00, run_duration=2.011174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:35:01.163576+00:00, queued_by_job_id=2, pid=2896 2024-06-27T03:35:06.735647555Z [2024-06-27T03:35:06.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:34:00+00:00, map_index=-1, run_start_date=2024-06-27 03:35:04.085837+00:00, run_end_date=2024-06-27 03:35:05.530514+00:00, run_duration=1.444677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:35:01.163576+00:00, queued_by_job_id=2, pid=2891 2024-06-27T03:35:08.063412392Z [2024-06-27T03:35:08.062+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:35:08.063437868Z 2024-06-27T03:35:08.063672731Z [2024-06-27T03:35:08.063+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:35:08.064362509Z [2024-06-27T03:35:08.064+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:35:08.064681463Z 2024-06-27T03:35:08.067525769Z [2024-06-27T03:35:08.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T03:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T03:35:08.067814506Z [2024-06-27T03:35:08.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T03:35:08.191290806Z [2024-06-27T03:35:08.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status queued for try_number 1 2024-06-27T03:35:08.192241872Z [2024-06-27T03:35:08.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status success for try_number 1 2024-06-27T03:35:08.214234670Z [2024-06-27T03:35:08.213+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5edf1616-0ab9-47a7-b1a8-3455b23e7539 2024-06-27T03:35:08.237953195Z [2024-06-27T03:35:08.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T03:30:00+00:00, map_index=-1, run_start_date=2024-06-27 03:35:07.215288+00:00, run_end_date=2024-06-27 03:35:07.573113+00:00, run_duration=0.357825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:35:05.359410+00:00, queued_by_job_id=2, pid=2926 2024-06-27T03:35:11.404515030Z [2024-06-27T03:35:11.403+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:35:11.404559973Z 2024-06-27T03:35:11.404805982Z [2024-06-27T03:35:11.404+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:35:11.405581363Z [2024-06-27T03:35:11.405+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:35:11.405594954Z 2024-06-27T03:35:11.409385324Z [2024-06-27T03:35:11.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:35:11.409773429Z [2024-06-27T03:35:11.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:35:11.498050683Z [2024-06-27T03:35:11.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status queued for try_number 1 2024-06-27T03:35:11.498157524Z [2024-06-27T03:35:11.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status success for try_number 1 2024-06-27T03:35:11.503623259Z [2024-06-27T03:35:11.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2585894b-47d2-4a5c-8e77-8f9c89bd021e 2024-06-27T03:35:11.503801989Z [2024-06-27T03:35:11.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T03:30:00+00:00, map_index=0, run_start_date=2024-06-27 03:35:10.144687+00:00, run_end_date=2024-06-27 03:35:10.489847+00:00, run_duration=0.34516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:35:08.065081+00:00, queued_by_job_id=2, pid=2938 2024-06-27T03:35:14.230408966Z [2024-06-27T03:35:14.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:35:14.231164641Z [2024-06-27T03:35:14.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:30:00+00:00, run_id=scheduled__2024-06-27T03:30:00+00:00, run_start_date=2024-06-27 03:35:01.024116+00:00, run_end_date=2024-06-27 03:35:14.230281+00:00, run_duration=13.206165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:30:00+00:00, data_interval_end=2024-06-27 03:35:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T03:35:14.240167449Z [2024-06-27T03:35:14.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:35:00+00:00, run_after=2024-06-27T03:40:00+00:00 2024-06-27T03:35:14.277796960Z [2024-06-27T03:35:14.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:30:00+00:00 exited with status success for try_number 1 2024-06-27T03:35:14.283538705Z [2024-06-27T03:35:14.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T03:30:00+00:00, map_index=-1, run_start_date=2024-06-27 03:35:13.133316+00:00, run_end_date=2024-06-27 03:35:13.526131+00:00, run_duration=0.392815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:35:11.406211+00:00, queued_by_job_id=2, pid=2950 2024-06-27T03:36:00.068092282Z [2024-06-27T03:36:00.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:36:00.082751438Z [2024-06-27T03:36:00.082+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:36:00.095532793Z [2024-06-27T03:36:00.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:36:00+00:00, run_after=2024-06-27T03:37:00+00:00 2024-06-27T03:36:00.112831457Z [2024-06-27T03:36:00.112+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:36:00+00:00, run_after=2024-06-27T03:37:00+00:00 2024-06-27T03:36:00.212388830Z [2024-06-27T03:36:00.212+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:36:00.212437730Z 2024-06-27T03:36:00.212443659Z 2024-06-27T03:36:00.212448539Z 2024-06-27T03:36:00.212453043Z 2024-06-27T03:36:00.212616998Z [2024-06-27T03:36:00.212+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:36:00.212948456Z [2024-06-27T03:36:00.212+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:36:00.213128171Z [2024-06-27T03:36:00.212+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:36:00.213249019Z [2024-06-27T03:36:00.213+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:36:00.213900203Z [2024-06-27T03:36:00.213+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:36:00.213911296Z 2024-06-27T03:36:00.213915017Z 2024-06-27T03:36:00.213918464Z 2024-06-27T03:36:00.213921802Z 2024-06-27T03:36:00.218377759Z [2024-06-27T03:36:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:36:00.218730428Z [2024-06-27T03:36:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:36:00.219000502Z [2024-06-27T03:36:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:36:00.219110752Z [2024-06-27T03:36:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:36:00.219354064Z [2024-06-27T03:36:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:36:00.219469713Z [2024-06-27T03:36:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:36:00.219765622Z [2024-06-27T03:36:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:36:00.219949389Z [2024-06-27T03:36:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:36:00.537887233Z [2024-06-27T03:36:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:34:00+00:00 exited with status queued for try_number 1 2024-06-27T03:36:00.537950553Z [2024-06-27T03:36:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status queued for try_number 1 2024-06-27T03:36:00.538067340Z [2024-06-27T03:36:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status queued for try_number 1 2024-06-27T03:36:00.538169508Z [2024-06-27T03:36:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status queued for try_number 1 2024-06-27T03:36:00.570110116Z [2024-06-27T03:36:00.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to 615e2bfc-5e60-46fd-a836-fe321c0755e4 2024-06-27T03:36:00.570201146Z [2024-06-27T03:36:00.570+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4df19854-20e6-4e50-9654-34ab1124eb93 2024-06-27T03:36:00.570392825Z [2024-06-27T03:36:00.570+0000] {scheduler_job.py:635} INFO - Setting external_id for to aeeb8054-b501-4ea7-a747-c7dc95ccbab7 2024-06-27T03:36:00.570631384Z [2024-06-27T03:36:00.570+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9f809b3-72e8-4169-98d9-f2b21955ec4e 2024-06-27T03:36:01.918580612Z [2024-06-27T03:36:01.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:36:01.919068540Z [2024-06-27T03:36:01.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:34:00+00:00, run_id=scheduled__2024-06-27T03:34:00+00:00, run_start_date=2024-06-27 03:36:00.135703+00:00, run_end_date=2024-06-27 03:36:01.918491+00:00, run_duration=1.782788, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:34:00+00:00, data_interval_end=2024-06-27 03:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:36:01.926783283Z [2024-06-27T03:36:01.926+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:36:00+00:00, run_after=2024-06-27T03:38:00+00:00 2024-06-27T03:36:01.946372923Z [2024-06-27T03:36:01.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:36:01.946790703Z [2024-06-27T03:36:01.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:35:00+00:00, run_id=scheduled__2024-06-27T03:35:00+00:00, run_start_date=2024-06-27 03:36:00.139912+00:00, run_end_date=2024-06-27 03:36:01.946288+00:00, run_duration=1.806376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:35:00+00:00, data_interval_end=2024-06-27 03:36:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:36:01.957832597Z [2024-06-27T03:36:01.957+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:36:00+00:00, run_after=2024-06-27T03:37:00+00:00 2024-06-27T03:36:02.021084517Z [2024-06-27T03:36:02.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:34:00+00:00 exited with status success for try_number 1 2024-06-27T03:36:02.021387732Z [2024-06-27T03:36:02.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status success for try_number 1 2024-06-27T03:36:02.030709279Z [2024-06-27T03:36:02.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:34:00+00:00, map_index=-1, run_start_date=2024-06-27 03:36:01.229918+00:00, run_end_date=2024-06-27 03:36:01.725986+00:00, run_duration=0.496068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:36:00.214960+00:00, queued_by_job_id=2, pid=2977 2024-06-27T03:36:02.031035478Z [2024-06-27T03:36:02.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:35:00+00:00, map_index=-1, run_start_date=2024-06-27 03:36:01.301948+00:00, run_end_date=2024-06-27 03:36:01.746006+00:00, run_duration=0.444058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:36:00.214960+00:00, queued_by_job_id=2, pid=2978 2024-06-27T03:36:04.222372886Z [2024-06-27T03:36:04.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:36:04.223056571Z [2024-06-27T03:36:04.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:35:00+00:00, run_id=scheduled__2024-06-27T03:35:00+00:00, run_start_date=2024-06-27 03:36:00.138598+00:00, run_end_date=2024-06-27 03:36:04.222194+00:00, run_duration=4.083596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:35:00+00:00, data_interval_end=2024-06-27 03:36:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:36:04.237120523Z [2024-06-27T03:36:04.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:36:00+00:00, run_after=2024-06-27T03:37:00+00:00 2024-06-27T03:36:04.282589160Z [2024-06-27T03:36:04.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status success for try_number 1 2024-06-27T03:36:04.291998558Z [2024-06-27T03:36:04.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:35:00+00:00, map_index=-1, run_start_date=2024-06-27 03:36:02.316677+00:00, run_end_date=2024-06-27 03:36:03.598826+00:00, run_duration=1.282149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:36:00.214960+00:00, queued_by_job_id=2, pid=3017 2024-06-27T03:36:05.341983034Z [2024-06-27T03:36:05.341+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:36:05.342091633Z [2024-06-27T03:36:05.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:35:00+00:00, run_id=scheduled__2024-06-27T03:35:00+00:00, run_start_date=2024-06-27 03:36:00.137129+00:00, run_end_date=2024-06-27 03:36:05.341625+00:00, run_duration=5.204496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:35:00+00:00, data_interval_end=2024-06-27 03:36:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:36:05.354247278Z [2024-06-27T03:36:05.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:36:00+00:00, run_after=2024-06-27T03:37:00+00:00 2024-06-27T03:36:05.388633251Z [2024-06-27T03:36:05.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status success for try_number 1 2024-06-27T03:36:05.401409640Z [2024-06-27T03:36:05.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:35:00+00:00, map_index=-1, run_start_date=2024-06-27 03:36:02.483114+00:00, run_end_date=2024-06-27 03:36:04.365427+00:00, run_duration=1.882313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:36:00.214960+00:00, queued_by_job_id=2, pid=3018 2024-06-27T03:37:00.629539364Z [2024-06-27T03:37:00.627+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:37:00+00:00, run_after=2024-06-27T03:38:00+00:00 2024-06-27T03:37:00.656913433Z [2024-06-27T03:37:00.650+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:37:00+00:00, run_after=2024-06-27T03:38:00+00:00 2024-06-27T03:37:00.660916357Z [2024-06-27T03:37:00.658+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:37:00.741981263Z [2024-06-27T03:37:00.741+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:37:00.742042873Z 2024-06-27T03:37:00.742080484Z 2024-06-27T03:37:00.742093215Z 2024-06-27T03:37:00.742105157Z [2024-06-27T03:37:00.741+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:37:00.742131033Z [2024-06-27T03:37:00.741+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:37:00.742396999Z [2024-06-27T03:37:00.742+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:37:00.743094292Z [2024-06-27T03:37:00.742+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:37:00.743113288Z 2024-06-27T03:37:00.743119910Z 2024-06-27T03:37:00.743125855Z 2024-06-27T03:37:00.749194450Z [2024-06-27T03:37:00.748+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:37:00.749396778Z [2024-06-27T03:37:00.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:37:00.749721322Z [2024-06-27T03:37:00.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:37:00.749904280Z [2024-06-27T03:37:00.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:37:00.750169451Z [2024-06-27T03:37:00.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:37:00.750334784Z [2024-06-27T03:37:00.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:37:00.980609439Z [2024-06-27T03:37:00.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:36:00+00:00 exited with status queued for try_number 1 2024-06-27T03:37:00.980696041Z [2024-06-27T03:37:00.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:36:00+00:00 exited with status queued for try_number 1 2024-06-27T03:37:00.980709640Z [2024-06-27T03:37:00.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:36:00+00:00 exited with status queued for try_number 1 2024-06-27T03:37:00.990211818Z [2024-06-27T03:37:00.989+0000] {scheduler_job.py:635} INFO - Setting external_id for to 571711f5-806c-4a1e-b914-91816a1752b3 2024-06-27T03:37:00.990256229Z [2024-06-27T03:37:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a36fdcb-a37a-4465-a70a-6058c4c20b80 2024-06-27T03:37:00.990372374Z [2024-06-27T03:37:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21420c5b-c10b-4390-83b1-106ae3f0111a 2024-06-27T03:37:02.620050065Z [2024-06-27T03:37:02.619+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:37:02.620417495Z [2024-06-27T03:37:02.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:36:00+00:00, run_id=scheduled__2024-06-27T03:36:00+00:00, run_start_date=2024-06-27 03:37:00.673893+00:00, run_end_date=2024-06-27 03:37:02.619944+00:00, run_duration=1.946051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:36:00+00:00, data_interval_end=2024-06-27 03:37:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:37:02.630621964Z [2024-06-27T03:37:02.630+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:37:00+00:00, run_after=2024-06-27T03:38:00+00:00 2024-06-27T03:37:02.680598476Z [2024-06-27T03:37:02.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:36:00+00:00 exited with status success for try_number 1 2024-06-27T03:37:02.685577010Z [2024-06-27T03:37:02.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:36:00+00:00, map_index=-1, run_start_date=2024-06-27 03:37:01.651368+00:00, run_end_date=2024-06-27 03:37:02.068667+00:00, run_duration=0.417299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:37:00.744149+00:00, queued_by_job_id=2, pid=3062 2024-06-27T03:37:04.862170566Z [2024-06-27T03:37:04.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:37:04.862881151Z [2024-06-27T03:37:04.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:36:00+00:00, run_id=scheduled__2024-06-27T03:36:00+00:00, run_start_date=2024-06-27 03:37:00.675424+00:00, run_end_date=2024-06-27 03:37:04.862113+00:00, run_duration=4.186689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:36:00+00:00, data_interval_end=2024-06-27 03:37:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:37:04.888851762Z [2024-06-27T03:37:04.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:37:00+00:00, run_after=2024-06-27T03:38:00+00:00 2024-06-27T03:37:04.939591170Z [2024-06-27T03:37:04.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:36:00+00:00 exited with status success for try_number 1 2024-06-27T03:37:04.948303397Z [2024-06-27T03:37:04.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:36:00+00:00, map_index=-1, run_start_date=2024-06-27 03:37:02.683280+00:00, run_end_date=2024-06-27 03:37:04.702647+00:00, run_duration=2.019367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:37:00.744149+00:00, queued_by_job_id=2, pid=3093 2024-06-27T03:37:05.994083973Z [2024-06-27T03:37:05.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:37:05.994367163Z [2024-06-27T03:37:05.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:36:00+00:00, run_id=scheduled__2024-06-27T03:36:00+00:00, run_start_date=2024-06-27 03:37:00.676535+00:00, run_end_date=2024-06-27 03:37:05.993931+00:00, run_duration=5.317396, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:36:00+00:00, data_interval_end=2024-06-27 03:37:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:37:06.011699845Z [2024-06-27T03:37:06.011+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:37:00+00:00, run_after=2024-06-27T03:38:00+00:00 2024-06-27T03:37:06.046603012Z [2024-06-27T03:37:06.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:36:00+00:00 exited with status success for try_number 1 2024-06-27T03:37:06.054481826Z [2024-06-27T03:37:06.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:36:00+00:00, map_index=-1, run_start_date=2024-06-27 03:37:02.631968+00:00, run_end_date=2024-06-27 03:37:05.300584+00:00, run_duration=2.668616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:37:00.744149+00:00, queued_by_job_id=2, pid=3092 2024-06-27T03:38:01.014037526Z [2024-06-27T03:38:01.013+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:38:01.026800347Z [2024-06-27T03:38:01.026+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:38:01.048003327Z [2024-06-27T03:38:01.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:38:00+00:00, run_after=2024-06-27T03:39:00+00:00 2024-06-27T03:38:01.068670987Z [2024-06-27T03:38:01.068+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:38:00+00:00, run_after=2024-06-27T03:39:00+00:00 2024-06-27T03:38:01.208212014Z [2024-06-27T03:38:01.207+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:38:01.208287984Z 2024-06-27T03:38:01.208300405Z 2024-06-27T03:38:01.208309688Z 2024-06-27T03:38:01.208318960Z 2024-06-27T03:38:01.208452718Z [2024-06-27T03:38:01.208+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:38:01.208632632Z [2024-06-27T03:38:01.208+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:38:01.208927774Z [2024-06-27T03:38:01.208+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:38:01.209140682Z [2024-06-27T03:38:01.208+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:38:01.210318125Z [2024-06-27T03:38:01.209+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:38:01.210335770Z 2024-06-27T03:38:01.210376168Z 2024-06-27T03:38:01.210385350Z 2024-06-27T03:38:01.210393837Z 2024-06-27T03:38:01.217865000Z [2024-06-27T03:38:01.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:38:01.218155092Z [2024-06-27T03:38:01.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:38:01.218601398Z [2024-06-27T03:38:01.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:38:01.218809940Z [2024-06-27T03:38:01.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:38:01.219043367Z [2024-06-27T03:38:01.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:38:01.219266652Z [2024-06-27T03:38:01.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:38:01.219567901Z [2024-06-27T03:38:01.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:38:01.219587886Z [2024-06-27T03:38:01.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:38:01.719619730Z [2024-06-27T03:38:01.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:36:00+00:00 exited with status queued for try_number 1 2024-06-27T03:38:01.719907596Z [2024-06-27T03:38:01.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:37:00+00:00 exited with status queued for try_number 1 2024-06-27T03:38:01.720284125Z [2024-06-27T03:38:01.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:37:00+00:00 exited with status queued for try_number 1 2024-06-27T03:38:01.720468595Z [2024-06-27T03:38:01.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:37:00+00:00 exited with status queued for try_number 1 2024-06-27T03:38:01.732886224Z [2024-06-27T03:38:01.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ee54055-9ec9-436b-b81c-e80b3bd05330 2024-06-27T03:38:01.733338822Z [2024-06-27T03:38:01.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43798f1b-b229-476f-b944-d3e12fd28349 2024-06-27T03:38:01.733668933Z [2024-06-27T03:38:01.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa83e452-0877-4024-94e9-d881293d1c96 2024-06-27T03:38:01.733939144Z [2024-06-27T03:38:01.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to da35ba51-a8da-41e1-b890-db2567244477 2024-06-27T03:38:02.551790299Z [2024-06-27T03:38:02.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:38:02.552474268Z [2024-06-27T03:38:02.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:36:00+00:00, run_id=scheduled__2024-06-27T03:36:00+00:00, run_start_date=2024-06-27 03:38:01.108577+00:00, run_end_date=2024-06-27 03:38:02.551672+00:00, run_duration=1.443095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:36:00+00:00, data_interval_end=2024-06-27 03:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:38:02.573742360Z [2024-06-27T03:38:02.573+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:38:00+00:00, run_after=2024-06-27T03:40:00+00:00 2024-06-27T03:38:02.659478863Z [2024-06-27T03:38:02.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:36:00+00:00 exited with status success for try_number 1 2024-06-27T03:38:02.665737034Z [2024-06-27T03:38:02.665+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:36:00+00:00, map_index=-1, run_start_date=2024-06-27 03:38:02.010459+00:00, run_end_date=2024-06-27 03:38:02.402946+00:00, run_duration=0.392487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:38:01.212463+00:00, queued_by_job_id=2, pid=3129 2024-06-27T03:38:03.754576768Z [2024-06-27T03:38:03.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:38:03.754707362Z [2024-06-27T03:38:03.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:37:00+00:00, run_id=scheduled__2024-06-27T03:37:00+00:00, run_start_date=2024-06-27 03:38:01.113299+00:00, run_end_date=2024-06-27 03:38:03.754382+00:00, run_duration=2.641083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:37:00+00:00, data_interval_end=2024-06-27 03:38:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:38:03.770682814Z [2024-06-27T03:38:03.770+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:38:00+00:00, run_after=2024-06-27T03:39:00+00:00 2024-06-27T03:38:03.828801303Z [2024-06-27T03:38:03.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:37:00+00:00 exited with status success for try_number 1 2024-06-27T03:38:03.839091405Z [2024-06-27T03:38:03.838+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:37:00+00:00, map_index=-1, run_start_date=2024-06-27 03:38:02.395320+00:00, run_end_date=2024-06-27 03:38:02.792154+00:00, run_duration=0.396834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:38:01.212463+00:00, queued_by_job_id=2, pid=3148 2024-06-27T03:38:06.030233214Z [2024-06-27T03:38:06.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:38:06.030319069Z [2024-06-27T03:38:06.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:37:00+00:00, run_id=scheduled__2024-06-27T03:37:00+00:00, run_start_date=2024-06-27 03:38:01.122229+00:00, run_end_date=2024-06-27 03:38:06.030090+00:00, run_duration=4.907861, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:37:00+00:00, data_interval_end=2024-06-27 03:38:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:38:06.039060229Z [2024-06-27T03:38:06.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:38:00+00:00, run_after=2024-06-27T03:39:00+00:00 2024-06-27T03:38:06.046924733Z [2024-06-27T03:38:06.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:38:06.047068303Z [2024-06-27T03:38:06.046+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:37:00+00:00, run_id=scheduled__2024-06-27T03:37:00+00:00, run_start_date=2024-06-27 03:38:01.120811+00:00, run_end_date=2024-06-27 03:38:06.046772+00:00, run_duration=4.925961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:37:00+00:00, data_interval_end=2024-06-27 03:38:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:38:06.057590107Z [2024-06-27T03:38:06.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:38:00+00:00, run_after=2024-06-27T03:39:00+00:00 2024-06-27T03:38:06.101183460Z [2024-06-27T03:38:06.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:37:00+00:00 exited with status success for try_number 1 2024-06-27T03:38:06.101235413Z [2024-06-27T03:38:06.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:37:00+00:00 exited with status success for try_number 1 2024-06-27T03:38:06.110356285Z [2024-06-27T03:38:06.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:37:00+00:00, map_index=-1, run_start_date=2024-06-27 03:38:03.584685+00:00, run_end_date=2024-06-27 03:38:05.624385+00:00, run_duration=2.0397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:38:01.212463+00:00, queued_by_job_id=2, pid=3178 2024-06-27T03:38:06.110664967Z [2024-06-27T03:38:06.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:37:00+00:00, map_index=-1, run_start_date=2024-06-27 03:38:03.582853+00:00, run_end_date=2024-06-27 03:38:05.114644+00:00, run_duration=1.531791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:38:01.212463+00:00, queued_by_job_id=2, pid=3179 2024-06-27T03:39:00.256452708Z [2024-06-27T03:39:00.255+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:39:00+00:00, run_after=2024-06-27T03:40:00+00:00 2024-06-27T03:39:00.265688275Z [2024-06-27T03:39:00.265+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:39:00.277637814Z [2024-06-27T03:39:00.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:39:00+00:00, run_after=2024-06-27T03:40:00+00:00 2024-06-27T03:39:00.348474309Z [2024-06-27T03:39:00.347+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:39:00.348629487Z 2024-06-27T03:39:00.348638412Z 2024-06-27T03:39:00.348645244Z 2024-06-27T03:39:00.348651837Z [2024-06-27T03:39:00.348+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:39:00.348697081Z [2024-06-27T03:39:00.348+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:39:00.348712233Z [2024-06-27T03:39:00.348+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:39:00.349424400Z [2024-06-27T03:39:00.349+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:39:00.349443758Z 2024-06-27T03:39:00.349450610Z 2024-06-27T03:39:00.349457218Z 2024-06-27T03:39:00.352421744Z [2024-06-27T03:39:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:39:00.352478398Z [2024-06-27T03:39:00.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:39:00.352828581Z [2024-06-27T03:39:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:39:00.352847487Z [2024-06-27T03:39:00.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:39:00.353071488Z [2024-06-27T03:39:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:39:00.353144701Z [2024-06-27T03:39:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:39:00.579001247Z [2024-06-27T03:39:00.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:38:00+00:00 exited with status queued for try_number 1 2024-06-27T03:39:00.579032786Z [2024-06-27T03:39:00.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:38:00+00:00 exited with status queued for try_number 1 2024-06-27T03:39:00.579074790Z [2024-06-27T03:39:00.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:38:00+00:00 exited with status queued for try_number 1 2024-06-27T03:39:00.586583339Z [2024-06-27T03:39:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to b74bb387-d8d7-4953-a960-5bef1a95bbdc 2024-06-27T03:39:00.586611781Z [2024-06-27T03:39:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 827f5d01-6fe9-40ba-98e5-f294b9e79d79 2024-06-27T03:39:00.586691919Z [2024-06-27T03:39:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1bed656-c739-4423-99d9-8454f49d328a 2024-06-27T03:39:02.975179727Z [2024-06-27T03:39:02.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:39:02.975571113Z [2024-06-27T03:39:02.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:38:00+00:00, run_id=scheduled__2024-06-27T03:38:00+00:00, run_start_date=2024-06-27 03:39:00.289639+00:00, run_end_date=2024-06-27 03:39:02.975228+00:00, run_duration=2.685589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:38:00+00:00, data_interval_end=2024-06-27 03:39:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:39:03.007487344Z [2024-06-27T03:39:03.007+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:39:00+00:00, run_after=2024-06-27T03:40:00+00:00 2024-06-27T03:39:03.099685815Z [2024-06-27T03:39:03.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:38:00+00:00 exited with status success for try_number 1 2024-06-27T03:39:03.114354647Z [2024-06-27T03:39:03.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:38:00+00:00, map_index=-1, run_start_date=2024-06-27 03:39:01.325481+00:00, run_end_date=2024-06-27 03:39:01.858495+00:00, run_duration=0.533014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:39:00.349976+00:00, queued_by_job_id=2, pid=3223 2024-06-27T03:39:04.760511434Z [2024-06-27T03:39:04.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:39:04.760955364Z [2024-06-27T03:39:04.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:38:00+00:00, run_id=scheduled__2024-06-27T03:38:00+00:00, run_start_date=2024-06-27 03:39:00.292140+00:00, run_end_date=2024-06-27 03:39:04.760361+00:00, run_duration=4.468221, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:38:00+00:00, data_interval_end=2024-06-27 03:39:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:39:04.771204658Z [2024-06-27T03:39:04.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:39:00+00:00, run_after=2024-06-27T03:40:00+00:00 2024-06-27T03:39:04.781093342Z [2024-06-27T03:39:04.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:39:04.781410481Z [2024-06-27T03:39:04.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:38:00+00:00, run_id=scheduled__2024-06-27T03:38:00+00:00, run_start_date=2024-06-27 03:39:00.291103+00:00, run_end_date=2024-06-27 03:39:04.780946+00:00, run_duration=4.489843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:38:00+00:00, data_interval_end=2024-06-27 03:39:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:39:04.792988362Z [2024-06-27T03:39:04.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:39:00+00:00, run_after=2024-06-27T03:40:00+00:00 2024-06-27T03:39:04.853713708Z [2024-06-27T03:39:04.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:38:00+00:00 exited with status success for try_number 1 2024-06-27T03:39:04.853832201Z [2024-06-27T03:39:04.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:38:00+00:00 exited with status success for try_number 1 2024-06-27T03:39:04.868192221Z [2024-06-27T03:39:04.866+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:38:00+00:00, map_index=-1, run_start_date=2024-06-27 03:39:02.443540+00:00, run_end_date=2024-06-27 03:39:04.498695+00:00, run_duration=2.055155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:39:00.349976+00:00, queued_by_job_id=2, pid=3253 2024-06-27T03:39:04.868322841Z [2024-06-27T03:39:04.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:38:00+00:00, map_index=-1, run_start_date=2024-06-27 03:39:02.692180+00:00, run_end_date=2024-06-27 03:39:04.408425+00:00, run_duration=1.716245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:39:00.349976+00:00, queued_by_job_id=2, pid=3254 2024-06-27T03:40:00.635536341Z [2024-06-27T03:40:00.634+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:40:00.662816925Z [2024-06-27T03:40:00.662+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:40:00+00:00, run_after=2024-06-27T03:41:00+00:00 2024-06-27T03:40:00.678833315Z [2024-06-27T03:40:00.678+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:40:00+00:00, run_after=2024-06-27T03:45:00+00:00 2024-06-27T03:40:00.686552520Z [2024-06-27T03:40:00.686+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:40:00.700157212Z [2024-06-27T03:40:00.699+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:40:00+00:00, run_after=2024-06-27T03:41:00+00:00 2024-06-27T03:40:00.795707016Z [2024-06-27T03:40:00.794+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T03:40:00.795750788Z 2024-06-27T03:40:00.795760903Z 2024-06-27T03:40:00.795771250Z 2024-06-27T03:40:00.795781042Z 2024-06-27T03:40:00.795831335Z 2024-06-27T03:40:00.795840388Z [2024-06-27T03:40:00.795+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:40:00.796103883Z [2024-06-27T03:40:00.795+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:40:00.796298553Z [2024-06-27T03:40:00.796+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:40:00.796476239Z [2024-06-27T03:40:00.796+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:40:00.796687500Z [2024-06-27T03:40:00.796+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:40:00.799360753Z [2024-06-27T03:40:00.798+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:40:00.799380418Z 2024-06-27T03:40:00.799384799Z 2024-06-27T03:40:00.799389136Z 2024-06-27T03:40:00.799392546Z 2024-06-27T03:40:00.799410209Z 2024-06-27T03:40:00.806885164Z [2024-06-27T03:40:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T03:40:00.807117743Z [2024-06-27T03:40:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:40:00.807585791Z [2024-06-27T03:40:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:40:00.807852174Z [2024-06-27T03:40:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:40:00.808326333Z [2024-06-27T03:40:00.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:40:00.808605883Z [2024-06-27T03:40:00.808+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:40:00.809128385Z [2024-06-27T03:40:00.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:40:00.809459726Z [2024-06-27T03:40:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:40:00.809977389Z [2024-06-27T03:40:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:40:00.810055953Z [2024-06-27T03:40:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:40:01.338596143Z [2024-06-27T03:40:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status queued for try_number 1 2024-06-27T03:40:01.338808770Z [2024-06-27T03:40:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:38:00+00:00 exited with status queued for try_number 1 2024-06-27T03:40:01.338957592Z [2024-06-27T03:40:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:39:00+00:00 exited with status queued for try_number 1 2024-06-27T03:40:01.339076954Z [2024-06-27T03:40:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:39:00+00:00 exited with status queued for try_number 1 2024-06-27T03:40:01.339180409Z [2024-06-27T03:40:01.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:39:00+00:00 exited with status queued for try_number 1 2024-06-27T03:40:01.355292435Z [2024-06-27T03:40:01.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ff5d525-5000-492c-aa94-5d4825124ff4 2024-06-27T03:40:01.355468518Z [2024-06-27T03:40:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39fb4548-c029-4b71-9a68-863f873a7975 2024-06-27T03:40:01.355622697Z [2024-06-27T03:40:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0a11291-3136-4001-9d24-2ff8cbe546c8 2024-06-27T03:40:01.355765822Z [2024-06-27T03:40:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f1e986e-f0e6-4045-a987-ff81ddd9bafd 2024-06-27T03:40:01.355912736Z [2024-06-27T03:40:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fc7f384-9495-430f-89e4-e5ce91332587 2024-06-27T03:40:04.030198720Z [2024-06-27T03:40:04.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:40:04.030437915Z [2024-06-27T03:40:04.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:39:00+00:00, run_id=scheduled__2024-06-27T03:39:00+00:00, run_start_date=2024-06-27 03:40:00.713696+00:00, run_end_date=2024-06-27 03:40:04.030123+00:00, run_duration=3.316427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:39:00+00:00, data_interval_end=2024-06-27 03:40:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:40:04.042594097Z [2024-06-27T03:40:04.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:40:00+00:00, run_after=2024-06-27T03:41:00+00:00 2024-06-27T03:40:04.074996946Z [2024-06-27T03:40:04.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:40:04.075136921Z [2024-06-27T03:40:04.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:38:00+00:00, run_id=scheduled__2024-06-27T03:38:00+00:00, run_start_date=2024-06-27 03:40:00.711987+00:00, run_end_date=2024-06-27 03:40:04.074882+00:00, run_duration=3.362895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:38:00+00:00, data_interval_end=2024-06-27 03:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:40:04.084785165Z [2024-06-27T03:40:04.084+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:40:00+00:00, run_after=2024-06-27T03:42:00+00:00 2024-06-27T03:40:04.181281577Z [2024-06-27T03:40:04.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:38:00+00:00 exited with status success for try_number 1 2024-06-27T03:40:04.181458937Z [2024-06-27T03:40:04.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:39:00+00:00 exited with status success for try_number 1 2024-06-27T03:40:04.188438338Z [2024-06-27T03:40:04.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:39:00+00:00, map_index=-1, run_start_date=2024-06-27 03:40:02.295312+00:00, run_end_date=2024-06-27 03:40:03.134678+00:00, run_duration=0.839366, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:40:00.802593+00:00, queued_by_job_id=2, pid=3300 2024-06-27T03:40:04.188476188Z [2024-06-27T03:40:04.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:38:00+00:00, map_index=-1, run_start_date=2024-06-27 03:40:02.139725+00:00, run_end_date=2024-06-27 03:40:02.816171+00:00, run_duration=0.676446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:40:00.802593+00:00, queued_by_job_id=2, pid=3299 2024-06-27T03:40:04.378841699Z [2024-06-27T03:40:04.378+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T03:40:04.673441463Z [2024-06-27T03:40:04.673+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:40:04.673467246Z 2024-06-27T03:40:04.673683836Z [2024-06-27T03:40:04.673+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:40:04.674379622Z [2024-06-27T03:40:04.674+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:40:04.674391821Z 2024-06-27T03:40:04.676639608Z [2024-06-27T03:40:04.676+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:40:04.676915873Z [2024-06-27T03:40:04.676+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:40:04.732479340Z [2024-06-27T03:40:04.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status queued for try_number 1 2024-06-27T03:40:04.732503689Z [2024-06-27T03:40:04.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status success for try_number 1 2024-06-27T03:40:04.743564659Z [2024-06-27T03:40:04.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0b5421f-5a75-4ca2-8c05-5df5d2da7664 2024-06-27T03:40:04.743898804Z [2024-06-27T03:40:04.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:35:00+00:00, map_index=-1, run_start_date=2024-06-27 03:40:03.939594+00:00, run_end_date=2024-06-27 03:40:04.435944+00:00, run_duration=0.49635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:40:00.802593+00:00, queued_by_job_id=2, pid=3350 2024-06-27T03:40:05.931292806Z [2024-06-27T03:40:05.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:40:05.931672787Z [2024-06-27T03:40:05.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:39:00+00:00, run_id=scheduled__2024-06-27T03:39:00+00:00, run_start_date=2024-06-27 03:40:00.715801+00:00, run_end_date=2024-06-27 03:40:05.931233+00:00, run_duration=5.215432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:39:00+00:00, data_interval_end=2024-06-27 03:40:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:40:05.943580360Z [2024-06-27T03:40:05.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:40:00+00:00, run_after=2024-06-27T03:41:00+00:00 2024-06-27T03:40:05.951476084Z [2024-06-27T03:40:05.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:40:05.951579181Z [2024-06-27T03:40:05.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:39:00+00:00, run_id=scheduled__2024-06-27T03:39:00+00:00, run_start_date=2024-06-27 03:40:00.714789+00:00, run_end_date=2024-06-27 03:40:05.951301+00:00, run_duration=5.236512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:39:00+00:00, data_interval_end=2024-06-27 03:40:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:40:05.965476222Z [2024-06-27T03:40:05.964+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:40:00+00:00, run_after=2024-06-27T03:41:00+00:00 2024-06-27T03:40:06.031291007Z [2024-06-27T03:40:06.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:39:00+00:00 exited with status success for try_number 1 2024-06-27T03:40:06.031323227Z [2024-06-27T03:40:06.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:39:00+00:00 exited with status success for try_number 1 2024-06-27T03:40:06.038447205Z [2024-06-27T03:40:06.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:39:00+00:00, map_index=-1, run_start_date=2024-06-27 03:40:03.835881+00:00, run_end_date=2024-06-27 03:40:05.781451+00:00, run_duration=1.94557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:40:00.802593+00:00, queued_by_job_id=2, pid=3348 2024-06-27T03:40:06.038685600Z [2024-06-27T03:40:06.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:39:00+00:00, map_index=-1, run_start_date=2024-06-27 03:40:04.214501+00:00, run_end_date=2024-06-27 03:40:05.606824+00:00, run_duration=1.392323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:40:00.802593+00:00, queued_by_job_id=2, pid=3360 2024-06-27T03:40:07.118222290Z [2024-06-27T03:40:07.117+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:40:07.118243496Z 2024-06-27T03:40:07.118553287Z [2024-06-27T03:40:07.118+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:40:07.119197885Z [2024-06-27T03:40:07.118+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:40:07.119208865Z 2024-06-27T03:40:07.121807958Z [2024-06-27T03:40:07.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T03:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T03:40:07.121989497Z [2024-06-27T03:40:07.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T03:40:07.196738331Z [2024-06-27T03:40:07.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status queued for try_number 1 2024-06-27T03:40:07.197122169Z [2024-06-27T03:40:07.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status success for try_number 1 2024-06-27T03:40:07.211576988Z [2024-06-27T03:40:07.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c88f834-7252-4a08-bd52-3a1631bf179e 2024-06-27T03:40:07.211971264Z [2024-06-27T03:40:07.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T03:35:00+00:00, map_index=-1, run_start_date=2024-06-27 03:40:06.342920+00:00, run_end_date=2024-06-27 03:40:06.747046+00:00, run_duration=0.404126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:40:04.674750+00:00, queued_by_job_id=2, pid=3390 2024-06-27T03:40:09.545428893Z [2024-06-27T03:40:09.545+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:40:09.545458185Z 2024-06-27T03:40:09.545463199Z [2024-06-27T03:40:09.545+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:40:09.545918890Z [2024-06-27T03:40:09.545+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:40:09.545929723Z 2024-06-27T03:40:09.548259061Z [2024-06-27T03:40:09.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:40:09.548385991Z [2024-06-27T03:40:09.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:40:09.607332239Z [2024-06-27T03:40:09.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status queued for try_number 1 2024-06-27T03:40:09.607358747Z [2024-06-27T03:40:09.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status success for try_number 1 2024-06-27T03:40:09.613242639Z [2024-06-27T03:40:09.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85789a23-5e53-44f0-86ce-7a3bf9d310eb 2024-06-27T03:40:09.613389825Z [2024-06-27T03:40:09.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T03:35:00+00:00, map_index=0, run_start_date=2024-06-27 03:40:09.066249+00:00, run_end_date=2024-06-27 03:40:09.449794+00:00, run_duration=0.383545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:40:07.119612+00:00, queued_by_job_id=2, pid=3402 2024-06-27T03:40:12.572730685Z [2024-06-27T03:40:12.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:40:12.573395009Z [2024-06-27T03:40:12.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:35:00+00:00, run_id=scheduled__2024-06-27T03:35:00+00:00, run_start_date=2024-06-27 03:40:00.710667+00:00, run_end_date=2024-06-27 03:40:12.572555+00:00, run_duration=11.861888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:35:00+00:00, data_interval_end=2024-06-27 03:40:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T03:40:12.584407275Z [2024-06-27T03:40:12.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:40:00+00:00, run_after=2024-06-27T03:45:00+00:00 2024-06-27T03:40:12.641254340Z [2024-06-27T03:40:12.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:35:00+00:00 exited with status success for try_number 1 2024-06-27T03:40:12.648940361Z [2024-06-27T03:40:12.648+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T03:35:00+00:00, map_index=-1, run_start_date=2024-06-27 03:40:11.312165+00:00, run_end_date=2024-06-27 03:40:11.673885+00:00, run_duration=0.36172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:40:09.546248+00:00, queued_by_job_id=2, pid=3414 2024-06-27T03:41:00.683417317Z [2024-06-27T03:41:00.682+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:41:00.710242060Z [2024-06-27T03:41:00.709+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:41:00+00:00, run_after=2024-06-27T03:42:00+00:00 2024-06-27T03:41:00.725098732Z [2024-06-27T03:41:00.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:41:00+00:00, run_after=2024-06-27T03:42:00+00:00 2024-06-27T03:41:00.812031794Z [2024-06-27T03:41:00.811+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:41:00.812058054Z 2024-06-27T03:41:00.812076811Z 2024-06-27T03:41:00.812079948Z 2024-06-27T03:41:00.812082833Z [2024-06-27T03:41:00.811+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:41:00.812430390Z [2024-06-27T03:41:00.811+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:41:00.812644044Z [2024-06-27T03:41:00.812+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:41:00.813350330Z [2024-06-27T03:41:00.813+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:41:00.813362347Z 2024-06-27T03:41:00.813365755Z 2024-06-27T03:41:00.813368799Z 2024-06-27T03:41:00.817092557Z [2024-06-27T03:41:00.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:41:00.817335844Z [2024-06-27T03:41:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:41:00.817614459Z [2024-06-27T03:41:00.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:41:00.817711329Z [2024-06-27T03:41:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:41:00.818113383Z [2024-06-27T03:41:00.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:41:00.818343330Z [2024-06-27T03:41:00.818+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:41:01.041849877Z [2024-06-27T03:41:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status queued for try_number 1 2024-06-27T03:41:01.041987749Z [2024-06-27T03:41:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status queued for try_number 1 2024-06-27T03:41:01.042110880Z [2024-06-27T03:41:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status queued for try_number 1 2024-06-27T03:41:01.051127851Z [2024-06-27T03:41:01.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to 951536d6-536a-4349-9910-805169233f7a 2024-06-27T03:41:01.052224627Z [2024-06-27T03:41:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12796769-fc59-43cd-9de3-0cf2dce96d03 2024-06-27T03:41:01.052510322Z [2024-06-27T03:41:01.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4c637f3-9027-4c6d-ad4e-c707b4301549 2024-06-27T03:41:02.969103580Z [2024-06-27T03:41:02.968+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:41:02.969333225Z [2024-06-27T03:41:02.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:40:00+00:00, run_id=scheduled__2024-06-27T03:40:00+00:00, run_start_date=2024-06-27 03:41:00.739723+00:00, run_end_date=2024-06-27 03:41:02.969016+00:00, run_duration=2.229293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:40:00+00:00, data_interval_end=2024-06-27 03:41:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:41:02.978441695Z [2024-06-27T03:41:02.978+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:41:00+00:00, run_after=2024-06-27T03:42:00+00:00 2024-06-27T03:41:03.044391050Z [2024-06-27T03:41:03.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status success for try_number 1 2024-06-27T03:41:03.050883267Z [2024-06-27T03:41:03.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:40:00+00:00, map_index=-1, run_start_date=2024-06-27 03:41:01.845210+00:00, run_end_date=2024-06-27 03:41:02.273779+00:00, run_duration=0.428569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:41:00.814060+00:00, queued_by_job_id=2, pid=3441 2024-06-27T03:41:05.223754162Z [2024-06-27T03:41:05.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:41:05.223927249Z [2024-06-27T03:41:05.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:40:00+00:00, run_id=scheduled__2024-06-27T03:40:00+00:00, run_start_date=2024-06-27 03:41:00.741341+00:00, run_end_date=2024-06-27 03:41:05.223418+00:00, run_duration=4.482077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:40:00+00:00, data_interval_end=2024-06-27 03:41:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:41:05.236354851Z [2024-06-27T03:41:05.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:41:00+00:00, run_after=2024-06-27T03:42:00+00:00 2024-06-27T03:41:05.290319679Z [2024-06-27T03:41:05.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status success for try_number 1 2024-06-27T03:41:05.303756388Z [2024-06-27T03:41:05.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:40:00+00:00, map_index=-1, run_start_date=2024-06-27 03:41:03.094221+00:00, run_end_date=2024-06-27 03:41:04.449576+00:00, run_duration=1.355355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:41:00.814060+00:00, queued_by_job_id=2, pid=3471 2024-06-27T03:41:06.142689412Z [2024-06-27T03:41:06.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:41:06.143356607Z [2024-06-27T03:41:06.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:40:00+00:00, run_id=scheduled__2024-06-27T03:40:00+00:00, run_start_date=2024-06-27 03:41:00.742497+00:00, run_end_date=2024-06-27 03:41:06.142774+00:00, run_duration=5.400277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:40:00+00:00, data_interval_end=2024-06-27 03:41:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:41:06.160267373Z [2024-06-27T03:41:06.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:41:00+00:00, run_after=2024-06-27T03:42:00+00:00 2024-06-27T03:41:06.209558454Z [2024-06-27T03:41:06.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status success for try_number 1 2024-06-27T03:41:06.215343908Z [2024-06-27T03:41:06.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:40:00+00:00, map_index=-1, run_start_date=2024-06-27 03:41:03.242642+00:00, run_end_date=2024-06-27 03:41:05.329898+00:00, run_duration=2.087256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:41:00.814060+00:00, queued_by_job_id=2, pid=3472 2024-06-27T03:42:01.068867224Z [2024-06-27T03:42:01.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:42:00+00:00, run_after=2024-06-27T03:43:00+00:00 2024-06-27T03:42:01.081833780Z [2024-06-27T03:42:01.080+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:42:01.092411866Z [2024-06-27T03:42:01.091+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:42:01.109258080Z [2024-06-27T03:42:01.108+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:42:00+00:00, run_after=2024-06-27T03:43:00+00:00 2024-06-27T03:42:01.210018693Z [2024-06-27T03:42:01.209+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:42:01.210048785Z 2024-06-27T03:42:01.210053895Z 2024-06-27T03:42:01.210058098Z 2024-06-27T03:42:01.210061797Z 2024-06-27T03:42:01.210197131Z [2024-06-27T03:42:01.209+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:42:01.210409493Z [2024-06-27T03:42:01.210+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:42:01.210642265Z [2024-06-27T03:42:01.210+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:42:01.210840473Z [2024-06-27T03:42:01.210+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:42:01.212247974Z [2024-06-27T03:42:01.211+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:42:01.212255299Z 2024-06-27T03:42:01.212259479Z 2024-06-27T03:42:01.212263584Z 2024-06-27T03:42:01.212281253Z 2024-06-27T03:42:01.219334438Z [2024-06-27T03:42:01.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:42:01.219469936Z [2024-06-27T03:42:01.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:42:01.219762367Z [2024-06-27T03:42:01.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:42:01.219950639Z [2024-06-27T03:42:01.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:42:01.220256840Z [2024-06-27T03:42:01.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:42:01.220436035Z [2024-06-27T03:42:01.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:42:01.220733631Z [2024-06-27T03:42:01.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:42:01.220901449Z [2024-06-27T03:42:01.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:42:01.567782295Z [2024-06-27T03:42:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status queued for try_number 1 2024-06-27T03:42:01.568186499Z [2024-06-27T03:42:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:41:00+00:00 exited with status queued for try_number 1 2024-06-27T03:42:01.568428711Z [2024-06-27T03:42:01.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:41:00+00:00 exited with status queued for try_number 1 2024-06-27T03:42:01.568635924Z [2024-06-27T03:42:01.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:41:00+00:00 exited with status queued for try_number 1 2024-06-27T03:42:01.578075764Z [2024-06-27T03:42:01.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6ecdee7-d2c1-4695-9cb9-c070de089ac7 2024-06-27T03:42:01.578780087Z [2024-06-27T03:42:01.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to e71e3d66-7526-4f20-b19f-fc94cf41cc52 2024-06-27T03:42:01.579146044Z [2024-06-27T03:42:01.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa827dcc-13b3-4e55-828a-8576f53b2318 2024-06-27T03:42:01.579494818Z [2024-06-27T03:42:01.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to e30bb577-7497-4cc2-9060-2bd3f7413813 2024-06-27T03:42:03.436109475Z [2024-06-27T03:42:03.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:42:03.436344205Z [2024-06-27T03:42:03.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:40:00+00:00, run_id=scheduled__2024-06-27T03:40:00+00:00, run_start_date=2024-06-27 03:42:01.133596+00:00, run_end_date=2024-06-27 03:42:03.435961+00:00, run_duration=2.302365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:40:00+00:00, data_interval_end=2024-06-27 03:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:42:03.444080910Z [2024-06-27T03:42:03.443+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:42:00+00:00, run_after=2024-06-27T03:44:00+00:00 2024-06-27T03:42:03.465937256Z [2024-06-27T03:42:03.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:42:03.466118761Z [2024-06-27T03:42:03.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:41:00+00:00, run_id=scheduled__2024-06-27T03:41:00+00:00, run_start_date=2024-06-27 03:42:01.139116+00:00, run_end_date=2024-06-27 03:42:03.465870+00:00, run_duration=2.326754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:41:00+00:00, data_interval_end=2024-06-27 03:42:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:42:03.482346535Z [2024-06-27T03:42:03.482+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:42:00+00:00, run_after=2024-06-27T03:43:00+00:00 2024-06-27T03:42:03.523367232Z [2024-06-27T03:42:03.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status success for try_number 1 2024-06-27T03:42:03.523453127Z [2024-06-27T03:42:03.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:41:00+00:00 exited with status success for try_number 1 2024-06-27T03:42:03.534243870Z [2024-06-27T03:42:03.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:40:00+00:00, map_index=-1, run_start_date=2024-06-27 03:42:02.270151+00:00, run_end_date=2024-06-27 03:42:02.791390+00:00, run_duration=0.521239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:42:01.214417+00:00, queued_by_job_id=2, pid=3518 2024-06-27T03:42:03.535101420Z [2024-06-27T03:42:03.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:41:00+00:00, map_index=-1, run_start_date=2024-06-27 03:42:02.212808+00:00, run_end_date=2024-06-27 03:42:02.687085+00:00, run_duration=0.474277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:42:01.214417+00:00, queued_by_job_id=2, pid=3517 2024-06-27T03:42:05.681690880Z [2024-06-27T03:42:05.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:42:05.682191558Z [2024-06-27T03:42:05.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:41:00+00:00, run_id=scheduled__2024-06-27T03:41:00+00:00, run_start_date=2024-06-27 03:42:01.135991+00:00, run_end_date=2024-06-27 03:42:05.681537+00:00, run_duration=4.545546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:41:00+00:00, data_interval_end=2024-06-27 03:42:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:42:05.703233776Z [2024-06-27T03:42:05.702+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:42:00+00:00, run_after=2024-06-27T03:43:00+00:00 2024-06-27T03:42:05.753934915Z [2024-06-27T03:42:05.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:41:00+00:00 exited with status success for try_number 1 2024-06-27T03:42:05.760838229Z [2024-06-27T03:42:05.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:41:00+00:00, map_index=-1, run_start_date=2024-06-27 03:42:03.431143+00:00, run_end_date=2024-06-27 03:42:05.337092+00:00, run_duration=1.905949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:42:01.214417+00:00, queued_by_job_id=2, pid=3555 2024-06-27T03:42:06.826460434Z [2024-06-27T03:42:06.825+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:42:06.826648699Z [2024-06-27T03:42:06.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:41:00+00:00, run_id=scheduled__2024-06-27T03:41:00+00:00, run_start_date=2024-06-27 03:42:01.137963+00:00, run_end_date=2024-06-27 03:42:06.826305+00:00, run_duration=5.688342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:41:00+00:00, data_interval_end=2024-06-27 03:42:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:42:06.842123894Z [2024-06-27T03:42:06.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:42:00+00:00, run_after=2024-06-27T03:43:00+00:00 2024-06-27T03:42:06.883748206Z [2024-06-27T03:42:06.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:41:00+00:00 exited with status success for try_number 1 2024-06-27T03:42:06.891189796Z [2024-06-27T03:42:06.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:41:00+00:00, map_index=-1, run_start_date=2024-06-27 03:42:03.626135+00:00, run_end_date=2024-06-27 03:42:05.944186+00:00, run_duration=2.318051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:42:01.214417+00:00, queued_by_job_id=2, pid=3558 2024-06-27T03:43:00.168520073Z [2024-06-27T03:43:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:43:00+00:00, run_after=2024-06-27T03:44:00+00:00 2024-06-27T03:43:00.176463016Z [2024-06-27T03:43:00.176+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:43:00.190929070Z [2024-06-27T03:43:00.190+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:43:00+00:00, run_after=2024-06-27T03:44:00+00:00 2024-06-27T03:43:00.279323570Z [2024-06-27T03:43:00.278+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:43:00.279364869Z 2024-06-27T03:43:00.279370818Z 2024-06-27T03:43:00.279375507Z 2024-06-27T03:43:00.279387963Z [2024-06-27T03:43:00.279+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:43:00.279531669Z [2024-06-27T03:43:00.279+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:43:00.279624623Z [2024-06-27T03:43:00.279+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:43:00.280250173Z [2024-06-27T03:43:00.280+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:43:00.280259465Z 2024-06-27T03:43:00.280262686Z 2024-06-27T03:43:00.280266016Z 2024-06-27T03:43:00.285222522Z [2024-06-27T03:43:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:43:00.285263530Z [2024-06-27T03:43:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:43:00.285498495Z [2024-06-27T03:43:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:43:00.285566648Z [2024-06-27T03:43:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:43:00.285743710Z [2024-06-27T03:43:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:43:00.285794163Z [2024-06-27T03:43:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:43:00.546959439Z [2024-06-27T03:43:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:42:00+00:00 exited with status queued for try_number 1 2024-06-27T03:43:00.546997630Z [2024-06-27T03:43:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:42:00+00:00 exited with status queued for try_number 1 2024-06-27T03:43:00.547007690Z [2024-06-27T03:43:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:42:00+00:00 exited with status queued for try_number 1 2024-06-27T03:43:00.564258586Z [2024-06-27T03:43:00.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69204be4-5293-4a94-b796-c8027ab4ed17 2024-06-27T03:43:00.564292934Z [2024-06-27T03:43:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e907270-cac3-4a00-b422-cd7ec28322d0 2024-06-27T03:43:00.564478400Z [2024-06-27T03:43:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba65ece0-7bdd-473e-b403-3efd2035fce2 2024-06-27T03:43:01.734235647Z [2024-06-27T03:43:01.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:43:01.734717220Z [2024-06-27T03:43:01.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:42:00+00:00, run_id=scheduled__2024-06-27T03:42:00+00:00, run_start_date=2024-06-27 03:43:00.207862+00:00, run_end_date=2024-06-27 03:43:01.734231+00:00, run_duration=1.526369, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:42:00+00:00, data_interval_end=2024-06-27 03:43:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:43:01.752558471Z [2024-06-27T03:43:01.752+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:43:00+00:00, run_after=2024-06-27T03:44:00+00:00 2024-06-27T03:43:01.791120782Z [2024-06-27T03:43:01.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:42:00+00:00 exited with status success for try_number 1 2024-06-27T03:43:01.797064138Z [2024-06-27T03:43:01.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:42:00+00:00, map_index=-1, run_start_date=2024-06-27 03:43:01.116625+00:00, run_end_date=2024-06-27 03:43:01.559619+00:00, run_duration=0.442994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:43:00.281576+00:00, queued_by_job_id=2, pid=3602 2024-06-27T03:43:04.212489283Z [2024-06-27T03:43:04.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:43:04.212917949Z [2024-06-27T03:43:04.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:42:00+00:00, run_id=scheduled__2024-06-27T03:42:00+00:00, run_start_date=2024-06-27 03:43:00.205235+00:00, run_end_date=2024-06-27 03:43:04.212383+00:00, run_duration=4.007148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:42:00+00:00, data_interval_end=2024-06-27 03:43:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:43:04.224060012Z [2024-06-27T03:43:04.223+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:43:00+00:00, run_after=2024-06-27T03:44:00+00:00 2024-06-27T03:43:04.262903633Z [2024-06-27T03:43:04.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:42:00+00:00 exited with status success for try_number 1 2024-06-27T03:43:04.269704058Z [2024-06-27T03:43:04.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:42:00+00:00, map_index=-1, run_start_date=2024-06-27 03:43:02.402625+00:00, run_end_date=2024-06-27 03:43:03.807208+00:00, run_duration=1.404583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:43:00.281576+00:00, queued_by_job_id=2, pid=3632 2024-06-27T03:43:05.355183210Z [2024-06-27T03:43:05.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:43:05.355208467Z [2024-06-27T03:43:05.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:42:00+00:00, run_id=scheduled__2024-06-27T03:42:00+00:00, run_start_date=2024-06-27 03:43:00.206662+00:00, run_end_date=2024-06-27 03:43:05.353759+00:00, run_duration=5.147097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:42:00+00:00, data_interval_end=2024-06-27 03:43:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:43:05.376033012Z [2024-06-27T03:43:05.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:43:00+00:00, run_after=2024-06-27T03:44:00+00:00 2024-06-27T03:43:05.413411701Z [2024-06-27T03:43:05.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:42:00+00:00 exited with status success for try_number 1 2024-06-27T03:43:05.419772242Z [2024-06-27T03:43:05.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:42:00+00:00, map_index=-1, run_start_date=2024-06-27 03:43:02.405584+00:00, run_end_date=2024-06-27 03:43:04.234361+00:00, run_duration=1.828777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:43:00.281576+00:00, queued_by_job_id=2, pid=3631 2024-06-27T03:44:00.795834400Z [2024-06-27T03:44:00.784+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:44:00.815342273Z [2024-06-27T03:44:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:44:00+00:00, run_after=2024-06-27T03:45:00+00:00 2024-06-27T03:44:00.825187099Z [2024-06-27T03:44:00.824+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:44:00.851562880Z [2024-06-27T03:44:00.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:44:00+00:00, run_after=2024-06-27T03:45:00+00:00 2024-06-27T03:44:00.952946503Z [2024-06-27T03:44:00.952+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:44:00.952988612Z 2024-06-27T03:44:00.952993654Z 2024-06-27T03:44:00.952997016Z 2024-06-27T03:44:00.953000276Z 2024-06-27T03:44:00.953326738Z [2024-06-27T03:44:00.953+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:44:00.953698543Z [2024-06-27T03:44:00.953+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:44:00.954069158Z [2024-06-27T03:44:00.953+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:44:00.954291236Z [2024-06-27T03:44:00.954+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:44:00.955109038Z [2024-06-27T03:44:00.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:44:00.955120495Z 2024-06-27T03:44:00.955126830Z 2024-06-27T03:44:00.955132582Z 2024-06-27T03:44:00.955138234Z 2024-06-27T03:44:00.962194226Z [2024-06-27T03:44:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:44:00.962564409Z [2024-06-27T03:44:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:44:00.963235991Z [2024-06-27T03:44:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:44:00.963583741Z [2024-06-27T03:44:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:44:00.964069686Z [2024-06-27T03:44:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:44:00.964349745Z [2024-06-27T03:44:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:44:00.964890764Z [2024-06-27T03:44:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:44:00.965264347Z [2024-06-27T03:44:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:44:01.444915083Z [2024-06-27T03:44:01.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:42:00+00:00 exited with status queued for try_number 1 2024-06-27T03:44:01.445251437Z [2024-06-27T03:44:01.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:43:00+00:00 exited with status queued for try_number 1 2024-06-27T03:44:01.445438603Z [2024-06-27T03:44:01.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:43:00+00:00 exited with status queued for try_number 1 2024-06-27T03:44:01.445663595Z [2024-06-27T03:44:01.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:43:00+00:00 exited with status queued for try_number 1 2024-06-27T03:44:01.455072423Z [2024-06-27T03:44:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e603093-afc9-4fe3-851d-cda3801ef49c 2024-06-27T03:44:01.455289498Z [2024-06-27T03:44:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5d5943f-d613-42f5-8066-0b8d03c2523e 2024-06-27T03:44:01.455495988Z [2024-06-27T03:44:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fd142dc-2ae1-4d58-8de8-cbb6d029567a 2024-06-27T03:44:01.455695598Z [2024-06-27T03:44:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3eafd7d7-13e9-44dc-b9b0-f757385f6750 2024-06-27T03:44:02.598154929Z [2024-06-27T03:44:02.597+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:44:02.598585659Z [2024-06-27T03:44:02.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:42:00+00:00, run_id=scheduled__2024-06-27T03:42:00+00:00, run_start_date=2024-06-27 03:44:00.866610+00:00, run_end_date=2024-06-27 03:44:02.598222+00:00, run_duration=1.731612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:42:00+00:00, data_interval_end=2024-06-27 03:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:44:02.606030836Z [2024-06-27T03:44:02.605+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:44:00+00:00, run_after=2024-06-27T03:46:00+00:00 2024-06-27T03:44:02.612644954Z [2024-06-27T03:44:02.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:44:02.613007201Z [2024-06-27T03:44:02.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:43:00+00:00, run_id=scheduled__2024-06-27T03:43:00+00:00, run_start_date=2024-06-27 03:44:00.868026+00:00, run_end_date=2024-06-27 03:44:02.612713+00:00, run_duration=1.744687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:43:00+00:00, data_interval_end=2024-06-27 03:44:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:44:02.622659325Z [2024-06-27T03:44:02.622+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:44:00+00:00, run_after=2024-06-27T03:45:00+00:00 2024-06-27T03:44:02.677682228Z [2024-06-27T03:44:02.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:42:00+00:00 exited with status success for try_number 1 2024-06-27T03:44:02.678160088Z [2024-06-27T03:44:02.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:43:00+00:00 exited with status success for try_number 1 2024-06-27T03:44:02.688425046Z [2024-06-27T03:44:02.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:42:00+00:00, map_index=-1, run_start_date=2024-06-27 03:44:01.965335+00:00, run_end_date=2024-06-27 03:44:02.367684+00:00, run_duration=0.402349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:44:00.956618+00:00, queued_by_job_id=2, pid=3677 2024-06-27T03:44:02.688844800Z [2024-06-27T03:44:02.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:43:00+00:00, map_index=-1, run_start_date=2024-06-27 03:44:02.019261+00:00, run_end_date=2024-06-27 03:44:02.445634+00:00, run_duration=0.426373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:44:00.956618+00:00, queued_by_job_id=2, pid=3678 2024-06-27T03:44:06.278391797Z [2024-06-27T03:44:06.277+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:44:06.278704981Z [2024-06-27T03:44:06.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:43:00+00:00, run_id=scheduled__2024-06-27T03:43:00+00:00, run_start_date=2024-06-27 03:44:00.869332+00:00, run_end_date=2024-06-27 03:44:06.278377+00:00, run_duration=5.409045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:43:00+00:00, data_interval_end=2024-06-27 03:44:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:44:06.289615159Z [2024-06-27T03:44:06.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:44:00+00:00, run_after=2024-06-27T03:45:00+00:00 2024-06-27T03:44:06.296561225Z [2024-06-27T03:44:06.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:44:06.296834599Z [2024-06-27T03:44:06.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:43:00+00:00, run_id=scheduled__2024-06-27T03:43:00+00:00, run_start_date=2024-06-27 03:44:00.870637+00:00, run_end_date=2024-06-27 03:44:06.296522+00:00, run_duration=5.425885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:43:00+00:00, data_interval_end=2024-06-27 03:44:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:44:06.306492365Z [2024-06-27T03:44:06.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:44:00+00:00, run_after=2024-06-27T03:45:00+00:00 2024-06-27T03:44:06.352362202Z [2024-06-27T03:44:06.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:43:00+00:00 exited with status success for try_number 1 2024-06-27T03:44:06.352562020Z [2024-06-27T03:44:06.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:43:00+00:00 exited with status success for try_number 1 2024-06-27T03:44:06.368336298Z [2024-06-27T03:44:06.367+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:43:00+00:00, map_index=-1, run_start_date=2024-06-27 03:44:03.265924+00:00, run_end_date=2024-06-27 03:44:05.975625+00:00, run_duration=2.709701, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:44:00.956618+00:00, queued_by_job_id=2, pid=3718 2024-06-27T03:44:06.368688505Z [2024-06-27T03:44:06.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:43:00+00:00, map_index=-1, run_start_date=2024-06-27 03:44:03.214914+00:00, run_end_date=2024-06-27 03:44:05.667037+00:00, run_duration=2.452123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:44:00.956618+00:00, queued_by_job_id=2, pid=3717 2024-06-27T03:45:00.866228200Z [2024-06-27T03:45:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:45:00+00:00, run_after=2024-06-27T03:46:00+00:00 2024-06-27T03:45:00.890144936Z [2024-06-27T03:45:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:45:00+00:00, run_after=2024-06-27T03:50:00+00:00 2024-06-27T03:45:00.910934125Z [2024-06-27T03:45:00.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:45:00+00:00, run_after=2024-06-27T03:46:00+00:00 2024-06-27T03:45:00.919555547Z [2024-06-27T03:45:00.919+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:45:01.053384280Z [2024-06-27T03:45:01.052+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:45:01.053418237Z 2024-06-27T03:45:01.053423870Z 2024-06-27T03:45:01.053428493Z 2024-06-27T03:45:01.053432863Z 2024-06-27T03:45:01.053533316Z [2024-06-27T03:45:01.053+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:45:01.053702784Z [2024-06-27T03:45:01.053+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:45:01.053875283Z [2024-06-27T03:45:01.053+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:45:01.054016081Z [2024-06-27T03:45:01.053+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:45:01.055067486Z [2024-06-27T03:45:01.054+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:45:01.055106946Z 2024-06-27T03:45:01.055113067Z 2024-06-27T03:45:01.055117954Z 2024-06-27T03:45:01.055122259Z 2024-06-27T03:45:01.062855334Z [2024-06-27T03:45:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T03:45:01.063065662Z [2024-06-27T03:45:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:45:01.063463485Z [2024-06-27T03:45:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:45:01.063644179Z [2024-06-27T03:45:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:45:01.063966637Z [2024-06-27T03:45:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:45:01.064067534Z [2024-06-27T03:45:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:45:01.064400516Z [2024-06-27T03:45:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:45:01.064635227Z [2024-06-27T03:45:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:45:01.609630214Z [2024-06-27T03:45:01.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status queued for try_number 1 2024-06-27T03:45:01.609732187Z [2024-06-27T03:45:01.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:44:00+00:00 exited with status queued for try_number 1 2024-06-27T03:45:01.609920443Z [2024-06-27T03:45:01.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:44:00+00:00 exited with status queued for try_number 1 2024-06-27T03:45:01.609935428Z [2024-06-27T03:45:01.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:44:00+00:00 exited with status queued for try_number 1 2024-06-27T03:45:01.631378447Z [2024-06-27T03:45:01.621+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06288b9a-b21e-4e9a-8415-cd71dfb5f77a 2024-06-27T03:45:01.631609131Z [2024-06-27T03:45:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06440af6-cbe3-4482-bdbb-e11c28c4a79e 2024-06-27T03:45:01.631776307Z [2024-06-27T03:45:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to eebc2cd9-2763-45b4-9416-dcd340e332e4 2024-06-27T03:45:01.631931128Z [2024-06-27T03:45:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3120574c-ad0f-49c0-a78f-81b9ee7e56f4 2024-06-27T03:45:02.827682181Z [2024-06-27T03:45:02.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:45:02.827717789Z [2024-06-27T03:45:02.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:44:00+00:00, run_id=scheduled__2024-06-27T03:44:00+00:00, run_start_date=2024-06-27 03:45:00.934524+00:00, run_end_date=2024-06-27 03:45:02.826552+00:00, run_duration=1.892028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:44:00+00:00, data_interval_end=2024-06-27 03:45:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:45:02.851854909Z [2024-06-27T03:45:02.840+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:45:00+00:00, run_after=2024-06-27T03:46:00+00:00 2024-06-27T03:45:02.946348467Z [2024-06-27T03:45:02.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:44:00+00:00 exited with status success for try_number 1 2024-06-27T03:45:02.952115457Z [2024-06-27T03:45:02.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:44:00+00:00, map_index=-1, run_start_date=2024-06-27 03:45:02.010533+00:00, run_end_date=2024-06-27 03:45:02.390399+00:00, run_duration=0.379866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:45:01.057238+00:00, queued_by_job_id=2, pid=3763 2024-06-27T03:45:04.500445740Z [2024-06-27T03:45:04.499+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:45:04.500514769Z 2024-06-27T03:45:04.500849403Z [2024-06-27T03:45:04.500+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:45:04.501946706Z [2024-06-27T03:45:04.501+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:45:04.501963366Z 2024-06-27T03:45:04.506216343Z [2024-06-27T03:45:04.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:45:04.506648627Z [2024-06-27T03:45:04.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:45:04.558585492Z [2024-06-27T03:45:04.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status queued for try_number 1 2024-06-27T03:45:04.558615633Z [2024-06-27T03:45:04.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status success for try_number 1 2024-06-27T03:45:04.565428657Z [2024-06-27T03:45:04.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca3fbb03-3cee-4540-aa6d-091620122e69 2024-06-27T03:45:04.565665228Z [2024-06-27T03:45:04.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:40:00+00:00, map_index=-1, run_start_date=2024-06-27 03:45:03.585741+00:00, run_end_date=2024-06-27 03:45:04.040359+00:00, run_duration=0.454618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:45:01.057238+00:00, queued_by_job_id=2, pid=3805 2024-06-27T03:45:04.580441136Z [2024-06-27T03:45:04.580+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T03:45:06.024056969Z [2024-06-27T03:45:06.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:45:06.024200992Z [2024-06-27T03:45:06.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:44:00+00:00, run_id=scheduled__2024-06-27T03:44:00+00:00, run_start_date=2024-06-27 03:45:00.936203+00:00, run_end_date=2024-06-27 03:45:06.023928+00:00, run_duration=5.087725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:44:00+00:00, data_interval_end=2024-06-27 03:45:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:45:06.033197513Z [2024-06-27T03:45:06.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:45:00+00:00, run_after=2024-06-27T03:46:00+00:00 2024-06-27T03:45:06.039998754Z [2024-06-27T03:45:06.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:45:06.040669298Z [2024-06-27T03:45:06.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:44:00+00:00, run_id=scheduled__2024-06-27T03:44:00+00:00, run_start_date=2024-06-27 03:45:00.938010+00:00, run_end_date=2024-06-27 03:45:06.039901+00:00, run_duration=5.101891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:44:00+00:00, data_interval_end=2024-06-27 03:45:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:45:06.061133617Z [2024-06-27T03:45:06.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:45:00+00:00, run_after=2024-06-27T03:46:00+00:00 2024-06-27T03:45:06.130105410Z [2024-06-27T03:45:06.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:44:00+00:00 exited with status success for try_number 1 2024-06-27T03:45:06.130138793Z [2024-06-27T03:45:06.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:44:00+00:00 exited with status success for try_number 1 2024-06-27T03:45:06.138417516Z [2024-06-27T03:45:06.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:44:00+00:00, map_index=-1, run_start_date=2024-06-27 03:45:03.390564+00:00, run_end_date=2024-06-27 03:45:04.919878+00:00, run_duration=1.529314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:45:01.057238+00:00, queued_by_job_id=2, pid=3804 2024-06-27T03:45:06.138492818Z [2024-06-27T03:45:06.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:44:00+00:00, map_index=-1, run_start_date=2024-06-27 03:45:03.368012+00:00, run_end_date=2024-06-27 03:45:04.983554+00:00, run_duration=1.615542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:45:01.057238+00:00, queued_by_job_id=2, pid=3802 2024-06-27T03:45:07.234348988Z [2024-06-27T03:45:07.233+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:45:07.234406169Z 2024-06-27T03:45:07.234754652Z [2024-06-27T03:45:07.234+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:45:07.236180515Z [2024-06-27T03:45:07.235+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:45:07.236208086Z 2024-06-27T03:45:07.240855452Z [2024-06-27T03:45:07.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T03:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T03:45:07.241272769Z [2024-06-27T03:45:07.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T03:45:07.308832651Z [2024-06-27T03:45:07.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status queued for try_number 1 2024-06-27T03:45:07.309161717Z [2024-06-27T03:45:07.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status success for try_number 1 2024-06-27T03:45:07.324068721Z [2024-06-27T03:45:07.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c5f5399-4a64-4915-96cf-a1786f32f2ed 2024-06-27T03:45:07.324183895Z [2024-06-27T03:45:07.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T03:40:00+00:00, map_index=-1, run_start_date=2024-06-27 03:45:06.278356+00:00, run_end_date=2024-06-27 03:45:06.721846+00:00, run_duration=0.44349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:45:04.502976+00:00, queued_by_job_id=2, pid=3844 2024-06-27T03:45:09.902127034Z [2024-06-27T03:45:09.901+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:45:09.902325199Z 2024-06-27T03:45:09.902379450Z [2024-06-27T03:45:09.901+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:45:09.903127759Z [2024-06-27T03:45:09.902+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:45:09.903176374Z 2024-06-27T03:45:09.905991670Z [2024-06-27T03:45:09.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:45:09.906070339Z [2024-06-27T03:45:09.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:45:09.951664757Z [2024-06-27T03:45:09.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status queued for try_number 1 2024-06-27T03:45:09.951744514Z [2024-06-27T03:45:09.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status success for try_number 1 2024-06-27T03:45:09.961255787Z [2024-06-27T03:45:09.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to d12ff70e-0f1e-4553-af6a-afc9a2ef394f 2024-06-27T03:45:09.961547410Z [2024-06-27T03:45:09.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T03:40:00+00:00, map_index=0, run_start_date=2024-06-27 03:45:08.936369+00:00, run_end_date=2024-06-27 03:45:09.448142+00:00, run_duration=0.511773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:45:07.237318+00:00, queued_by_job_id=2, pid=3856 2024-06-27T03:45:12.249168416Z [2024-06-27T03:45:12.248+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:45:12.250234616Z [2024-06-27T03:45:12.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:40:00+00:00, run_id=scheduled__2024-06-27T03:40:00+00:00, run_start_date=2024-06-27 03:45:00.932915+00:00, run_end_date=2024-06-27 03:45:12.249466+00:00, run_duration=11.316551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:40:00+00:00, data_interval_end=2024-06-27 03:45:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T03:45:12.264581187Z [2024-06-27T03:45:12.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:45:00+00:00, run_after=2024-06-27T03:50:00+00:00 2024-06-27T03:45:12.311137272Z [2024-06-27T03:45:12.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:40:00+00:00 exited with status success for try_number 1 2024-06-27T03:45:12.319257304Z [2024-06-27T03:45:12.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T03:40:00+00:00, map_index=-1, run_start_date=2024-06-27 03:45:11.676013+00:00, run_end_date=2024-06-27 03:45:12.067469+00:00, run_duration=0.391456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:45:09.903294+00:00, queued_by_job_id=2, pid=3868 2024-06-27T03:46:00.801480583Z [2024-06-27T03:46:00.800+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:46:00.832117725Z [2024-06-27T03:46:00.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:46:00+00:00, run_after=2024-06-27T03:47:00+00:00 2024-06-27T03:46:00.846704933Z [2024-06-27T03:46:00.846+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:46:00.874813081Z [2024-06-27T03:46:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:46:00+00:00, run_after=2024-06-27T03:47:00+00:00 2024-06-27T03:46:00.969296441Z [2024-06-27T03:46:00.968+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:46:00.969345131Z 2024-06-27T03:46:00.969361136Z 2024-06-27T03:46:00.969371076Z 2024-06-27T03:46:00.969380462Z 2024-06-27T03:46:00.969407319Z [2024-06-27T03:46:00.969+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:46:00.969720060Z [2024-06-27T03:46:00.969+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:46:00.969813238Z [2024-06-27T03:46:00.969+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:46:00.970061981Z [2024-06-27T03:46:00.969+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:46:00.971311259Z [2024-06-27T03:46:00.970+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:46:00.971338060Z 2024-06-27T03:46:00.971347452Z 2024-06-27T03:46:00.971355872Z 2024-06-27T03:46:00.971367102Z 2024-06-27T03:46:00.977439055Z [2024-06-27T03:46:00.977+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:46:00.977499576Z [2024-06-27T03:46:00.977+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:46:00.977842777Z [2024-06-27T03:46:00.977+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:46:00.977872955Z [2024-06-27T03:46:00.977+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:46:00.978125785Z [2024-06-27T03:46:00.977+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:46:00.978207274Z [2024-06-27T03:46:00.978+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:46:00.978476376Z [2024-06-27T03:46:00.978+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:46:00.978554717Z [2024-06-27T03:46:00.978+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:46:01.397883321Z [2024-06-27T03:46:01.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:44:00+00:00 exited with status queued for try_number 1 2024-06-27T03:46:01.397937686Z [2024-06-27T03:46:01.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status queued for try_number 1 2024-06-27T03:46:01.398017130Z [2024-06-27T03:46:01.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status queued for try_number 1 2024-06-27T03:46:01.398069181Z [2024-06-27T03:46:01.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status queued for try_number 1 2024-06-27T03:46:01.408105452Z [2024-06-27T03:46:01.407+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b2e86bf-c805-417d-b0ab-e3035b4d72b1 2024-06-27T03:46:01.408148992Z [2024-06-27T03:46:01.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dc0ecbd-8439-4e79-99d4-a17376bec5bd 2024-06-27T03:46:01.408257989Z [2024-06-27T03:46:01.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41b970e6-7de2-4a85-a2fa-93195edded22 2024-06-27T03:46:01.408357756Z [2024-06-27T03:46:01.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to fabcea97-2f9f-414c-ad79-257ced873489 2024-06-27T03:46:03.103258227Z [2024-06-27T03:46:03.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:46:03.103525698Z [2024-06-27T03:46:03.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:45:00+00:00, run_id=scheduled__2024-06-27T03:45:00+00:00, run_start_date=2024-06-27 03:46:00.886353+00:00, run_end_date=2024-06-27 03:46:03.103074+00:00, run_duration=2.216721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:45:00+00:00, data_interval_end=2024-06-27 03:46:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:46:03.112923551Z [2024-06-27T03:46:03.112+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:46:00+00:00, run_after=2024-06-27T03:47:00+00:00 2024-06-27T03:46:03.121553788Z [2024-06-27T03:46:03.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:46:03.121717263Z [2024-06-27T03:46:03.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:44:00+00:00, run_id=scheduled__2024-06-27T03:44:00+00:00, run_start_date=2024-06-27 03:46:00.885098+00:00, run_end_date=2024-06-27 03:46:03.121392+00:00, run_duration=2.236294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:44:00+00:00, data_interval_end=2024-06-27 03:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:46:03.131461223Z [2024-06-27T03:46:03.131+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:46:00+00:00, run_after=2024-06-27T03:48:00+00:00 2024-06-27T03:46:03.210491524Z [2024-06-27T03:46:03.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:44:00+00:00 exited with status success for try_number 1 2024-06-27T03:46:03.211598528Z [2024-06-27T03:46:03.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status success for try_number 1 2024-06-27T03:46:03.221662394Z [2024-06-27T03:46:03.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:44:00+00:00, map_index=-1, run_start_date=2024-06-27 03:46:01.931280+00:00, run_end_date=2024-06-27 03:46:02.322825+00:00, run_duration=0.391545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:46:00.972639+00:00, queued_by_job_id=2, pid=3895 2024-06-27T03:46:03.222041911Z [2024-06-27T03:46:03.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:45:00+00:00, map_index=-1, run_start_date=2024-06-27 03:46:02.114934+00:00, run_end_date=2024-06-27 03:46:02.575563+00:00, run_duration=0.460629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:46:00.972639+00:00, queued_by_job_id=2, pid=3896 2024-06-27T03:46:05.441074290Z [2024-06-27T03:46:05.440+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:46:05.449414028Z [2024-06-27T03:46:05.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:45:00+00:00, run_id=scheduled__2024-06-27T03:45:00+00:00, run_start_date=2024-06-27 03:46:00.887333+00:00, run_end_date=2024-06-27 03:46:05.440992+00:00, run_duration=4.553659, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:45:00+00:00, data_interval_end=2024-06-27 03:46:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:46:05.451155492Z [2024-06-27T03:46:05.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:46:00+00:00, run_after=2024-06-27T03:47:00+00:00 2024-06-27T03:46:05.497541906Z [2024-06-27T03:46:05.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status success for try_number 1 2024-06-27T03:46:05.507264337Z [2024-06-27T03:46:05.506+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:45:00+00:00, map_index=-1, run_start_date=2024-06-27 03:46:03.279905+00:00, run_end_date=2024-06-27 03:46:04.775140+00:00, run_duration=1.495235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:46:00.972639+00:00, queued_by_job_id=2, pid=3936 2024-06-27T03:46:07.612676366Z [2024-06-27T03:46:07.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:46:07.613006655Z [2024-06-27T03:46:07.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:45:00+00:00, run_id=scheduled__2024-06-27T03:45:00+00:00, run_start_date=2024-06-27 03:46:00.888677+00:00, run_end_date=2024-06-27 03:46:07.612505+00:00, run_duration=6.723828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:45:00+00:00, data_interval_end=2024-06-27 03:46:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:46:07.622427432Z [2024-06-27T03:46:07.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:46:00+00:00, run_after=2024-06-27T03:47:00+00:00 2024-06-27T03:46:07.660454402Z [2024-06-27T03:46:07.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status success for try_number 1 2024-06-27T03:46:07.675390809Z [2024-06-27T03:46:07.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:45:00+00:00, map_index=-1, run_start_date=2024-06-27 03:46:03.092451+00:00, run_end_date=2024-06-27 03:46:06.588650+00:00, run_duration=3.496199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:46:00.972639+00:00, queued_by_job_id=2, pid=3935 2024-06-27T03:47:00.504859740Z [2024-06-27T03:47:00.504+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:47:00+00:00, run_after=2024-06-27T03:48:00+00:00 2024-06-27T03:47:00.526686817Z [2024-06-27T03:47:00.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:47:00+00:00, run_after=2024-06-27T03:48:00+00:00 2024-06-27T03:47:00.587309087Z [2024-06-27T03:47:00.586+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-06-27T03:47:00.587336131Z 2024-06-27T03:47:00.587342372Z 2024-06-27T03:47:00.587347717Z [2024-06-27T03:47:00.587+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:47:00.587360511Z [2024-06-27T03:47:00.587+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:47:00.587965425Z [2024-06-27T03:47:00.587+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:47:00.587982591Z 2024-06-27T03:47:00.587987669Z 2024-06-27T03:47:00.591653780Z [2024-06-27T03:47:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:47:00.591724223Z [2024-06-27T03:47:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:47:00.591889493Z [2024-06-27T03:47:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:47:00.591946932Z [2024-06-27T03:47:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:47:00.741964101Z [2024-06-27T03:47:00.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:46:00+00:00 exited with status queued for try_number 1 2024-06-27T03:47:00.742270133Z [2024-06-27T03:47:00.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:46:00+00:00 exited with status queued for try_number 1 2024-06-27T03:47:00.752008388Z [2024-06-27T03:47:00.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to 696a1791-2b64-4d9b-93f0-f7a0c531f489 2024-06-27T03:47:00.752284444Z [2024-06-27T03:47:00.752+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47b1b3e0-fb62-40ba-b365-5b63d02c1d6a 2024-06-27T03:47:00.796208245Z [2024-06-27T03:47:00.795+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:47:00.882922530Z [2024-06-27T03:47:00.882+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:47:00.882944462Z 2024-06-27T03:47:00.884701591Z [2024-06-27T03:47:00.883+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:47:00.885988091Z [2024-06-27T03:47:00.885+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:47:00.886001552Z 2024-06-27T03:47:00.889517220Z [2024-06-27T03:47:00.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:47:00.889758067Z [2024-06-27T03:47:00.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:47:00.949081972Z [2024-06-27T03:47:00.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:46:00+00:00 exited with status queued for try_number 1 2024-06-27T03:47:00.954677073Z [2024-06-27T03:47:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f4981b7-4930-4333-8914-104b72efde2c 2024-06-27T03:47:02.128731750Z [2024-06-27T03:47:02.128+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:47:02.129371316Z [2024-06-27T03:47:02.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:46:00+00:00, run_id=scheduled__2024-06-27T03:46:00+00:00, run_start_date=2024-06-27 03:47:00.538259+00:00, run_end_date=2024-06-27 03:47:02.128596+00:00, run_duration=1.590337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:46:00+00:00, data_interval_end=2024-06-27 03:47:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:47:02.145470707Z [2024-06-27T03:47:02.145+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:47:00+00:00, run_after=2024-06-27T03:48:00+00:00 2024-06-27T03:47:02.194187997Z [2024-06-27T03:47:02.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:46:00+00:00 exited with status success for try_number 1 2024-06-27T03:47:02.201856147Z [2024-06-27T03:47:02.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:46:00+00:00, map_index=-1, run_start_date=2024-06-27 03:47:01.424166+00:00, run_end_date=2024-06-27 03:47:01.912500+00:00, run_duration=0.488334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:47:00.589388+00:00, queued_by_job_id=2, pid=3980 2024-06-27T03:47:04.565394187Z [2024-06-27T03:47:04.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:47:04.565881673Z [2024-06-27T03:47:04.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:46:00+00:00, run_id=scheduled__2024-06-27T03:46:00+00:00, run_start_date=2024-06-27 03:47:00.814477+00:00, run_end_date=2024-06-27 03:47:04.565268+00:00, run_duration=3.750791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:46:00+00:00, data_interval_end=2024-06-27 03:47:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:47:04.578228802Z [2024-06-27T03:47:04.577+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:47:00+00:00, run_after=2024-06-27T03:48:00+00:00 2024-06-27T03:47:04.586895409Z [2024-06-27T03:47:04.586+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:47:04.587472516Z [2024-06-27T03:47:04.587+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:46:00+00:00, run_id=scheduled__2024-06-27T03:46:00+00:00, run_start_date=2024-06-27 03:47:00.539518+00:00, run_end_date=2024-06-27 03:47:04.586788+00:00, run_duration=4.04727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:46:00+00:00, data_interval_end=2024-06-27 03:47:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:47:04.620452884Z [2024-06-27T03:47:04.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:47:00+00:00, run_after=2024-06-27T03:48:00+00:00 2024-06-27T03:47:04.666357503Z [2024-06-27T03:47:04.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:46:00+00:00 exited with status success for try_number 1 2024-06-27T03:47:04.678193278Z [2024-06-27T03:47:04.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:46:00+00:00, map_index=-1, run_start_date=2024-06-27 03:47:02.494105+00:00, run_end_date=2024-06-27 03:47:03.839129+00:00, run_duration=1.345024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:47:00.589388+00:00, queued_by_job_id=2, pid=4001 2024-06-27T03:47:04.839070107Z [2024-06-27T03:47:04.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:46:00+00:00 exited with status success for try_number 1 2024-06-27T03:47:04.846654309Z [2024-06-27T03:47:04.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:46:00+00:00, map_index=-1, run_start_date=2024-06-27 03:47:02.773144+00:00, run_end_date=2024-06-27 03:47:04.453730+00:00, run_duration=1.680586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:47:00.886602+00:00, queued_by_job_id=2, pid=4011 2024-06-27T03:48:00.488925211Z [2024-06-27T03:48:00.488+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:48:00.504332017Z [2024-06-27T03:48:00.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:48:00+00:00, run_after=2024-06-27T03:49:00+00:00 2024-06-27T03:48:00.518647715Z [2024-06-27T03:48:00.518+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:48:00+00:00, run_after=2024-06-27T03:49:00+00:00 2024-06-27T03:48:00.529343773Z [2024-06-27T03:48:00.529+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:48:00.629314801Z [2024-06-27T03:48:00.628+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:48:00.629343094Z 2024-06-27T03:48:00.629348482Z 2024-06-27T03:48:00.629369810Z 2024-06-27T03:48:00.629373969Z 2024-06-27T03:48:00.629605865Z [2024-06-27T03:48:00.629+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:48:00.629713408Z [2024-06-27T03:48:00.629+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:48:00.629878780Z [2024-06-27T03:48:00.629+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:48:00.630048542Z [2024-06-27T03:48:00.629+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:48:00.631015975Z [2024-06-27T03:48:00.630+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:48:00.631030679Z 2024-06-27T03:48:00.631035211Z 2024-06-27T03:48:00.631042709Z 2024-06-27T03:48:00.631047083Z 2024-06-27T03:48:00.635405811Z [2024-06-27T03:48:00.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:48:00.635580934Z [2024-06-27T03:48:00.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:48:00.635914582Z [2024-06-27T03:48:00.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:48:00.636074457Z [2024-06-27T03:48:00.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:48:00.636446184Z [2024-06-27T03:48:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:48:00.636480550Z [2024-06-27T03:48:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:48:00.636923920Z [2024-06-27T03:48:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:48:00.637095793Z [2024-06-27T03:48:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:48:00.967399212Z [2024-06-27T03:48:00.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:46:00+00:00 exited with status queued for try_number 1 2024-06-27T03:48:00.967796401Z [2024-06-27T03:48:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:47:00+00:00 exited with status queued for try_number 1 2024-06-27T03:48:00.968102993Z [2024-06-27T03:48:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:47:00+00:00 exited with status queued for try_number 1 2024-06-27T03:48:00.968367378Z [2024-06-27T03:48:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:47:00+00:00 exited with status queued for try_number 1 2024-06-27T03:48:00.980435801Z [2024-06-27T03:48:00.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6be24abf-34b0-4cc1-aa15-278a8d898c4d 2024-06-27T03:48:00.981110014Z [2024-06-27T03:48:00.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2607978e-04eb-41c1-9502-0f6b35808899 2024-06-27T03:48:00.981461026Z [2024-06-27T03:48:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ab96325-f4a0-43cc-9bf2-61d73f6607c0 2024-06-27T03:48:00.981759336Z [2024-06-27T03:48:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf6722d7-3d26-4a94-bc65-462c9eb48cea 2024-06-27T03:48:02.795346319Z [2024-06-27T03:48:02.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:48:02.798875956Z [2024-06-27T03:48:02.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:46:00+00:00, run_id=scheduled__2024-06-27T03:46:00+00:00, run_start_date=2024-06-27 03:48:00.547428+00:00, run_end_date=2024-06-27 03:48:02.798324+00:00, run_duration=2.250896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:46:00+00:00, data_interval_end=2024-06-27 03:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:48:02.815613450Z [2024-06-27T03:48:02.815+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:48:00+00:00, run_after=2024-06-27T03:50:00+00:00 2024-06-27T03:48:02.865571328Z [2024-06-27T03:48:02.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:48:02.865871161Z [2024-06-27T03:48:02.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:47:00+00:00, run_id=scheduled__2024-06-27T03:47:00+00:00, run_start_date=2024-06-27 03:48:00.549531+00:00, run_end_date=2024-06-27 03:48:02.865537+00:00, run_duration=2.316006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:47:00+00:00, data_interval_end=2024-06-27 03:48:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:48:02.913570081Z [2024-06-27T03:48:02.905+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:48:00+00:00, run_after=2024-06-27T03:49:00+00:00 2024-06-27T03:48:02.979558993Z [2024-06-27T03:48:02.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:46:00+00:00 exited with status success for try_number 1 2024-06-27T03:48:02.980065168Z [2024-06-27T03:48:02.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:47:00+00:00 exited with status success for try_number 1 2024-06-27T03:48:02.987832751Z [2024-06-27T03:48:02.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:46:00+00:00, map_index=-1, run_start_date=2024-06-27 03:48:01.791072+00:00, run_end_date=2024-06-27 03:48:02.330298+00:00, run_duration=0.539226, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:48:00.632047+00:00, queued_by_job_id=2, pid=4057 2024-06-27T03:48:02.988289804Z [2024-06-27T03:48:02.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:47:00+00:00, map_index=-1, run_start_date=2024-06-27 03:48:01.777578+00:00, run_end_date=2024-06-27 03:48:02.239221+00:00, run_duration=0.461643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:48:00.632047+00:00, queued_by_job_id=2, pid=4056 2024-06-27T03:48:05.267665986Z [2024-06-27T03:48:05.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:48:05.268121769Z [2024-06-27T03:48:05.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:47:00+00:00, run_id=scheduled__2024-06-27T03:47:00+00:00, run_start_date=2024-06-27 03:48:00.550756+00:00, run_end_date=2024-06-27 03:48:05.267796+00:00, run_duration=4.71704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:47:00+00:00, data_interval_end=2024-06-27 03:48:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:48:05.277715248Z [2024-06-27T03:48:05.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:48:00+00:00, run_after=2024-06-27T03:49:00+00:00 2024-06-27T03:48:05.310843908Z [2024-06-27T03:48:05.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:47:00+00:00 exited with status success for try_number 1 2024-06-27T03:48:05.317940015Z [2024-06-27T03:48:05.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:47:00+00:00, map_index=-1, run_start_date=2024-06-27 03:48:03.268249+00:00, run_end_date=2024-06-27 03:48:04.856904+00:00, run_duration=1.588655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:48:00.632047+00:00, queued_by_job_id=2, pid=4096 2024-06-27T03:48:06.387338170Z [2024-06-27T03:48:06.380+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:48:06.387365355Z [2024-06-27T03:48:06.380+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:47:00+00:00, run_id=scheduled__2024-06-27T03:47:00+00:00, run_start_date=2024-06-27 03:48:00.552397+00:00, run_end_date=2024-06-27 03:48:06.380789+00:00, run_duration=5.828392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:47:00+00:00, data_interval_end=2024-06-27 03:48:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:48:06.394587989Z [2024-06-27T03:48:06.392+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:48:00+00:00, run_after=2024-06-27T03:49:00+00:00 2024-06-27T03:48:06.440323877Z [2024-06-27T03:48:06.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:47:00+00:00 exited with status success for try_number 1 2024-06-27T03:48:06.446620761Z [2024-06-27T03:48:06.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:47:00+00:00, map_index=-1, run_start_date=2024-06-27 03:48:03.361836+00:00, run_end_date=2024-06-27 03:48:05.242826+00:00, run_duration=1.88099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:48:00.632047+00:00, queued_by_job_id=2, pid=4097 2024-06-27T03:49:00.532184742Z [2024-06-27T03:49:00.530+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:49:00.546734634Z [2024-06-27T03:49:00.546+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:49:00+00:00, run_after=2024-06-27T03:50:00+00:00 2024-06-27T03:49:00.559855152Z [2024-06-27T03:49:00.559+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:49:00+00:00, run_after=2024-06-27T03:50:00+00:00 2024-06-27T03:49:00.656509456Z [2024-06-27T03:49:00.656+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:49:00.656535753Z 2024-06-27T03:49:00.656539206Z 2024-06-27T03:49:00.656554366Z 2024-06-27T03:49:00.657477757Z [2024-06-27T03:49:00.657+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:49:00.657695436Z [2024-06-27T03:49:00.657+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:49:00.658119814Z [2024-06-27T03:49:00.657+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:49:00.659549647Z [2024-06-27T03:49:00.659+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:49:00.659560216Z 2024-06-27T03:49:00.659563529Z 2024-06-27T03:49:00.659566739Z 2024-06-27T03:49:00.666930354Z [2024-06-27T03:49:00.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:49:00.667370178Z [2024-06-27T03:49:00.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:49:00.668222620Z [2024-06-27T03:49:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:49:00.668487037Z [2024-06-27T03:49:00.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:49:00.669278928Z [2024-06-27T03:49:00.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:49:00.669511841Z [2024-06-27T03:49:00.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:49:01.015969623Z [2024-06-27T03:49:01.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:48:00+00:00 exited with status queued for try_number 1 2024-06-27T03:49:01.016029056Z [2024-06-27T03:49:01.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:48:00+00:00 exited with status queued for try_number 1 2024-06-27T03:49:01.016051927Z [2024-06-27T03:49:01.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:48:00+00:00 exited with status queued for try_number 1 2024-06-27T03:49:01.024147673Z [2024-06-27T03:49:01.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to ceea80b2-096a-4fae-b4ed-1aa633401e13 2024-06-27T03:49:01.024524268Z [2024-06-27T03:49:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to 834a7f0f-b441-4c65-b389-1eabf713abf2 2024-06-27T03:49:01.024941059Z [2024-06-27T03:49:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae1c138d-a543-4fda-9675-7c73da6947f4 2024-06-27T03:49:02.238004040Z [2024-06-27T03:49:02.237+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:49:02.238379920Z [2024-06-27T03:49:02.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:48:00+00:00, run_id=scheduled__2024-06-27T03:48:00+00:00, run_start_date=2024-06-27 03:49:00.572022+00:00, run_end_date=2024-06-27 03:49:02.237835+00:00, run_duration=1.665813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:48:00+00:00, data_interval_end=2024-06-27 03:49:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:49:02.249982357Z [2024-06-27T03:49:02.249+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:49:00+00:00, run_after=2024-06-27T03:50:00+00:00 2024-06-27T03:49:02.284038688Z [2024-06-27T03:49:02.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:48:00+00:00 exited with status success for try_number 1 2024-06-27T03:49:02.289338152Z [2024-06-27T03:49:02.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:48:00+00:00, map_index=-1, run_start_date=2024-06-27 03:49:01.607039+00:00, run_end_date=2024-06-27 03:49:01.980076+00:00, run_duration=0.373037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:49:00.661462+00:00, queued_by_job_id=2, pid=4140 2024-06-27T03:49:04.412641024Z [2024-06-27T03:49:04.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:49:04.412877849Z [2024-06-27T03:49:04.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:48:00+00:00, run_id=scheduled__2024-06-27T03:48:00+00:00, run_start_date=2024-06-27 03:49:00.575214+00:00, run_end_date=2024-06-27 03:49:04.412466+00:00, run_duration=3.837252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:48:00+00:00, data_interval_end=2024-06-27 03:49:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:49:04.425645009Z [2024-06-27T03:49:04.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:49:00+00:00, run_after=2024-06-27T03:50:00+00:00 2024-06-27T03:49:04.433873219Z [2024-06-27T03:49:04.433+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:49:04.434063351Z [2024-06-27T03:49:04.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:48:00+00:00, run_id=scheduled__2024-06-27T03:48:00+00:00, run_start_date=2024-06-27 03:49:00.574015+00:00, run_end_date=2024-06-27 03:49:04.433706+00:00, run_duration=3.859691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:48:00+00:00, data_interval_end=2024-06-27 03:49:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:49:04.444032119Z [2024-06-27T03:49:04.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:49:00+00:00, run_after=2024-06-27T03:50:00+00:00 2024-06-27T03:49:04.494220783Z [2024-06-27T03:49:04.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:48:00+00:00 exited with status success for try_number 1 2024-06-27T03:49:04.494273687Z [2024-06-27T03:49:04.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:48:00+00:00 exited with status success for try_number 1 2024-06-27T03:49:04.505873545Z [2024-06-27T03:49:04.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:48:00+00:00, map_index=-1, run_start_date=2024-06-27 03:49:02.554649+00:00, run_end_date=2024-06-27 03:49:04.268965+00:00, run_duration=1.714316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:49:00.661462+00:00, queued_by_job_id=2, pid=4170 2024-06-27T03:49:04.505958438Z [2024-06-27T03:49:04.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:48:00+00:00, map_index=-1, run_start_date=2024-06-27 03:49:02.646909+00:00, run_end_date=2024-06-27 03:49:03.966727+00:00, run_duration=1.319818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:49:00.661462+00:00, queued_by_job_id=2, pid=4171 2024-06-27T03:50:00.292249928Z [2024-06-27T03:50:00.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:50:00+00:00, run_after=2024-06-27T03:51:00+00:00 2024-06-27T03:50:00.322118840Z [2024-06-27T03:50:00.321+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:50:00+00:00, run_after=2024-06-27T03:51:00+00:00 2024-06-27T03:50:00.329550000Z [2024-06-27T03:50:00.329+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:50:00.351299119Z [2024-06-27T03:50:00.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:50:00+00:00, run_after=2024-06-27T03:55:00+00:00 2024-06-27T03:50:00.362261345Z [2024-06-27T03:50:00.361+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:50:00.473779320Z [2024-06-27T03:50:00.473+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T03:50:00.473828472Z 2024-06-27T03:50:00.473833328Z 2024-06-27T03:50:00.473837307Z 2024-06-27T03:50:00.473840441Z 2024-06-27T03:50:00.473843632Z 2024-06-27T03:50:00.473872751Z [2024-06-27T03:50:00.473+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:50:00.473921206Z [2024-06-27T03:50:00.473+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:50:00.473933299Z [2024-06-27T03:50:00.473+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:50:00.474025487Z [2024-06-27T03:50:00.473+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:50:00.474059824Z [2024-06-27T03:50:00.473+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:50:00.474640493Z [2024-06-27T03:50:00.474+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:50:00.474663868Z 2024-06-27T03:50:00.474671175Z 2024-06-27T03:50:00.474677468Z 2024-06-27T03:50:00.474683319Z 2024-06-27T03:50:00.474689147Z 2024-06-27T03:50:00.479748100Z [2024-06-27T03:50:00.479+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T03:50:00.479767284Z [2024-06-27T03:50:00.479+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:50:00.479926192Z [2024-06-27T03:50:00.479+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:50:00.480007075Z [2024-06-27T03:50:00.479+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:50:00.480170993Z [2024-06-27T03:50:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:50:00.480241925Z [2024-06-27T03:50:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:50:00.480385942Z [2024-06-27T03:50:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:50:00.480459980Z [2024-06-27T03:50:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:50:00.480622981Z [2024-06-27T03:50:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:50:00.480693319Z [2024-06-27T03:50:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:50:00.990880756Z [2024-06-27T03:50:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status queued for try_number 1 2024-06-27T03:50:00.996991890Z [2024-06-27T03:50:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:48:00+00:00 exited with status queued for try_number 1 2024-06-27T03:50:00.997212565Z [2024-06-27T03:50:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:49:00+00:00 exited with status queued for try_number 1 2024-06-27T03:50:00.997340481Z [2024-06-27T03:50:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:49:00+00:00 exited with status queued for try_number 1 2024-06-27T03:50:00.997434333Z [2024-06-27T03:50:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:49:00+00:00 exited with status queued for try_number 1 2024-06-27T03:50:01.021448327Z [2024-06-27T03:50:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59f858fd-e5a2-429d-9c2b-15c91ae8fa2b 2024-06-27T03:50:01.021595002Z [2024-06-27T03:50:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4770cf23-7edd-4f9d-86b6-59e66a5ffbc9 2024-06-27T03:50:01.021829344Z [2024-06-27T03:50:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf73d10e-3e13-4861-b03c-cc44836ec60f 2024-06-27T03:50:01.024152415Z [2024-06-27T03:50:01.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb5f164a-1eb6-491b-bb0d-c68b946c6a36 2024-06-27T03:50:01.024322728Z [2024-06-27T03:50:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68ca2189-638a-445d-8184-f64c9cf79143 2024-06-27T03:50:02.433430423Z [2024-06-27T03:50:02.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:50:02.433907747Z [2024-06-27T03:50:02.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:48:00+00:00, run_id=scheduled__2024-06-27T03:48:00+00:00, run_start_date=2024-06-27 03:50:00.374062+00:00, run_end_date=2024-06-27 03:50:02.433511+00:00, run_duration=2.059449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:48:00+00:00, data_interval_end=2024-06-27 03:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:50:02.445714337Z [2024-06-27T03:50:02.445+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:50:00+00:00, run_after=2024-06-27T03:52:00+00:00 2024-06-27T03:50:02.578539046Z [2024-06-27T03:50:02.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:48:00+00:00 exited with status success for try_number 1 2024-06-27T03:50:02.578727434Z [2024-06-27T03:50:02.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:49:00+00:00 exited with status success for try_number 1 2024-06-27T03:50:02.589045691Z [2024-06-27T03:50:02.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:48:00+00:00, map_index=-1, run_start_date=2024-06-27 03:50:01.419484+00:00, run_end_date=2024-06-27 03:50:01.864393+00:00, run_duration=0.444909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:50:00.475881+00:00, queued_by_job_id=2, pid=4208 2024-06-27T03:50:02.589370332Z [2024-06-27T03:50:02.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:49:00+00:00, map_index=-1, run_start_date=2024-06-27 03:50:01.850235+00:00, run_end_date=2024-06-27 03:50:02.347523+00:00, run_duration=0.497288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:50:00.475881+00:00, queued_by_job_id=2, pid=4227 2024-06-27T03:50:03.565867503Z [2024-06-27T03:50:03.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:50:03.566381475Z [2024-06-27T03:50:03.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:49:00+00:00, run_id=scheduled__2024-06-27T03:49:00+00:00, run_start_date=2024-06-27 03:50:00.375573+00:00, run_end_date=2024-06-27 03:50:03.565767+00:00, run_duration=3.190194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:49:00+00:00, data_interval_end=2024-06-27 03:50:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:50:03.597228594Z [2024-06-27T03:50:03.596+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:50:00+00:00, run_after=2024-06-27T03:51:00+00:00 2024-06-27T03:50:04.673362532Z [2024-06-27T03:50:04.672+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:50:04.673415353Z 2024-06-27T03:50:04.673430795Z [2024-06-27T03:50:04.673+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:50:04.674114616Z [2024-06-27T03:50:04.673+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:50:04.674138391Z 2024-06-27T03:50:04.677443025Z [2024-06-27T03:50:04.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:50:04.677481830Z [2024-06-27T03:50:04.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:50:04.760959238Z [2024-06-27T03:50:04.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status queued for try_number 1 2024-06-27T03:50:04.761008287Z [2024-06-27T03:50:04.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status success for try_number 1 2024-06-27T03:50:04.765386097Z [2024-06-27T03:50:04.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e15f056-18e2-4c75-9fab-10763c320b85 2024-06-27T03:50:04.765634335Z [2024-06-27T03:50:04.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:45:00+00:00, map_index=-1, run_start_date=2024-06-27 03:50:03.184745+00:00, run_end_date=2024-06-27 03:50:03.824501+00:00, run_duration=0.639756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:50:00.475881+00:00, queued_by_job_id=2, pid=4258 2024-06-27T03:50:04.779926062Z [2024-06-27T03:50:04.779+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T03:50:05.949154025Z [2024-06-27T03:50:05.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:50:05.949446286Z [2024-06-27T03:50:05.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:49:00+00:00, run_id=scheduled__2024-06-27T03:49:00+00:00, run_start_date=2024-06-27 03:50:00.377740+00:00, run_end_date=2024-06-27 03:50:05.949062+00:00, run_duration=5.571322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:49:00+00:00, data_interval_end=2024-06-27 03:50:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:50:05.958581998Z [2024-06-27T03:50:05.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:50:00+00:00, run_after=2024-06-27T03:51:00+00:00 2024-06-27T03:50:05.966268324Z [2024-06-27T03:50:05.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:50:05.966608314Z [2024-06-27T03:50:05.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:49:00+00:00, run_id=scheduled__2024-06-27T03:49:00+00:00, run_start_date=2024-06-27 03:50:00.376565+00:00, run_end_date=2024-06-27 03:50:05.966186+00:00, run_duration=5.589621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:49:00+00:00, data_interval_end=2024-06-27 03:50:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:50:05.976873423Z [2024-06-27T03:50:05.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:50:00+00:00, run_after=2024-06-27T03:51:00+00:00 2024-06-27T03:50:06.035527167Z [2024-06-27T03:50:06.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:49:00+00:00 exited with status success for try_number 1 2024-06-27T03:50:06.035729336Z [2024-06-27T03:50:06.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:49:00+00:00 exited with status success for try_number 1 2024-06-27T03:50:06.044380571Z [2024-06-27T03:50:06.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:49:00+00:00, map_index=-1, run_start_date=2024-06-27 03:50:03.333565+00:00, run_end_date=2024-06-27 03:50:05.299723+00:00, run_duration=1.966158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:50:00.475881+00:00, queued_by_job_id=2, pid=4268 2024-06-27T03:50:06.044883003Z [2024-06-27T03:50:06.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:49:00+00:00, map_index=-1, run_start_date=2024-06-27 03:50:03.564429+00:00, run_end_date=2024-06-27 03:50:04.975115+00:00, run_duration=1.410686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:50:00.475881+00:00, queued_by_job_id=2, pid=4269 2024-06-27T03:50:07.302343856Z [2024-06-27T03:50:07.301+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:50:07.302374469Z 2024-06-27T03:50:07.302546343Z [2024-06-27T03:50:07.302+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:50:07.303303353Z [2024-06-27T03:50:07.303+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:50:07.303317125Z 2024-06-27T03:50:07.305673376Z [2024-06-27T03:50:07.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T03:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T03:50:07.306610488Z [2024-06-27T03:50:07.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T03:50:07.376676438Z [2024-06-27T03:50:07.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status queued for try_number 1 2024-06-27T03:50:07.376965738Z [2024-06-27T03:50:07.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status success for try_number 1 2024-06-27T03:50:07.382794486Z [2024-06-27T03:50:07.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to f270a01e-09df-4134-96b0-a051c1b97331 2024-06-27T03:50:07.383167327Z [2024-06-27T03:50:07.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T03:45:00+00:00, map_index=-1, run_start_date=2024-06-27 03:50:06.345136+00:00, run_end_date=2024-06-27 03:50:06.765374+00:00, run_duration=0.420238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:50:04.674706+00:00, queued_by_job_id=2, pid=4308 2024-06-27T03:50:10.375119244Z [2024-06-27T03:50:10.374+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:50:10.375146138Z 2024-06-27T03:50:10.375150162Z [2024-06-27T03:50:10.374+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:50:10.376035963Z [2024-06-27T03:50:10.375+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:50:10.376061279Z 2024-06-27T03:50:10.379389900Z [2024-06-27T03:50:10.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:50:10.379407650Z [2024-06-27T03:50:10.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:50:10.457198980Z [2024-06-27T03:50:10.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status queued for try_number 1 2024-06-27T03:50:10.457268746Z [2024-06-27T03:50:10.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status success for try_number 1 2024-06-27T03:50:10.465717865Z [2024-06-27T03:50:10.465+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7ad5011-bef6-4c65-a9b4-95c43a0b8364 2024-06-27T03:50:10.465786665Z [2024-06-27T03:50:10.465+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T03:45:00+00:00, map_index=0, run_start_date=2024-06-27 03:50:08.962330+00:00, run_end_date=2024-06-27 03:50:09.402897+00:00, run_duration=0.440567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:50:07.303755+00:00, queued_by_job_id=2, pid=4320 2024-06-27T03:50:13.500968436Z [2024-06-27T03:50:13.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:50:13.501425418Z [2024-06-27T03:50:13.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:45:00+00:00, run_id=scheduled__2024-06-27T03:45:00+00:00, run_start_date=2024-06-27 03:50:00.372698+00:00, run_end_date=2024-06-27 03:50:13.501013+00:00, run_duration=13.128315, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:45:00+00:00, data_interval_end=2024-06-27 03:50:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T03:50:13.509056648Z [2024-06-27T03:50:13.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:50:00+00:00, run_after=2024-06-27T03:55:00+00:00 2024-06-27T03:50:13.544865899Z [2024-06-27T03:50:13.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:45:00+00:00 exited with status success for try_number 1 2024-06-27T03:50:13.558263449Z [2024-06-27T03:50:13.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T03:45:00+00:00, map_index=-1, run_start_date=2024-06-27 03:50:12.074026+00:00, run_end_date=2024-06-27 03:50:12.501211+00:00, run_duration=0.427185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:50:10.376018+00:00, queued_by_job_id=2, pid=4332 2024-06-27T03:51:00.237178313Z [2024-06-27T03:51:00.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:51:00+00:00, run_after=2024-06-27T03:52:00+00:00 2024-06-27T03:51:00.250018969Z [2024-06-27T03:51:00.249+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:51:00.266041089Z [2024-06-27T03:51:00.265+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:51:00+00:00, run_after=2024-06-27T03:52:00+00:00 2024-06-27T03:51:00.351830691Z [2024-06-27T03:51:00.351+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:51:00.351867683Z 2024-06-27T03:51:00.351872550Z 2024-06-27T03:51:00.351875902Z 2024-06-27T03:51:00.352065236Z [2024-06-27T03:51:00.351+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:51:00.352310802Z [2024-06-27T03:51:00.352+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:51:00.352493938Z [2024-06-27T03:51:00.352+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:51:00.353211976Z [2024-06-27T03:51:00.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:51:00.353223841Z 2024-06-27T03:51:00.353227332Z 2024-06-27T03:51:00.353230448Z 2024-06-27T03:51:00.357263208Z [2024-06-27T03:51:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:51:00.357526520Z [2024-06-27T03:51:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:51:00.357846141Z [2024-06-27T03:51:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:51:00.358106521Z [2024-06-27T03:51:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:51:00.358349738Z [2024-06-27T03:51:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:51:00.358528778Z [2024-06-27T03:51:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:51:00.629644276Z [2024-06-27T03:51:00.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status queued for try_number 1 2024-06-27T03:51:00.629829991Z [2024-06-27T03:51:00.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status queued for try_number 1 2024-06-27T03:51:00.630080094Z [2024-06-27T03:51:00.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status queued for try_number 1 2024-06-27T03:51:00.642095596Z [2024-06-27T03:51:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0893984-1382-4536-8f8d-3d25b1a53f93 2024-06-27T03:51:00.642359062Z [2024-06-27T03:51:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to f987c897-ab49-4898-b4b7-c64dd1fa5531 2024-06-27T03:51:00.642694861Z [2024-06-27T03:51:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f906a55-47df-4934-8bc7-1a025636440d 2024-06-27T03:51:01.784367305Z [2024-06-27T03:51:01.783+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:51:01.785097698Z [2024-06-27T03:51:01.784+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:50:00+00:00, run_id=scheduled__2024-06-27T03:50:00+00:00, run_start_date=2024-06-27 03:51:00.280539+00:00, run_end_date=2024-06-27 03:51:01.784630+00:00, run_duration=1.504091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:50:00+00:00, data_interval_end=2024-06-27 03:51:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:51:01.801269062Z [2024-06-27T03:51:01.800+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:51:00+00:00, run_after=2024-06-27T03:52:00+00:00 2024-06-27T03:51:01.839718616Z [2024-06-27T03:51:01.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status success for try_number 1 2024-06-27T03:51:01.844359783Z [2024-06-27T03:51:01.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:50:00+00:00, map_index=-1, run_start_date=2024-06-27 03:51:01.159831+00:00, run_end_date=2024-06-27 03:51:01.554511+00:00, run_duration=0.39468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:51:00.353929+00:00, queued_by_job_id=2, pid=4358 2024-06-27T03:51:04.022247528Z [2024-06-27T03:51:04.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:51:04.022761122Z [2024-06-27T03:51:04.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:50:00+00:00, run_id=scheduled__2024-06-27T03:50:00+00:00, run_start_date=2024-06-27 03:51:00.282007+00:00, run_end_date=2024-06-27 03:51:04.022389+00:00, run_duration=3.740382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:50:00+00:00, data_interval_end=2024-06-27 03:51:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:51:04.033469430Z [2024-06-27T03:51:04.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:51:00+00:00, run_after=2024-06-27T03:52:00+00:00 2024-06-27T03:51:04.041353461Z [2024-06-27T03:51:04.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:51:04.041801716Z [2024-06-27T03:51:04.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:50:00+00:00, run_id=scheduled__2024-06-27T03:50:00+00:00, run_start_date=2024-06-27 03:51:00.283175+00:00, run_end_date=2024-06-27 03:51:04.041458+00:00, run_duration=3.758283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:50:00+00:00, data_interval_end=2024-06-27 03:51:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:51:04.052241992Z [2024-06-27T03:51:04.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:51:00+00:00, run_after=2024-06-27T03:52:00+00:00 2024-06-27T03:51:04.089916850Z [2024-06-27T03:51:04.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status success for try_number 1 2024-06-27T03:51:04.089994030Z [2024-06-27T03:51:04.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status success for try_number 1 2024-06-27T03:51:04.099700145Z [2024-06-27T03:51:04.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:50:00+00:00, map_index=-1, run_start_date=2024-06-27 03:51:02.223620+00:00, run_end_date=2024-06-27 03:51:03.556276+00:00, run_duration=1.332656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:51:00.353929+00:00, queued_by_job_id=2, pid=4388 2024-06-27T03:51:04.100533703Z [2024-06-27T03:51:04.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:50:00+00:00, map_index=-1, run_start_date=2024-06-27 03:51:02.251977+00:00, run_end_date=2024-06-27 03:51:03.866026+00:00, run_duration=1.614049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:51:00.353929+00:00, queued_by_job_id=2, pid=4389 2024-06-27T03:52:00.189176996Z [2024-06-27T03:52:00.188+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:52:00.205004437Z [2024-06-27T03:52:00.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:52:00+00:00, run_after=2024-06-27T03:53:00+00:00 2024-06-27T03:52:00.220061547Z [2024-06-27T03:52:00.219+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:52:00+00:00, run_after=2024-06-27T03:53:00+00:00 2024-06-27T03:52:00.229174587Z [2024-06-27T03:52:00.228+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:52:00.323582715Z [2024-06-27T03:52:00.323+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:52:00.323609078Z 2024-06-27T03:52:00.323613258Z 2024-06-27T03:52:00.323639883Z 2024-06-27T03:52:00.323643538Z 2024-06-27T03:52:00.323649605Z [2024-06-27T03:52:00.323+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:52:00.323665141Z [2024-06-27T03:52:00.323+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:52:00.324016109Z [2024-06-27T03:52:00.323+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:52:00.324262433Z [2024-06-27T03:52:00.323+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:52:00.325110086Z [2024-06-27T03:52:00.324+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:52:00.325122925Z 2024-06-27T03:52:00.325126870Z 2024-06-27T03:52:00.325130034Z 2024-06-27T03:52:00.325146694Z 2024-06-27T03:52:00.329388172Z [2024-06-27T03:52:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:52:00.329519791Z [2024-06-27T03:52:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:52:00.329776222Z [2024-06-27T03:52:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:52:00.329976302Z [2024-06-27T03:52:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:52:00.330261017Z [2024-06-27T03:52:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:52:00.330590818Z [2024-06-27T03:52:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:52:00.330956818Z [2024-06-27T03:52:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:52:00.331109817Z [2024-06-27T03:52:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:52:00.639275156Z [2024-06-27T03:52:00.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status queued for try_number 1 2024-06-27T03:52:00.639323662Z [2024-06-27T03:52:00.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:51:00+00:00 exited with status queued for try_number 1 2024-06-27T03:52:00.639480175Z [2024-06-27T03:52:00.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:51:00+00:00 exited with status queued for try_number 1 2024-06-27T03:52:00.639565498Z [2024-06-27T03:52:00.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:51:00+00:00 exited with status queued for try_number 1 2024-06-27T03:52:00.647487697Z [2024-06-27T03:52:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5599dae8-9af1-4e28-bdd9-6cd7780be169 2024-06-27T03:52:00.647619388Z [2024-06-27T03:52:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to d59431b7-893b-4e98-97e7-e9d39073140c 2024-06-27T03:52:00.647807474Z [2024-06-27T03:52:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08aa0c90-010b-43c9-8336-10a73ea472c4 2024-06-27T03:52:00.647916356Z [2024-06-27T03:52:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f9ff999-4619-4cd1-a191-cb3268a36b6d 2024-06-27T03:52:01.977817833Z [2024-06-27T03:52:01.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:52:01.978283296Z [2024-06-27T03:52:01.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:50:00+00:00, run_id=scheduled__2024-06-27T03:50:00+00:00, run_start_date=2024-06-27 03:52:00.240346+00:00, run_end_date=2024-06-27 03:52:01.977910+00:00, run_duration=1.737564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:50:00+00:00, data_interval_end=2024-06-27 03:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:52:01.985073476Z [2024-06-27T03:52:01.984+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:52:00+00:00, run_after=2024-06-27T03:54:00+00:00 2024-06-27T03:52:01.999260888Z [2024-06-27T03:52:01.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:52:01.999679701Z [2024-06-27T03:52:01.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:51:00+00:00, run_id=scheduled__2024-06-27T03:51:00+00:00, run_start_date=2024-06-27 03:52:00.241771+00:00, run_end_date=2024-06-27 03:52:01.999346+00:00, run_duration=1.757575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:51:00+00:00, data_interval_end=2024-06-27 03:52:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:52:02.012632128Z [2024-06-27T03:52:02.012+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:52:00+00:00, run_after=2024-06-27T03:53:00+00:00 2024-06-27T03:52:02.072457967Z [2024-06-27T03:52:02.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status success for try_number 1 2024-06-27T03:52:02.072636438Z [2024-06-27T03:52:02.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:51:00+00:00 exited with status success for try_number 1 2024-06-27T03:52:02.080805386Z [2024-06-27T03:52:02.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:50:00+00:00, map_index=-1, run_start_date=2024-06-27 03:52:01.218023+00:00, run_end_date=2024-06-27 03:52:01.676557+00:00, run_duration=0.458534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:52:00.326619+00:00, queued_by_job_id=2, pid=4434 2024-06-27T03:52:02.081027777Z [2024-06-27T03:52:02.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:51:00+00:00, map_index=-1, run_start_date=2024-06-27 03:52:01.350418+00:00, run_end_date=2024-06-27 03:52:01.864022+00:00, run_duration=0.513604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:52:00.326619+00:00, queued_by_job_id=2, pid=4435 2024-06-27T03:52:05.367670139Z [2024-06-27T03:52:05.367+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:52:05.368007719Z [2024-06-27T03:52:05.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:51:00+00:00, run_id=scheduled__2024-06-27T03:51:00+00:00, run_start_date=2024-06-27 03:52:00.242800+00:00, run_end_date=2024-06-27 03:52:05.367687+00:00, run_duration=5.124887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:51:00+00:00, data_interval_end=2024-06-27 03:52:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:52:05.377016371Z [2024-06-27T03:52:05.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:52:00+00:00, run_after=2024-06-27T03:53:00+00:00 2024-06-27T03:52:05.382516440Z [2024-06-27T03:52:05.382+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:52:05.382823817Z [2024-06-27T03:52:05.382+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:51:00+00:00, run_id=scheduled__2024-06-27T03:51:00+00:00, run_start_date=2024-06-27 03:52:00.243856+00:00, run_end_date=2024-06-27 03:52:05.382498+00:00, run_duration=5.138642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:51:00+00:00, data_interval_end=2024-06-27 03:52:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:52:05.399338787Z [2024-06-27T03:52:05.393+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:52:00+00:00, run_after=2024-06-27T03:53:00+00:00 2024-06-27T03:52:05.434890273Z [2024-06-27T03:52:05.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:51:00+00:00 exited with status success for try_number 1 2024-06-27T03:52:05.435126192Z [2024-06-27T03:52:05.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:51:00+00:00 exited with status success for try_number 1 2024-06-27T03:52:05.445876751Z [2024-06-27T03:52:05.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:51:00+00:00, map_index=-1, run_start_date=2024-06-27 03:52:02.702502+00:00, run_end_date=2024-06-27 03:52:04.473268+00:00, run_duration=1.770766, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:52:00.326619+00:00, queued_by_job_id=2, pid=4475 2024-06-27T03:52:05.446144204Z [2024-06-27T03:52:05.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:51:00+00:00, map_index=-1, run_start_date=2024-06-27 03:52:02.547485+00:00, run_end_date=2024-06-27 03:52:04.476720+00:00, run_duration=1.929235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:52:00.326619+00:00, queued_by_job_id=2, pid=4474 2024-06-27T03:53:00.106020912Z [2024-06-27T03:53:00.105+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:53:00.137181887Z [2024-06-27T03:53:00.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:53:00+00:00, run_after=2024-06-27T03:54:00+00:00 2024-06-27T03:53:00.162735702Z [2024-06-27T03:53:00.162+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:53:00+00:00, run_after=2024-06-27T03:54:00+00:00 2024-06-27T03:53:00.257378870Z [2024-06-27T03:53:00.257+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:53:00.257402157Z 2024-06-27T03:53:00.257406141Z 2024-06-27T03:53:00.257409306Z 2024-06-27T03:53:00.257693557Z [2024-06-27T03:53:00.257+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:53:00.257956338Z [2024-06-27T03:53:00.257+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:53:00.258195065Z [2024-06-27T03:53:00.257+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:53:00.258798829Z [2024-06-27T03:53:00.258+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:53:00.258809488Z 2024-06-27T03:53:00.258813125Z 2024-06-27T03:53:00.258816043Z 2024-06-27T03:53:00.263780482Z [2024-06-27T03:53:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:53:00.264533372Z [2024-06-27T03:53:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:53:00.264942712Z [2024-06-27T03:53:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:53:00.265189561Z [2024-06-27T03:53:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:53:00.265505663Z [2024-06-27T03:53:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:53:00.269154822Z [2024-06-27T03:53:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:53:00.546827469Z [2024-06-27T03:53:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:52:00+00:00 exited with status queued for try_number 1 2024-06-27T03:53:00.546858399Z [2024-06-27T03:53:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:52:00+00:00 exited with status queued for try_number 1 2024-06-27T03:53:00.546922789Z [2024-06-27T03:53:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:52:00+00:00 exited with status queued for try_number 1 2024-06-27T03:53:00.566229650Z [2024-06-27T03:53:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f511352-5f20-4d20-bda1-4a7d9a5db976 2024-06-27T03:53:00.566307207Z [2024-06-27T03:53:00.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cc36545-38f6-49cb-a698-d6ebf23e6fde 2024-06-27T03:53:00.566404536Z [2024-06-27T03:53:00.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b45ef0a-a10e-4159-938e-3404fb625832 2024-06-27T03:53:01.774839371Z [2024-06-27T03:53:01.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:53:01.775808717Z [2024-06-27T03:53:01.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:52:00+00:00, run_id=scheduled__2024-06-27T03:52:00+00:00, run_start_date=2024-06-27 03:53:00.189065+00:00, run_end_date=2024-06-27 03:53:01.775115+00:00, run_duration=1.58605, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:52:00+00:00, data_interval_end=2024-06-27 03:53:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:53:01.808160760Z [2024-06-27T03:53:01.807+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:53:00+00:00, run_after=2024-06-27T03:54:00+00:00 2024-06-27T03:53:01.852679075Z [2024-06-27T03:53:01.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:52:00+00:00 exited with status success for try_number 1 2024-06-27T03:53:01.861465096Z [2024-06-27T03:53:01.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:52:00+00:00, map_index=-1, run_start_date=2024-06-27 03:53:01.199026+00:00, run_end_date=2024-06-27 03:53:01.553228+00:00, run_duration=0.354202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:53:00.259568+00:00, queued_by_job_id=2, pid=4519 2024-06-27T03:53:04.018126340Z [2024-06-27T03:53:04.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:53:04.018336020Z [2024-06-27T03:53:04.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:52:00+00:00, run_id=scheduled__2024-06-27T03:52:00+00:00, run_start_date=2024-06-27 03:53:00.191397+00:00, run_end_date=2024-06-27 03:53:04.018029+00:00, run_duration=3.826632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:52:00+00:00, data_interval_end=2024-06-27 03:53:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:53:04.027241839Z [2024-06-27T03:53:04.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:53:00+00:00, run_after=2024-06-27T03:54:00+00:00 2024-06-27T03:53:04.080517929Z [2024-06-27T03:53:04.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:52:00+00:00 exited with status success for try_number 1 2024-06-27T03:53:04.090777396Z [2024-06-27T03:53:04.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:52:00+00:00, map_index=-1, run_start_date=2024-06-27 03:53:02.317234+00:00, run_end_date=2024-06-27 03:53:03.856558+00:00, run_duration=1.539324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:53:00.259568+00:00, queued_by_job_id=2, pid=4549 2024-06-27T03:53:04.599208341Z [2024-06-27T03:53:04.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:53:04.599384820Z [2024-06-27T03:53:04.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:52:00+00:00, run_id=scheduled__2024-06-27T03:52:00+00:00, run_start_date=2024-06-27 03:53:00.192414+00:00, run_end_date=2024-06-27 03:53:04.598860+00:00, run_duration=4.406446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:52:00+00:00, data_interval_end=2024-06-27 03:53:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:53:04.619703764Z [2024-06-27T03:53:04.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:53:00+00:00, run_after=2024-06-27T03:54:00+00:00 2024-06-27T03:53:04.668721530Z [2024-06-27T03:53:04.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:52:00+00:00 exited with status success for try_number 1 2024-06-27T03:53:04.676113571Z [2024-06-27T03:53:04.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:52:00+00:00, map_index=-1, run_start_date=2024-06-27 03:53:02.484955+00:00, run_end_date=2024-06-27 03:53:04.192182+00:00, run_duration=1.707227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:53:00.259568+00:00, queued_by_job_id=2, pid=4550 2024-06-27T03:54:00.024115895Z [2024-06-27T03:54:00.023+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:54:00+00:00, run_after=2024-06-27T03:55:00+00:00 2024-06-27T03:54:00.031255401Z [2024-06-27T03:54:00.030+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:54:00.043931209Z [2024-06-27T03:54:00.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:54:00+00:00, run_after=2024-06-27T03:55:00+00:00 2024-06-27T03:54:00.054341514Z [2024-06-27T03:54:00.054+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:54:00.145489501Z [2024-06-27T03:54:00.145+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:54:00.145533094Z 2024-06-27T03:54:00.145543958Z 2024-06-27T03:54:00.145552700Z 2024-06-27T03:54:00.145561545Z 2024-06-27T03:54:00.146605635Z [2024-06-27T03:54:00.146+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:54:00.146925749Z [2024-06-27T03:54:00.146+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:54:00.147375156Z [2024-06-27T03:54:00.147+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:54:00.147655965Z [2024-06-27T03:54:00.147+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:54:00.148677495Z [2024-06-27T03:54:00.148+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:54:00.148691985Z 2024-06-27T03:54:00.148700776Z 2024-06-27T03:54:00.148708992Z 2024-06-27T03:54:00.148717583Z 2024-06-27T03:54:00.156110069Z [2024-06-27T03:54:00.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:54:00.156315352Z [2024-06-27T03:54:00.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:54:00.156706031Z [2024-06-27T03:54:00.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:54:00.156975902Z [2024-06-27T03:54:00.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:54:00.157437222Z [2024-06-27T03:54:00.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:54:00.157680715Z [2024-06-27T03:54:00.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:54:00.158020863Z [2024-06-27T03:54:00.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:54:00.158228813Z [2024-06-27T03:54:00.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:54:00.704456108Z [2024-06-27T03:54:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:52:00+00:00 exited with status queued for try_number 1 2024-06-27T03:54:00.704660303Z [2024-06-27T03:54:00.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:53:00+00:00 exited with status queued for try_number 1 2024-06-27T03:54:00.704901409Z [2024-06-27T03:54:00.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:53:00+00:00 exited with status queued for try_number 1 2024-06-27T03:54:00.705065368Z [2024-06-27T03:54:00.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:53:00+00:00 exited with status queued for try_number 1 2024-06-27T03:54:00.734291260Z [2024-06-27T03:54:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01ba6e25-c325-4082-a8da-22c214c542bc 2024-06-27T03:54:00.734608038Z [2024-06-27T03:54:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to 126bf90a-65cc-4d20-94b1-e8061c3d79a9 2024-06-27T03:54:00.734843871Z [2024-06-27T03:54:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to 653cb174-3efc-44fb-abff-2ba4a8861fd5 2024-06-27T03:54:00.735054993Z [2024-06-27T03:54:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8ec729d-deed-4bc7-a5e5-5399b6017de4 2024-06-27T03:54:02.011833198Z [2024-06-27T03:54:02.011+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:54:02.012485530Z [2024-06-27T03:54:02.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:52:00+00:00, run_id=scheduled__2024-06-27T03:52:00+00:00, run_start_date=2024-06-27 03:54:00.067398+00:00, run_end_date=2024-06-27 03:54:02.012055+00:00, run_duration=1.944657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:52:00+00:00, data_interval_end=2024-06-27 03:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:54:02.037765087Z [2024-06-27T03:54:02.037+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:54:00+00:00, run_after=2024-06-27T03:56:00+00:00 2024-06-27T03:54:02.050434790Z [2024-06-27T03:54:02.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:54:02.050705841Z [2024-06-27T03:54:02.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:53:00+00:00, run_id=scheduled__2024-06-27T03:53:00+00:00, run_start_date=2024-06-27 03:54:00.068579+00:00, run_end_date=2024-06-27 03:54:02.050408+00:00, run_duration=1.981829, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:53:00+00:00, data_interval_end=2024-06-27 03:54:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:54:02.077507332Z [2024-06-27T03:54:02.077+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:54:00+00:00, run_after=2024-06-27T03:55:00+00:00 2024-06-27T03:54:02.129821635Z [2024-06-27T03:54:02.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:52:00+00:00 exited with status success for try_number 1 2024-06-27T03:54:02.130232276Z [2024-06-27T03:54:02.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:53:00+00:00 exited with status success for try_number 1 2024-06-27T03:54:02.137829341Z [2024-06-27T03:54:02.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:52:00+00:00, map_index=-1, run_start_date=2024-06-27 03:54:00.939270+00:00, run_end_date=2024-06-27 03:54:01.513824+00:00, run_duration=0.574554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:54:00.150917+00:00, queued_by_job_id=2, pid=4595 2024-06-27T03:54:02.138165471Z [2024-06-27T03:54:02.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:53:00+00:00, map_index=-1, run_start_date=2024-06-27 03:54:01.122611+00:00, run_end_date=2024-06-27 03:54:01.845851+00:00, run_duration=0.72324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:54:00.150917+00:00, queued_by_job_id=2, pid=4596 2024-06-27T03:54:04.291458903Z [2024-06-27T03:54:04.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:54:04.291951885Z [2024-06-27T03:54:04.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:53:00+00:00, run_id=scheduled__2024-06-27T03:53:00+00:00, run_start_date=2024-06-27 03:54:00.069695+00:00, run_end_date=2024-06-27 03:54:04.291315+00:00, run_duration=4.22162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:53:00+00:00, data_interval_end=2024-06-27 03:54:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:54:04.304813825Z [2024-06-27T03:54:04.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:54:00+00:00, run_after=2024-06-27T03:55:00+00:00 2024-06-27T03:54:04.360590048Z [2024-06-27T03:54:04.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:53:00+00:00 exited with status success for try_number 1 2024-06-27T03:54:04.367877075Z [2024-06-27T03:54:04.367+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:53:00+00:00, map_index=-1, run_start_date=2024-06-27 03:54:02.436643+00:00, run_end_date=2024-06-27 03:54:03.752048+00:00, run_duration=1.315405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:54:00.150917+00:00, queued_by_job_id=2, pid=4635 2024-06-27T03:54:05.845318718Z [2024-06-27T03:54:05.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:54:05.845721988Z [2024-06-27T03:54:05.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:53:00+00:00, run_id=scheduled__2024-06-27T03:53:00+00:00, run_start_date=2024-06-27 03:54:00.070707+00:00, run_end_date=2024-06-27 03:54:05.845251+00:00, run_duration=5.774544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:53:00+00:00, data_interval_end=2024-06-27 03:54:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:54:05.869741364Z [2024-06-27T03:54:05.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:54:00+00:00, run_after=2024-06-27T03:55:00+00:00 2024-06-27T03:54:07.022649910Z [2024-06-27T03:54:07.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:53:00+00:00 exited with status success for try_number 1 2024-06-27T03:54:07.032149277Z [2024-06-27T03:54:07.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:53:00+00:00, map_index=-1, run_start_date=2024-06-27 03:54:02.550223+00:00, run_end_date=2024-06-27 03:54:05.771369+00:00, run_duration=3.221146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:54:00.150917+00:00, queued_by_job_id=2, pid=4636 2024-06-27T03:55:00.404425499Z [2024-06-27T03:55:00.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:55:00+00:00, run_after=2024-06-27T03:56:00+00:00 2024-06-27T03:55:00.421049502Z [2024-06-27T03:55:00.420+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:55:00.448154279Z [2024-06-27T03:55:00.447+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:55:00+00:00, run_after=2024-06-27T03:56:00+00:00 2024-06-27T03:55:00.471893417Z [2024-06-27T03:55:00.471+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:55:00+00:00, run_after=2024-06-27T04:00:00+00:00 2024-06-27T03:55:00.595905948Z [2024-06-27T03:55:00.595+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:55:00.595970161Z 2024-06-27T03:55:00.595979628Z 2024-06-27T03:55:00.595987043Z 2024-06-27T03:55:00.595994211Z 2024-06-27T03:55:00.596001288Z [2024-06-27T03:55:00.595+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:55:00.596347489Z [2024-06-27T03:55:00.596+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:55:00.596809476Z [2024-06-27T03:55:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:55:00.597052672Z [2024-06-27T03:55:00.596+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:55:00.598760763Z [2024-06-27T03:55:00.597+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:55:00.598783896Z 2024-06-27T03:55:00.598792547Z 2024-06-27T03:55:00.598799932Z 2024-06-27T03:55:00.598807127Z 2024-06-27T03:55:00.606246991Z [2024-06-27T03:55:00.605+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T03:55:00.606369491Z [2024-06-27T03:55:00.606+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:55:00.606794499Z [2024-06-27T03:55:00.606+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:55:00.606893044Z [2024-06-27T03:55:00.606+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:55:00.607299480Z [2024-06-27T03:55:00.607+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:55:00.607501310Z [2024-06-27T03:55:00.607+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:55:00.607850932Z [2024-06-27T03:55:00.607+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:55:00.607965013Z [2024-06-27T03:55:00.607+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:55:00.971502311Z [2024-06-27T03:55:00.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status queued for try_number 1 2024-06-27T03:55:00.972000866Z [2024-06-27T03:55:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:54:00+00:00 exited with status queued for try_number 1 2024-06-27T03:55:00.972084960Z [2024-06-27T03:55:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:54:00+00:00 exited with status queued for try_number 1 2024-06-27T03:55:00.972499037Z [2024-06-27T03:55:00.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:54:00+00:00 exited with status queued for try_number 1 2024-06-27T03:55:00.982629455Z [2024-06-27T03:55:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a3ba705-e590-4e0a-929b-06f9ab959600 2024-06-27T03:55:00.982996606Z [2024-06-27T03:55:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56681f07-aacb-46dc-8c0b-a5f18b4571e5 2024-06-27T03:55:00.983194833Z [2024-06-27T03:55:00.983+0000] {scheduler_job.py:635} INFO - Setting external_id for to df301e33-1671-4fb3-9360-e9a3b3c9c334 2024-06-27T03:55:00.983377338Z [2024-06-27T03:55:00.983+0000] {scheduler_job.py:635} INFO - Setting external_id for to f553e0c9-61a5-4111-ba0d-2195d3006d43 2024-06-27T03:55:02.985725435Z [2024-06-27T03:55:02.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:55:02.986210356Z [2024-06-27T03:55:02.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:54:00+00:00, run_id=scheduled__2024-06-27T03:54:00+00:00, run_start_date=2024-06-27 03:55:00.485669+00:00, run_end_date=2024-06-27 03:55:02.985655+00:00, run_duration=2.499986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:54:00+00:00, data_interval_end=2024-06-27 03:55:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:55:03.007386056Z [2024-06-27T03:55:03.007+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:55:00+00:00, run_after=2024-06-27T03:56:00+00:00 2024-06-27T03:55:03.227336077Z [2024-06-27T03:55:03.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:54:00+00:00 exited with status success for try_number 1 2024-06-27T03:55:03.251359376Z [2024-06-27T03:55:03.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:54:00+00:00, map_index=-1, run_start_date=2024-06-27 03:55:01.767528+00:00, run_end_date=2024-06-27 03:55:02.182272+00:00, run_duration=0.414744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:55:00.600852+00:00, queued_by_job_id=2, pid=4680 2024-06-27T03:55:04.361350216Z [2024-06-27T03:55:04.357+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:55:04.361409162Z 2024-06-27T03:55:04.361442644Z [2024-06-27T03:55:04.358+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:55:04.361457649Z [2024-06-27T03:55:04.359+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:55:04.361470069Z 2024-06-27T03:55:04.369245527Z [2024-06-27T03:55:04.366+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T03:55:04.369296485Z [2024-06-27T03:55:04.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:55:04.427685341Z [2024-06-27T03:55:04.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status queued for try_number 1 2024-06-27T03:55:04.428333931Z [2024-06-27T03:55:04.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status success for try_number 1 2024-06-27T03:55:04.435997609Z [2024-06-27T03:55:04.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c02f093-35c4-44a1-a2c8-64602bdb78e1 2024-06-27T03:55:04.436591946Z [2024-06-27T03:55:04.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:50:00+00:00, map_index=-1, run_start_date=2024-06-27 03:55:03.687135+00:00, run_end_date=2024-06-27 03:55:04.127224+00:00, run_duration=0.440089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:55:00.600852+00:00, queued_by_job_id=2, pid=4740 2024-06-27T03:55:04.838293068Z [2024-06-27T03:55:04.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:55:04.839353905Z [2024-06-27T03:55:04.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:54:00+00:00, run_id=scheduled__2024-06-27T03:54:00+00:00, run_start_date=2024-06-27 03:55:00.486636+00:00, run_end_date=2024-06-27 03:55:04.838111+00:00, run_duration=4.351475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:54:00+00:00, data_interval_end=2024-06-27 03:55:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:55:04.852986583Z [2024-06-27T03:55:04.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:55:00+00:00, run_after=2024-06-27T03:56:00+00:00 2024-06-27T03:55:04.928022359Z [2024-06-27T03:55:04.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:54:00+00:00 exited with status success for try_number 1 2024-06-27T03:55:04.933754920Z [2024-06-27T03:55:04.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:54:00+00:00, map_index=-1, run_start_date=2024-06-27 03:55:03.215734+00:00, run_end_date=2024-06-27 03:55:04.559742+00:00, run_duration=1.344008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:55:00.600852+00:00, queued_by_job_id=2, pid=4712 2024-06-27T03:55:04.945610463Z [2024-06-27T03:55:04.945+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T03:55:05.297246369Z [2024-06-27T03:55:05.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:55:05.297686191Z [2024-06-27T03:55:05.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:54:00+00:00, run_id=scheduled__2024-06-27T03:54:00+00:00, run_start_date=2024-06-27 03:55:00.487548+00:00, run_end_date=2024-06-27 03:55:05.297335+00:00, run_duration=4.809787, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:54:00+00:00, data_interval_end=2024-06-27 03:55:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:55:05.310061926Z [2024-06-27T03:55:05.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:55:00+00:00, run_after=2024-06-27T03:56:00+00:00 2024-06-27T03:55:05.356084593Z [2024-06-27T03:55:05.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:54:00+00:00 exited with status success for try_number 1 2024-06-27T03:55:05.361558363Z [2024-06-27T03:55:05.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:54:00+00:00, map_index=-1, run_start_date=2024-06-27 03:55:03.026052+00:00, run_end_date=2024-06-27 03:55:04.985105+00:00, run_duration=1.959053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:55:00.600852+00:00, queued_by_job_id=2, pid=4711 2024-06-27T03:55:06.949153101Z [2024-06-27T03:55:06.948+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:55:06.949197176Z 2024-06-27T03:55:06.949300970Z [2024-06-27T03:55:06.948+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:55:06.950261715Z [2024-06-27T03:55:06.949+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:55:06.950304923Z 2024-06-27T03:55:06.954284527Z [2024-06-27T03:55:06.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T03:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T03:55:06.954629193Z [2024-06-27T03:55:06.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T03:55:07.022103158Z [2024-06-27T03:55:07.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status queued for try_number 1 2024-06-27T03:55:07.022319818Z [2024-06-27T03:55:07.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status success for try_number 1 2024-06-27T03:55:07.029847326Z [2024-06-27T03:55:07.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d76a05d-b1dd-452c-8771-2895e46b8063 2024-06-27T03:55:07.030187462Z [2024-06-27T03:55:07.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T03:50:00+00:00, map_index=-1, run_start_date=2024-06-27 03:55:06.089582+00:00, run_end_date=2024-06-27 03:55:06.509892+00:00, run_duration=0.42031, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:55:04.361696+00:00, queued_by_job_id=2, pid=4761 2024-06-27T03:55:09.580149207Z [2024-06-27T03:55:09.579+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:55:09.580185916Z 2024-06-27T03:55:09.580248783Z [2024-06-27T03:55:09.580+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:55:09.580889911Z [2024-06-27T03:55:09.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:55:09.580904638Z 2024-06-27T03:55:09.584550331Z [2024-06-27T03:55:09.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:55:09.584655958Z [2024-06-27T03:55:09.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T03:55:09.642055349Z [2024-06-27T03:55:09.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status queued for try_number 1 2024-06-27T03:55:09.642147801Z [2024-06-27T03:55:09.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status success for try_number 1 2024-06-27T03:55:09.648671160Z [2024-06-27T03:55:09.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to afe5c316-56c6-45bc-a448-bab7c0eb2b88 2024-06-27T03:55:09.648959835Z [2024-06-27T03:55:09.648+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T03:50:00+00:00, map_index=0, run_start_date=2024-06-27 03:55:08.654033+00:00, run_end_date=2024-06-27 03:55:09.123202+00:00, run_duration=0.469169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:55:06.950880+00:00, queued_by_job_id=2, pid=4773 2024-06-27T03:55:11.927414048Z [2024-06-27T03:55:11.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:55:11.927898531Z [2024-06-27T03:55:11.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:50:00+00:00, run_id=scheduled__2024-06-27T03:50:00+00:00, run_start_date=2024-06-27 03:55:00.484379+00:00, run_end_date=2024-06-27 03:55:11.927264+00:00, run_duration=11.442885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:50:00+00:00, data_interval_end=2024-06-27 03:55:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T03:55:11.937215057Z [2024-06-27T03:55:11.936+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:55:00+00:00, run_after=2024-06-27T04:00:00+00:00 2024-06-27T03:55:11.986216799Z [2024-06-27T03:55:11.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:50:00+00:00 exited with status success for try_number 1 2024-06-27T03:55:11.996999172Z [2024-06-27T03:55:11.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T03:50:00+00:00, map_index=-1, run_start_date=2024-06-27 03:55:11.196659+00:00, run_end_date=2024-06-27 03:55:11.580431+00:00, run_duration=0.383772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:55:09.582425+00:00, queued_by_job_id=2, pid=4785 2024-06-27T03:55:35.462472141Z [2024-06-27T03:55:35.462+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca to 2024-06-27T03:55:00+00:00, run_after=2024-06-27T03:56:00+00:00 2024-06-27T03:55:35.498921740Z [2024-06-27T03:55:35.497+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:55:35.498943486Z 2024-06-27T03:55:35.500943224Z [2024-06-27T03:55:35.499+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca has 0/16 running and queued tasks 2024-06-27T03:55:35.504172049Z [2024-06-27T03:55:35.503+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:55:35.504196339Z 2024-06-27T03:55:35.507452022Z [2024-06-27T03:55:35.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:55:35.508142820Z [2024-06-27T03:55:35.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:55:35.570517116Z [2024-06-27T03:55:35.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:54:00+00:00 exited with status queued for try_number 1 2024-06-27T03:55:35.580922849Z [2024-06-27T03:55:35.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05faa2ad-b88c-418a-a217-7a7c6368118e 2024-06-27T03:55:37.494339587Z [2024-06-27T03:55:37.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:55:37.494578062Z [2024-06-27T03:55:37.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca, execution_date=2024-06-27 03:54:00+00:00, run_id=scheduled__2024-06-27T03:54:00+00:00, run_start_date=2024-06-27 03:55:35.471127+00:00, run_end_date=2024-06-27 03:55:37.494156+00:00, run_duration=2.023029, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:54:00+00:00, data_interval_end=2024-06-27 03:55:00+00:00, dag_hash=e65a1c634786a6a503810f2d41f78066 2024-06-27T03:55:37.505040694Z [2024-06-27T03:55:37.504+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca to 2024-06-27T03:55:00+00:00, run_after=2024-06-27T03:56:00+00:00 2024-06-27T03:55:37.539016668Z [2024-06-27T03:55:37.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:54:00+00:00 exited with status success for try_number 1 2024-06-27T03:55:37.545195218Z [2024-06-27T03:55:37.544+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:54:00+00:00, map_index=-1, run_start_date=2024-06-27 03:55:36.212065+00:00, run_end_date=2024-06-27 03:55:36.611928+00:00, run_duration=0.399863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:55:35.504818+00:00, queued_by_job_id=2, pid=4809 2024-06-27T03:56:00.882437929Z [2024-06-27T03:56:00.881+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:56:00.898155640Z [2024-06-27T03:56:00.897+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:56:00.916180909Z [2024-06-27T03:56:00.915+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:56:00+00:00, run_after=2024-06-27T03:57:00+00:00 2024-06-27T03:56:00.928454883Z [2024-06-27T03:56:00.928+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca to 2024-06-27T03:56:00+00:00, run_after=2024-06-27T03:57:00+00:00 2024-06-27T03:56:00.939738543Z [2024-06-27T03:56:00.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:56:00+00:00, run_after=2024-06-27T03:57:00+00:00 2024-06-27T03:56:01.019856856Z [2024-06-27T03:56:01.019+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T03:56:01.019903329Z 2024-06-27T03:56:01.019915360Z 2024-06-27T03:56:01.019926474Z 2024-06-27T03:56:01.019935810Z 2024-06-27T03:56:01.019943889Z 2024-06-27T03:56:01.019954297Z [2024-06-27T03:56:01.019+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:56:01.019981712Z [2024-06-27T03:56:01.019+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:56:01.020000101Z [2024-06-27T03:56:01.019+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca has 0/16 running and queued tasks 2024-06-27T03:56:01.020120038Z [2024-06-27T03:56:01.019+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:56:01.020243237Z [2024-06-27T03:56:01.020+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:56:01.020845466Z [2024-06-27T03:56:01.020+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:56:01.020865245Z 2024-06-27T03:56:01.020872371Z 2024-06-27T03:56:01.020878748Z 2024-06-27T03:56:01.020885863Z 2024-06-27T03:56:01.020892391Z 2024-06-27T03:56:01.025064885Z [2024-06-27T03:56:01.024+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:56:01.025094499Z [2024-06-27T03:56:01.024+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:56:01.025327238Z [2024-06-27T03:56:01.025+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:56:01.025385767Z [2024-06-27T03:56:01.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:56:01.025605821Z [2024-06-27T03:56:01.025+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:56:01.025620513Z [2024-06-27T03:56:01.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:56:01.025789711Z [2024-06-27T03:56:01.025+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:56:01.025871932Z [2024-06-27T03:56:01.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:56:01.026009135Z [2024-06-27T03:56:01.025+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:56:01.026061939Z [2024-06-27T03:56:01.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:56:01.617591677Z [2024-06-27T03:56:01.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:54:00+00:00 exited with status queued for try_number 1 2024-06-27T03:56:01.617915752Z [2024-06-27T03:56:01.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status queued for try_number 1 2024-06-27T03:56:01.618104619Z [2024-06-27T03:56:01.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status queued for try_number 1 2024-06-27T03:56:01.618331375Z [2024-06-27T03:56:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status queued for try_number 1 2024-06-27T03:56:01.618541760Z [2024-06-27T03:56:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status queued for try_number 1 2024-06-27T03:56:01.638278889Z [2024-06-27T03:56:01.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bd98362-b8ec-4aac-81aa-cdddebff1b32 2024-06-27T03:56:01.640165162Z [2024-06-27T03:56:01.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8957892c-f717-48bf-8c6b-204a8a758f96 2024-06-27T03:56:01.640375802Z [2024-06-27T03:56:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6461c82-9c0e-4508-ac8d-a3c17e2c82e2 2024-06-27T03:56:01.643099948Z [2024-06-27T03:56:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9157d8c9-eb59-4e57-9465-103fbe2f68b9 2024-06-27T03:56:01.643222428Z [2024-06-27T03:56:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to af662a05-82f5-49ab-a26d-abac1c51b001 2024-06-27T03:56:02.911981617Z [2024-06-27T03:56:02.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:56:02.912522034Z [2024-06-27T03:56:02.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:54:00+00:00, run_id=scheduled__2024-06-27T03:54:00+00:00, run_start_date=2024-06-27 03:56:00.955342+00:00, run_end_date=2024-06-27 03:56:02.911897+00:00, run_duration=1.956555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:54:00+00:00, data_interval_end=2024-06-27 03:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:56:02.930303824Z [2024-06-27T03:56:02.929+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:56:00+00:00, run_after=2024-06-27T03:58:00+00:00 2024-06-27T03:56:02.955876643Z [2024-06-27T03:56:02.955+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:56:02.957033037Z [2024-06-27T03:56:02.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca, execution_date=2024-06-27 03:55:00+00:00, run_id=scheduled__2024-06-27T03:55:00+00:00, run_start_date=2024-06-27 03:56:00.957046+00:00, run_end_date=2024-06-27 03:56:02.956616+00:00, run_duration=1.99957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:55:00+00:00, data_interval_end=2024-06-27 03:56:00+00:00, dag_hash=e65a1c634786a6a503810f2d41f78066 2024-06-27T03:56:02.970255397Z [2024-06-27T03:56:02.969+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca to 2024-06-27T03:56:00+00:00, run_after=2024-06-27T03:57:00+00:00 2024-06-27T03:56:03.039698407Z [2024-06-27T03:56:03.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:54:00+00:00 exited with status success for try_number 1 2024-06-27T03:56:03.041919150Z [2024-06-27T03:56:03.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status success for try_number 1 2024-06-27T03:56:03.054316572Z [2024-06-27T03:56:03.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:55:00+00:00, map_index=-1, run_start_date=2024-06-27 03:56:02.090892+00:00, run_end_date=2024-06-27 03:56:02.542214+00:00, run_duration=0.451322, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:56:01.021741+00:00, queued_by_job_id=2, pid=4834 2024-06-27T03:56:03.054760172Z [2024-06-27T03:56:03.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:54:00+00:00, map_index=-1, run_start_date=2024-06-27 03:56:02.047737+00:00, run_end_date=2024-06-27 03:56:02.510366+00:00, run_duration=0.462629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:56:01.021741+00:00, queued_by_job_id=2, pid=4833 2024-06-27T03:56:04.120359743Z [2024-06-27T03:56:04.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:56:04.120847938Z [2024-06-27T03:56:04.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:55:00+00:00, run_id=scheduled__2024-06-27T03:55:00+00:00, run_start_date=2024-06-27 03:56:00.958044+00:00, run_end_date=2024-06-27 03:56:04.120451+00:00, run_duration=3.162407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:55:00+00:00, data_interval_end=2024-06-27 03:56:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:56:04.129087140Z [2024-06-27T03:56:04.128+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:56:00+00:00, run_after=2024-06-27T03:57:00+00:00 2024-06-27T03:56:04.186929212Z [2024-06-27T03:56:04.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status success for try_number 1 2024-06-27T03:56:04.193787957Z [2024-06-27T03:56:04.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:55:00+00:00, map_index=-1, run_start_date=2024-06-27 03:56:02.581524+00:00, run_end_date=2024-06-27 03:56:03.138309+00:00, run_duration=0.556785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:56:01.021741+00:00, queued_by_job_id=2, pid=4863 2024-06-27T03:56:05.726086982Z [2024-06-27T03:56:05.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:56:05.726299391Z [2024-06-27T03:56:05.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:55:00+00:00, run_id=scheduled__2024-06-27T03:55:00+00:00, run_start_date=2024-06-27 03:56:00.958945+00:00, run_end_date=2024-06-27 03:56:05.725979+00:00, run_duration=4.767034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:55:00+00:00, data_interval_end=2024-06-27 03:56:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:56:05.735485485Z [2024-06-27T03:56:05.735+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:56:00+00:00, run_after=2024-06-27T03:57:00+00:00 2024-06-27T03:56:05.780748820Z [2024-06-27T03:56:05.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status success for try_number 1 2024-06-27T03:56:05.786641922Z [2024-06-27T03:56:05.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:55:00+00:00, map_index=-1, run_start_date=2024-06-27 03:56:03.366694+00:00, run_end_date=2024-06-27 03:56:05.479108+00:00, run_duration=2.112414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:56:01.021741+00:00, queued_by_job_id=2, pid=4883 2024-06-27T03:56:06.833184030Z [2024-06-27T03:56:06.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:56:06.833413949Z [2024-06-27T03:56:06.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:55:00+00:00, run_id=scheduled__2024-06-27T03:55:00+00:00, run_start_date=2024-06-27 03:56:00.959807+00:00, run_end_date=2024-06-27 03:56:06.833048+00:00, run_duration=5.873241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:55:00+00:00, data_interval_end=2024-06-27 03:56:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:56:06.845788826Z [2024-06-27T03:56:06.845+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:56:00+00:00, run_after=2024-06-27T03:57:00+00:00 2024-06-27T03:56:06.897787858Z [2024-06-27T03:56:06.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status success for try_number 1 2024-06-27T03:56:06.908040949Z [2024-06-27T03:56:06.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:55:00+00:00, map_index=-1, run_start_date=2024-06-27 03:56:03.836297+00:00, run_end_date=2024-06-27 03:56:05.890305+00:00, run_duration=2.054008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:56:01.021741+00:00, queued_by_job_id=2, pid=4902 2024-06-27T03:57:00.231805747Z [2024-06-27T03:57:00.231+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:57:00.249675350Z [2024-06-27T03:57:00.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:57:00+00:00, run_after=2024-06-27T03:58:00+00:00 2024-06-27T03:57:00.263840246Z [2024-06-27T03:57:00.263+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca to 2024-06-27T03:57:00+00:00, run_after=2024-06-27T03:58:00+00:00 2024-06-27T03:57:00.278059077Z [2024-06-27T03:57:00.277+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:57:00+00:00, run_after=2024-06-27T03:58:00+00:00 2024-06-27T03:57:00.394860871Z [2024-06-27T03:57:00.394+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:57:00.394899701Z 2024-06-27T03:57:00.394908220Z 2024-06-27T03:57:00.394915422Z 2024-06-27T03:57:00.394922528Z 2024-06-27T03:57:00.395109812Z [2024-06-27T03:57:00.394+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:57:00.395468171Z [2024-06-27T03:57:00.395+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca has 0/16 running and queued tasks 2024-06-27T03:57:00.395766437Z [2024-06-27T03:57:00.395+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:57:00.396033856Z [2024-06-27T03:57:00.395+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:57:00.397089190Z [2024-06-27T03:57:00.396+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:57:00.397103018Z 2024-06-27T03:57:00.397110369Z 2024-06-27T03:57:00.397117213Z 2024-06-27T03:57:00.397124093Z 2024-06-27T03:57:00.404203415Z [2024-06-27T03:57:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:57:00.404425650Z [2024-06-27T03:57:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:57:00.404674243Z [2024-06-27T03:57:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:57:00.404909164Z [2024-06-27T03:57:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:57:00.405288646Z [2024-06-27T03:57:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:57:00.405461916Z [2024-06-27T03:57:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:57:00.405750180Z [2024-06-27T03:57:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:57:00.405976476Z [2024-06-27T03:57:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:57:00.752745658Z [2024-06-27T03:57:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:56:00+00:00 exited with status queued for try_number 1 2024-06-27T03:57:00.752938335Z [2024-06-27T03:57:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:56:00+00:00 exited with status queued for try_number 1 2024-06-27T03:57:00.753079978Z [2024-06-27T03:57:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:56:00+00:00 exited with status queued for try_number 1 2024-06-27T03:57:00.753245153Z [2024-06-27T03:57:00.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:56:00+00:00 exited with status queued for try_number 1 2024-06-27T03:57:00.766431678Z [2024-06-27T03:57:00.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5de180a3-9b66-4a63-898a-6d3c9eb22009 2024-06-27T03:57:00.766751483Z [2024-06-27T03:57:00.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5b646cf-eb0d-409c-a2f2-088e8e65a547 2024-06-27T03:57:00.766921998Z [2024-06-27T03:57:00.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9d301a5-4cf0-419b-9358-359090cd761e 2024-06-27T03:57:00.767092953Z [2024-06-27T03:57:00.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9634cda0-dddd-46fc-9b62-bec77cc8d3a4 2024-06-27T03:57:02.006900168Z [2024-06-27T03:57:02.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:56:00+00:00 exited with status failed for try_number 1 2024-06-27T03:57:02.015622669Z [2024-06-27T03:57:02.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:56:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:57:00.398525+00:00, queued_by_job_id=2, pid=None 2024-06-27T03:57:02.016129422Z [2024-06-27T03:57:02.015+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:57:02.018760923Z [2024-06-27T03:57:02.018+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:57:02.032968256Z [2024-06-27T03:57:02.032+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240627T035600, start_date=, end_date=20240627T035702 2024-06-27T03:57:03.095328317Z [2024-06-27T03:57:03.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:57:03.095549699Z [2024-06-27T03:57:03.095+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:56:00+00:00, run_id=scheduled__2024-06-27T03:56:00+00:00, run_start_date=2024-06-27 03:57:00.301267+00:00, run_end_date=2024-06-27 03:57:03.095224+00:00, run_duration=2.793957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:56:00+00:00, data_interval_end=2024-06-27 03:57:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:57:03.109650176Z [2024-06-27T03:57:03.109+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:57:00+00:00, run_after=2024-06-27T03:58:00+00:00 2024-06-27T03:57:03.207346912Z [2024-06-27T03:57:03.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:56:00+00:00 exited with status success for try_number 1 2024-06-27T03:57:03.221848837Z [2024-06-27T03:57:03.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:56:00+00:00, map_index=-1, run_start_date=2024-06-27 03:57:01.437643+00:00, run_end_date=2024-06-27 03:57:01.868927+00:00, run_duration=0.431284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:57:00.398525+00:00, queued_by_job_id=2, pid=4955 2024-06-27T03:57:04.165647994Z [2024-06-27T03:57:04.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:56:00+00:00 exited with status success for try_number 1 2024-06-27T03:57:04.171856703Z [2024-06-27T03:57:04.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:56:00+00:00, map_index=-1, run_start_date=2024-06-27 03:57:02.526641+00:00, run_end_date=2024-06-27 03:57:03.990106+00:00, run_duration=1.463465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:57:00.398525+00:00, queued_by_job_id=2, pid=4985 2024-06-27T03:57:05.229219281Z [2024-06-27T03:57:05.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:57:05.229428412Z [2024-06-27T03:57:05.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:56:00+00:00, run_id=scheduled__2024-06-27T03:56:00+00:00, run_start_date=2024-06-27 03:57:00.303942+00:00, run_end_date=2024-06-27 03:57:05.229072+00:00, run_duration=4.92513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:56:00+00:00, data_interval_end=2024-06-27 03:57:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:57:05.238354084Z [2024-06-27T03:57:05.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:57:00+00:00, run_after=2024-06-27T03:58:00+00:00 2024-06-27T03:57:05.245327150Z [2024-06-27T03:57:05.244+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:57:05.245617422Z [2024-06-27T03:57:05.245+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:56:00+00:00, run_id=scheduled__2024-06-27T03:56:00+00:00, run_start_date=2024-06-27 03:57:00.302474+00:00, run_end_date=2024-06-27 03:57:05.245279+00:00, run_duration=4.942805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:56:00+00:00, data_interval_end=2024-06-27 03:57:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:57:05.255275894Z [2024-06-27T03:57:05.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:57:00+00:00, run_after=2024-06-27T03:58:00+00:00 2024-06-27T03:57:05.311219442Z [2024-06-27T03:57:05.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:56:00+00:00 exited with status success for try_number 1 2024-06-27T03:57:05.320662816Z [2024-06-27T03:57:05.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:56:00+00:00, map_index=-1, run_start_date=2024-06-27 03:57:02.618724+00:00, run_end_date=2024-06-27 03:57:04.586192+00:00, run_duration=1.967468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:57:00.398525+00:00, queued_by_job_id=2, pid=4986 2024-06-27T03:57:12.550663885Z [2024-06-27T03:57:12.549+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T03:57:12.550713301Z 2024-06-27T03:57:12.554242475Z [2024-06-27T03:57:12.550+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca has 0/16 running and queued tasks 2024-06-27T03:57:12.555205921Z [2024-06-27T03:57:12.554+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:57:12.555224832Z 2024-06-27T03:57:12.558930581Z [2024-06-27T03:57:12.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:56:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:57:12.559297965Z [2024-06-27T03:57:12.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:57:12.614784847Z [2024-06-27T03:57:12.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:56:00+00:00 exited with status queued for try_number 2 2024-06-27T03:57:12.625572789Z [2024-06-27T03:57:12.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 396c91ff-5828-4468-8763-47f4dea1311a 2024-06-27T03:57:13.854316700Z [2024-06-27T03:57:13.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:56:00+00:00 exited with status failed for try_number 2 2024-06-27T03:57:13.862686494Z [2024-06-27T03:57:13.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:56:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 03:57:02.021865+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:57:12.555885+00:00, queued_by_job_id=2, pid=None 2024-06-27T03:57:13.863273482Z [2024-06-27T03:57:13.862+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:57:13.866031442Z [2024-06-27T03:57:13.865+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T03:57:13.883046917Z [2024-06-27T03:57:13.882+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240627T035600, start_date=, end_date=20240627T035713 2024-06-27T03:57:14.334655524Z [2024-06-27T03:57:14.334+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T03:57:14.334987279Z [2024-06-27T03:57:14.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca, execution_date=2024-06-27 03:56:00+00:00, run_id=scheduled__2024-06-27T03:56:00+00:00, run_start_date=2024-06-27 03:57:00.299711+00:00, run_end_date=2024-06-27 03:57:14.334579+00:00, run_duration=14.034868, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:56:00+00:00, data_interval_end=2024-06-27 03:57:00+00:00, dag_hash=e65a1c634786a6a503810f2d41f78066 2024-06-27T03:57:14.342915980Z [2024-06-27T03:57:14.342+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83bb0383-eb1b-4afc-8248-ac6bc82251ca to 2024-06-27T03:57:00+00:00, run_after=2024-06-27T03:58:00+00:00 2024-06-27T03:58:01.014075262Z [2024-06-27T03:58:01.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:58:00+00:00, run_after=2024-06-27T03:59:00+00:00 2024-06-27T03:58:01.026280915Z [2024-06-27T03:58:01.025+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:58:01.048723229Z [2024-06-27T03:58:01.048+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:58:00+00:00, run_after=2024-06-27T03:59:00+00:00 2024-06-27T03:58:01.069872140Z [2024-06-27T03:58:01.067+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:58:01.211099236Z [2024-06-27T03:58:01.210+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T03:58:01.211148495Z 2024-06-27T03:58:01.211159776Z 2024-06-27T03:58:01.211168696Z 2024-06-27T03:58:01.211177279Z 2024-06-27T03:58:01.211977743Z [2024-06-27T03:58:01.211+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T03:58:01.212476410Z [2024-06-27T03:58:01.212+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:58:01.212898109Z [2024-06-27T03:58:01.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:58:01.213272739Z [2024-06-27T03:58:01.212+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:58:01.214357182Z [2024-06-27T03:58:01.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:58:01.214383191Z 2024-06-27T03:58:01.214386677Z 2024-06-27T03:58:01.214389725Z 2024-06-27T03:58:01.214393002Z 2024-06-27T03:58:01.219538480Z [2024-06-27T03:58:01.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:58:01.219794745Z [2024-06-27T03:58:01.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T03:58:01.220156822Z [2024-06-27T03:58:01.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:58:01.220692121Z [2024-06-27T03:58:01.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:58:01.221291819Z [2024-06-27T03:58:01.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:58:01.221456369Z [2024-06-27T03:58:01.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:58:01.221768687Z [2024-06-27T03:58:01.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:58:01.221936296Z [2024-06-27T03:58:01.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:58:01.704218958Z [2024-06-27T03:58:01.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:56:00+00:00 exited with status queued for try_number 1 2024-06-27T03:58:01.704395060Z [2024-06-27T03:58:01.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:57:00+00:00 exited with status queued for try_number 1 2024-06-27T03:58:01.704537143Z [2024-06-27T03:58:01.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:57:00+00:00 exited with status queued for try_number 1 2024-06-27T03:58:01.704649544Z [2024-06-27T03:58:01.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:57:00+00:00 exited with status queued for try_number 1 2024-06-27T03:58:01.719865771Z [2024-06-27T03:58:01.717+0000] {scheduler_job.py:635} INFO - Setting external_id for to 541b584e-a94b-456a-b299-daf6b57d2391 2024-06-27T03:58:01.720094947Z [2024-06-27T03:58:01.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2aff1d2-48fc-4055-8426-76ca96d606e3 2024-06-27T03:58:01.720269519Z [2024-06-27T03:58:01.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebe114be-00d0-42ff-9758-1f6765ba012c 2024-06-27T03:58:01.720455796Z [2024-06-27T03:58:01.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1772d7b-c0d2-4e27-af73-281a91de359b 2024-06-27T03:58:02.943977833Z [2024-06-27T03:58:02.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:58:02.944166045Z [2024-06-27T03:58:02.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:56:00+00:00, run_id=scheduled__2024-06-27T03:56:00+00:00, run_start_date=2024-06-27 03:58:01.095108+00:00, run_end_date=2024-06-27 03:58:02.943846+00:00, run_duration=1.848738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:56:00+00:00, data_interval_end=2024-06-27 03:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T03:58:02.951705596Z [2024-06-27T03:58:02.951+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T03:58:00+00:00, run_after=2024-06-27T04:00:00+00:00 2024-06-27T03:58:02.969874919Z [2024-06-27T03:58:02.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:58:02.970032014Z [2024-06-27T03:58:02.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:57:00+00:00, run_id=scheduled__2024-06-27T03:57:00+00:00, run_start_date=2024-06-27 03:58:01.105233+00:00, run_end_date=2024-06-27 03:58:02.969710+00:00, run_duration=1.864477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:57:00+00:00, data_interval_end=2024-06-27 03:58:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:58:02.979989658Z [2024-06-27T03:58:02.979+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:58:00+00:00, run_after=2024-06-27T03:59:00+00:00 2024-06-27T03:58:03.025831801Z [2024-06-27T03:58:03.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:56:00+00:00 exited with status success for try_number 1 2024-06-27T03:58:03.026050977Z [2024-06-27T03:58:03.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:57:00+00:00 exited with status success for try_number 1 2024-06-27T03:58:03.036076199Z [2024-06-27T03:58:03.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:56:00+00:00, map_index=-1, run_start_date=2024-06-27 03:58:02.083934+00:00, run_end_date=2024-06-27 03:58:02.480574+00:00, run_duration=0.39664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:58:01.215814+00:00, queued_by_job_id=2, pid=5050 2024-06-27T03:58:03.036329476Z [2024-06-27T03:58:03.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:57:00+00:00, map_index=-1, run_start_date=2024-06-27 03:58:02.206905+00:00, run_end_date=2024-06-27 03:58:02.616402+00:00, run_duration=0.409497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:58:01.215814+00:00, queued_by_job_id=2, pid=5051 2024-06-27T03:58:06.124031878Z [2024-06-27T03:58:06.123+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:58:06.124860382Z [2024-06-27T03:58:06.124+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:57:00+00:00, run_id=scheduled__2024-06-27T03:57:00+00:00, run_start_date=2024-06-27 03:58:01.108624+00:00, run_end_date=2024-06-27 03:58:06.124421+00:00, run_duration=5.015797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:57:00+00:00, data_interval_end=2024-06-27 03:58:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:58:06.132949759Z [2024-06-27T03:58:06.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:58:00+00:00, run_after=2024-06-27T03:59:00+00:00 2024-06-27T03:58:06.139932541Z [2024-06-27T03:58:06.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:58:06.140302018Z [2024-06-27T03:58:06.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:57:00+00:00, run_id=scheduled__2024-06-27T03:57:00+00:00, run_start_date=2024-06-27 03:58:01.110027+00:00, run_end_date=2024-06-27 03:58:06.140015+00:00, run_duration=5.029988, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:57:00+00:00, data_interval_end=2024-06-27 03:58:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:58:06.148717579Z [2024-06-27T03:58:06.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:58:00+00:00, run_after=2024-06-27T03:59:00+00:00 2024-06-27T03:58:06.198700334Z [2024-06-27T03:58:06.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:57:00+00:00 exited with status success for try_number 1 2024-06-27T03:58:06.199321455Z [2024-06-27T03:58:06.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:57:00+00:00 exited with status success for try_number 1 2024-06-27T03:58:06.210871473Z [2024-06-27T03:58:06.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:57:00+00:00, map_index=-1, run_start_date=2024-06-27 03:58:03.475257+00:00, run_end_date=2024-06-27 03:58:05.029665+00:00, run_duration=1.554408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:58:01.215814+00:00, queued_by_job_id=2, pid=5091 2024-06-27T03:58:06.211257942Z [2024-06-27T03:58:06.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:57:00+00:00, map_index=-1, run_start_date=2024-06-27 03:58:03.320287+00:00, run_end_date=2024-06-27 03:58:05.348372+00:00, run_duration=2.028085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:58:01.215814+00:00, queued_by_job_id=2, pid=5090 2024-06-27T03:59:00.034699679Z [2024-06-27T03:59:00.034+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T03:59:00.047097174Z [2024-06-27T03:59:00.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:59:00+00:00, run_after=2024-06-27T04:00:00+00:00 2024-06-27T03:59:00.065462274Z [2024-06-27T03:59:00.065+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:59:00+00:00, run_after=2024-06-27T04:00:00+00:00 2024-06-27T03:59:00.137503506Z [2024-06-27T03:59:00.137+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T03:59:00.137539449Z 2024-06-27T03:59:00.137547535Z 2024-06-27T03:59:00.137562256Z 2024-06-27T03:59:00.137758933Z [2024-06-27T03:59:00.137+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T03:59:00.138009031Z [2024-06-27T03:59:00.137+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:59:00.138250376Z [2024-06-27T03:59:00.137+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T03:59:00.138886536Z [2024-06-27T03:59:00.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T03:59:00.138905635Z 2024-06-27T03:59:00.138913382Z 2024-06-27T03:59:00.138941981Z 2024-06-27T03:59:00.141849016Z [2024-06-27T03:59:00.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:59:00.141969579Z [2024-06-27T03:59:00.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T03:59:00.142062121Z [2024-06-27T03:59:00.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:59:00.142138485Z [2024-06-27T03:59:00.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T03:59:00.142327517Z [2024-06-27T03:59:00.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T03:59:00.142425511Z [2024-06-27T03:59:00.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T03:59:00.369385592Z [2024-06-27T03:59:00.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:58:00+00:00 exited with status queued for try_number 1 2024-06-27T03:59:00.369559955Z [2024-06-27T03:59:00.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:58:00+00:00 exited with status queued for try_number 1 2024-06-27T03:59:00.369709581Z [2024-06-27T03:59:00.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:58:00+00:00 exited with status queued for try_number 1 2024-06-27T03:59:00.380467037Z [2024-06-27T03:59:00.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58ab0c52-7a8c-437c-afbb-1361acd0e9ee 2024-06-27T03:59:00.380693625Z [2024-06-27T03:59:00.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7506a2f6-5d07-403b-b80e-3e8556d24a00 2024-06-27T03:59:00.381026420Z [2024-06-27T03:59:00.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b18c65f-1f24-4d4a-85ac-059427bce9ea 2024-06-27T03:59:02.122597397Z [2024-06-27T03:59:02.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:59:02.122950909Z [2024-06-27T03:59:02.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:58:00+00:00, run_id=scheduled__2024-06-27T03:58:00+00:00, run_start_date=2024-06-27 03:59:00.081440+00:00, run_end_date=2024-06-27 03:59:02.122418+00:00, run_duration=2.040978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:58:00+00:00, data_interval_end=2024-06-27 03:59:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T03:59:02.133844757Z [2024-06-27T03:59:02.133+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T03:59:00+00:00, run_after=2024-06-27T04:00:00+00:00 2024-06-27T03:59:02.196423989Z [2024-06-27T03:59:02.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:58:00+00:00 exited with status success for try_number 1 2024-06-27T03:59:02.204976586Z [2024-06-27T03:59:02.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:58:00+00:00, map_index=-1, run_start_date=2024-06-27 03:59:00.981463+00:00, run_end_date=2024-06-27 03:59:01.373755+00:00, run_duration=0.392292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:59:00.139465+00:00, queued_by_job_id=2, pid=5136 2024-06-27T03:59:04.336130357Z [2024-06-27T03:59:04.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:59:04.336644527Z [2024-06-27T03:59:04.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:58:00+00:00, run_id=scheduled__2024-06-27T03:58:00+00:00, run_start_date=2024-06-27 03:59:00.084453+00:00, run_end_date=2024-06-27 03:59:04.336036+00:00, run_duration=4.251583, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:58:00+00:00, data_interval_end=2024-06-27 03:59:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T03:59:04.361573551Z [2024-06-27T03:59:04.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:59:00+00:00, run_after=2024-06-27T04:00:00+00:00 2024-06-27T03:59:04.371945017Z [2024-06-27T03:59:04.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T03:59:04.372266051Z [2024-06-27T03:59:04.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:58:00+00:00, run_id=scheduled__2024-06-27T03:58:00+00:00, run_start_date=2024-06-27 03:59:00.082729+00:00, run_end_date=2024-06-27 03:59:04.371949+00:00, run_duration=4.28922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:58:00+00:00, data_interval_end=2024-06-27 03:59:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T03:59:04.383658583Z [2024-06-27T03:59:04.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T03:59:00+00:00, run_after=2024-06-27T04:00:00+00:00 2024-06-27T03:59:04.430644980Z [2024-06-27T03:59:04.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:58:00+00:00 exited with status success for try_number 1 2024-06-27T03:59:04.430734066Z [2024-06-27T03:59:04.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:58:00+00:00 exited with status success for try_number 1 2024-06-27T03:59:04.440929000Z [2024-06-27T03:59:04.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:58:00+00:00, map_index=-1, run_start_date=2024-06-27 03:59:02.080216+00:00, run_end_date=2024-06-27 03:59:03.818409+00:00, run_duration=1.738193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:59:00.139465+00:00, queued_by_job_id=2, pid=5166 2024-06-27T03:59:04.441284280Z [2024-06-27T03:59:04.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:58:00+00:00, map_index=-1, run_start_date=2024-06-27 03:59:02.060469+00:00, run_end_date=2024-06-27 03:59:03.368316+00:00, run_duration=1.307847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 03:59:00.139465+00:00, queued_by_job_id=2, pid=5167 2024-06-27T04:00:00.107870363Z [2024-06-27T04:00:00.107+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:00:00.120658728Z [2024-06-27T04:00:00.120+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:00:00.134568967Z [2024-06-27T04:00:00.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:00:00+00:00, run_after=2024-06-27T04:01:00+00:00 2024-06-27T04:00:00.148070908Z [2024-06-27T04:00:00.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:00:00+00:00, run_after=2024-06-27T04:05:00+00:00 2024-06-27T04:00:00.166760204Z [2024-06-27T04:00:00.166+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:00:00+00:00, run_after=2024-06-27T04:01:00+00:00 2024-06-27T04:00:00.259905209Z [2024-06-27T04:00:00.259+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T04:00:00.259935181Z 2024-06-27T04:00:00.259939955Z 2024-06-27T04:00:00.259947644Z 2024-06-27T04:00:00.259952143Z 2024-06-27T04:00:00.259977385Z 2024-06-27T04:00:00.260129007Z [2024-06-27T04:00:00.259+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:00:00.260230924Z [2024-06-27T04:00:00.260+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:00:00.260277991Z [2024-06-27T04:00:00.260+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:00:00.260385729Z [2024-06-27T04:00:00.260+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:00:00.260444818Z [2024-06-27T04:00:00.260+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:00:00.261217318Z [2024-06-27T04:00:00.260+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:00:00.261245882Z 2024-06-27T04:00:00.261251144Z 2024-06-27T04:00:00.261256648Z 2024-06-27T04:00:00.261260813Z 2024-06-27T04:00:00.261265356Z 2024-06-27T04:00:00.265937228Z [2024-06-27T04:00:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:00:00.266299711Z [2024-06-27T04:00:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:00:00.266944651Z [2024-06-27T04:00:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:00:00.267246026Z [2024-06-27T04:00:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:00:00.267706520Z [2024-06-27T04:00:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:00:00.268015792Z [2024-06-27T04:00:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:00:00.268481601Z [2024-06-27T04:00:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:00:00.268872380Z [2024-06-27T04:00:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:00:00.269321723Z [2024-06-27T04:00:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T03:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:00:00.269721634Z [2024-06-27T04:00:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:00:00.758181494Z [2024-06-27T04:00:00.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status queued for try_number 1 2024-06-27T04:00:00.759447410Z [2024-06-27T04:00:00.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:58:00+00:00 exited with status queued for try_number 1 2024-06-27T04:00:00.759637170Z [2024-06-27T04:00:00.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:59:00+00:00 exited with status queued for try_number 1 2024-06-27T04:00:00.759783558Z [2024-06-27T04:00:00.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:59:00+00:00 exited with status queued for try_number 1 2024-06-27T04:00:00.759943891Z [2024-06-27T04:00:00.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:59:00+00:00 exited with status queued for try_number 1 2024-06-27T04:00:00.774017052Z [2024-06-27T04:00:00.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99af5399-741f-47a2-89df-0f2f10fc6b0f 2024-06-27T04:00:00.774470664Z [2024-06-27T04:00:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05b9636d-95c8-4aae-8247-5dc8e1e01d1c 2024-06-27T04:00:00.774686018Z [2024-06-27T04:00:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81e92328-2c6d-4c11-a3dc-eae1f928ad5e 2024-06-27T04:00:00.774884214Z [2024-06-27T04:00:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 753ba720-1726-4681-bfe2-a361537b3419 2024-06-27T04:00:00.775091569Z [2024-06-27T04:00:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to c551107b-200f-44e4-93c8-fedfcce770ce 2024-06-27T04:00:02.038347463Z [2024-06-27T04:00:02.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:00:02.038576757Z [2024-06-27T04:00:02.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 03:58:00+00:00, run_id=scheduled__2024-06-27T03:58:00+00:00, run_start_date=2024-06-27 04:00:00.187547+00:00, run_end_date=2024-06-27 04:00:02.038275+00:00, run_duration=1.850728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:58:00+00:00, data_interval_end=2024-06-27 04:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:00:02.055821976Z [2024-06-27T04:00:02.055+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:00:00+00:00, run_after=2024-06-27T04:02:00+00:00 2024-06-27T04:00:02.102069447Z [2024-06-27T04:00:02.101+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:00:02.102181695Z [2024-06-27T04:00:02.102+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 03:59:00+00:00, run_id=scheduled__2024-06-27T03:59:00+00:00, run_start_date=2024-06-27 04:00:00.188662+00:00, run_end_date=2024-06-27 04:00:02.101931+00:00, run_duration=1.913269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:59:00+00:00, data_interval_end=2024-06-27 04:00:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:00:02.127974733Z [2024-06-27T04:00:02.127+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:00:00+00:00, run_after=2024-06-27T04:01:00+00:00 2024-06-27T04:00:02.229148669Z [2024-06-27T04:00:02.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T03:58:00+00:00 exited with status success for try_number 1 2024-06-27T04:00:02.242810609Z [2024-06-27T04:00:02.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T03:58:00+00:00, map_index=-1, run_start_date=2024-06-27 04:00:01.290141+00:00, run_end_date=2024-06-27 04:00:01.700171+00:00, run_duration=0.41003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:00:00.262093+00:00, queued_by_job_id=2, pid=5213 2024-06-27T04:00:03.427449266Z [2024-06-27T04:00:03.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:59:00+00:00 exited with status success for try_number 1 2024-06-27T04:00:03.438601194Z [2024-06-27T04:00:03.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:59:00+00:00, map_index=-1, run_start_date=2024-06-27 04:00:01.563028+00:00, run_end_date=2024-06-27 04:00:02.060351+00:00, run_duration=0.497323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:00:00.262093+00:00, queued_by_job_id=2, pid=5216 2024-06-27T04:00:04.513349730Z [2024-06-27T04:00:04.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:00:04.513846109Z [2024-06-27T04:00:04.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:59:00+00:00, run_id=scheduled__2024-06-27T03:59:00+00:00, run_start_date=2024-06-27 04:00:00.189780+00:00, run_end_date=2024-06-27 04:00:04.513278+00:00, run_duration=4.323498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:59:00+00:00, data_interval_end=2024-06-27 04:00:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:00:04.526677767Z [2024-06-27T04:00:04.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:00:00+00:00, run_after=2024-06-27T04:01:00+00:00 2024-06-27T04:00:04.572153658Z [2024-06-27T04:00:04.571+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:00:04.572171749Z 2024-06-27T04:00:04.572342423Z [2024-06-27T04:00:04.572+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:00:04.573210589Z [2024-06-27T04:00:04.572+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:00:04.573223617Z 2024-06-27T04:00:04.575861279Z [2024-06-27T04:00:04.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:00:04.576683320Z [2024-06-27T04:00:04.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:00:04.646312295Z [2024-06-27T04:00:04.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status queued for try_number 1 2024-06-27T04:00:04.646904089Z [2024-06-27T04:00:04.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status success for try_number 1 2024-06-27T04:00:04.647225292Z [2024-06-27T04:00:04.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:59:00+00:00 exited with status success for try_number 1 2024-06-27T04:00:04.656498906Z [2024-06-27T04:00:04.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T03:55:00+00:00, map_index=-1, run_start_date=2024-06-27 04:00:02.996359+00:00, run_end_date=2024-06-27 04:00:03.550001+00:00, run_duration=0.553642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:00:00.262093+00:00, queued_by_job_id=2, pid=5264 2024-06-27T04:00:04.657315198Z [2024-06-27T04:00:04.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42094ffb-9d2b-4daa-8470-590e21dedc4e 2024-06-27T04:00:04.657859314Z [2024-06-27T04:00:04.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:59:00+00:00, map_index=-1, run_start_date=2024-06-27 04:00:03.148819+00:00, run_end_date=2024-06-27 04:00:04.450163+00:00, run_duration=1.301344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:00:00.262093+00:00, queued_by_job_id=2, pid=5265 2024-06-27T04:00:04.996694571Z [2024-06-27T04:00:04.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:00:04.996872055Z [2024-06-27T04:00:04.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:59:00+00:00, run_id=scheduled__2024-06-27T03:59:00+00:00, run_start_date=2024-06-27 04:00:00.191020+00:00, run_end_date=2024-06-27 04:00:04.996565+00:00, run_duration=4.805545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:59:00+00:00, data_interval_end=2024-06-27 04:00:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:00:05.010663252Z [2024-06-27T04:00:05.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:00:00+00:00, run_after=2024-06-27T04:01:00+00:00 2024-06-27T04:00:05.058683347Z [2024-06-27T04:00:05.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T03:59:00+00:00 exited with status success for try_number 1 2024-06-27T04:00:05.068581745Z [2024-06-27T04:00:05.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T03:59:00+00:00, map_index=-1, run_start_date=2024-06-27 04:00:02.804596+00:00, run_end_date=2024-06-27 04:00:04.683554+00:00, run_duration=1.878958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:00:00.262093+00:00, queued_by_job_id=2, pid=5254 2024-06-27T04:00:05.081620426Z [2024-06-27T04:00:05.081+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T04:00:06.897814623Z [2024-06-27T04:00:06.897+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:00:06.897836211Z 2024-06-27T04:00:06.897840513Z [2024-06-27T04:00:06.897+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:00:06.898592446Z [2024-06-27T04:00:06.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:00:06.898602109Z 2024-06-27T04:00:06.901609256Z [2024-06-27T04:00:06.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T03:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:00:06.901703744Z [2024-06-27T04:00:06.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:00:06.947343980Z [2024-06-27T04:00:06.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status queued for try_number 1 2024-06-27T04:00:06.947617352Z [2024-06-27T04:00:06.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status success for try_number 1 2024-06-27T04:00:06.953531293Z [2024-06-27T04:00:06.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebe6e207-3941-4274-be1d-8df0a2c381a8 2024-06-27T04:00:06.953707239Z [2024-06-27T04:00:06.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T03:55:00+00:00, map_index=-1, run_start_date=2024-06-27 04:00:06.221589+00:00, run_end_date=2024-06-27 04:00:06.649547+00:00, run_duration=0.427958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:00:04.573658+00:00, queued_by_job_id=2, pid=5304 2024-06-27T04:00:10.071401930Z [2024-06-27T04:00:10.070+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:00:10.071452944Z 2024-06-27T04:00:10.071464005Z [2024-06-27T04:00:10.071+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:00:10.072018341Z [2024-06-27T04:00:10.071+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:00:10.072036971Z 2024-06-27T04:00:10.076008822Z [2024-06-27T04:00:10.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:00:10.076033389Z [2024-06-27T04:00:10.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:00:10.128288330Z [2024-06-27T04:00:10.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status queued for try_number 1 2024-06-27T04:00:10.128691367Z [2024-06-27T04:00:10.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status success for try_number 1 2024-06-27T04:00:10.136575866Z [2024-06-27T04:00:10.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3db3b33-dac0-4be9-9abb-b72db5440936 2024-06-27T04:00:10.138692622Z [2024-06-27T04:00:10.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T03:55:00+00:00, map_index=0, run_start_date=2024-06-27 04:00:08.749679+00:00, run_end_date=2024-06-27 04:00:09.141433+00:00, run_duration=0.391754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:00:06.898971+00:00, queued_by_job_id=2, pid=5316 2024-06-27T04:00:12.430238544Z [2024-06-27T04:00:12.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:00:12.430542260Z [2024-06-27T04:00:12.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 03:55:00+00:00, run_id=scheduled__2024-06-27T03:55:00+00:00, run_start_date=2024-06-27 04:00:00.185993+00:00, run_end_date=2024-06-27 04:00:12.430167+00:00, run_duration=12.244174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 03:55:00+00:00, data_interval_end=2024-06-27 04:00:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T04:00:12.441169269Z [2024-06-27T04:00:12.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:00:00+00:00, run_after=2024-06-27T04:05:00+00:00 2024-06-27T04:00:12.480031192Z [2024-06-27T04:00:12.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T03:55:00+00:00 exited with status success for try_number 1 2024-06-27T04:00:12.490665732Z [2024-06-27T04:00:12.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T03:55:00+00:00, map_index=-1, run_start_date=2024-06-27 04:00:11.843011+00:00, run_end_date=2024-06-27 04:00:12.237448+00:00, run_duration=0.394437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:00:10.072358+00:00, queued_by_job_id=2, pid=5328 2024-06-27T04:01:00.401590472Z [2024-06-27T04:01:00.401+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:01:00.413664032Z [2024-06-27T04:01:00.413+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:01:00+00:00, run_after=2024-06-27T04:02:00+00:00 2024-06-27T04:01:00.425767389Z [2024-06-27T04:01:00.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:01:00+00:00, run_after=2024-06-27T04:02:00+00:00 2024-06-27T04:01:00.498904200Z [2024-06-27T04:01:00.498+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:01:00.498945040Z 2024-06-27T04:01:00.498968979Z 2024-06-27T04:01:00.498975177Z 2024-06-27T04:01:00.499108796Z [2024-06-27T04:01:00.498+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:01:00.499354289Z [2024-06-27T04:01:00.499+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:01:00.499601151Z [2024-06-27T04:01:00.499+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:01:00.500419650Z [2024-06-27T04:01:00.500+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:01:00.500433912Z 2024-06-27T04:01:00.500440257Z 2024-06-27T04:01:00.500445937Z 2024-06-27T04:01:00.504268961Z [2024-06-27T04:01:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:01:00.504559689Z [2024-06-27T04:01:00.504+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:01:00.504961950Z [2024-06-27T04:01:00.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:01:00.505199913Z [2024-06-27T04:01:00.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:01:00.505598737Z [2024-06-27T04:01:00.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:01:00.505864705Z [2024-06-27T04:01:00.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:01:00.688020529Z [2024-06-27T04:01:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status queued for try_number 1 2024-06-27T04:01:00.690046683Z [2024-06-27T04:01:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status queued for try_number 1 2024-06-27T04:01:00.690197853Z [2024-06-27T04:01:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status queued for try_number 1 2024-06-27T04:01:00.698822237Z [2024-06-27T04:01:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to d85abba2-2040-467d-88e0-123d5cf8d599 2024-06-27T04:01:00.699018153Z [2024-06-27T04:01:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 889d45f6-f60c-4e6c-8643-afc4dc3faa49 2024-06-27T04:01:00.699196159Z [2024-06-27T04:01:00.699+0000] {scheduler_job.py:635} INFO - Setting external_id for to 890a1cab-9500-4f0b-941a-9bb2d51fb0ac 2024-06-27T04:01:02.339478049Z [2024-06-27T04:01:02.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:01:02.340098134Z [2024-06-27T04:01:02.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:00:00+00:00, run_id=scheduled__2024-06-27T04:00:00+00:00, run_start_date=2024-06-27 04:01:00.435681+00:00, run_end_date=2024-06-27 04:01:02.339596+00:00, run_duration=1.903915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:00:00+00:00, data_interval_end=2024-06-27 04:01:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:01:02.352403113Z [2024-06-27T04:01:02.352+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:01:00+00:00, run_after=2024-06-27T04:02:00+00:00 2024-06-27T04:01:02.409135118Z [2024-06-27T04:01:02.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status success for try_number 1 2024-06-27T04:01:02.417313796Z [2024-06-27T04:01:02.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:00:00+00:00, map_index=-1, run_start_date=2024-06-27 04:01:01.314480+00:00, run_end_date=2024-06-27 04:01:01.719243+00:00, run_duration=0.404763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:01:00.501408+00:00, queued_by_job_id=2, pid=5354 2024-06-27T04:01:04.473566987Z [2024-06-27T04:01:04.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:01:04.474180675Z [2024-06-27T04:01:04.473+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:00:00+00:00, run_id=scheduled__2024-06-27T04:00:00+00:00, run_start_date=2024-06-27 04:01:00.438148+00:00, run_end_date=2024-06-27 04:01:04.473363+00:00, run_duration=4.035215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:00:00+00:00, data_interval_end=2024-06-27 04:01:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:01:04.482317051Z [2024-06-27T04:01:04.481+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:01:00+00:00, run_after=2024-06-27T04:02:00+00:00 2024-06-27T04:01:04.491307900Z [2024-06-27T04:01:04.490+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:01:04.491509390Z [2024-06-27T04:01:04.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:00:00+00:00, run_id=scheduled__2024-06-27T04:00:00+00:00, run_start_date=2024-06-27 04:01:00.437106+00:00, run_end_date=2024-06-27 04:01:04.491160+00:00, run_duration=4.054054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:00:00+00:00, data_interval_end=2024-06-27 04:01:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:01:04.501005634Z [2024-06-27T04:01:04.500+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:01:00+00:00, run_after=2024-06-27T04:02:00+00:00 2024-06-27T04:01:04.528327051Z [2024-06-27T04:01:04.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status success for try_number 1 2024-06-27T04:01:04.528620736Z [2024-06-27T04:01:04.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status success for try_number 1 2024-06-27T04:01:04.535322288Z [2024-06-27T04:01:04.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:00:00+00:00, map_index=-1, run_start_date=2024-06-27 04:01:02.320034+00:00, run_end_date=2024-06-27 04:01:03.955006+00:00, run_duration=1.634972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:01:00.501408+00:00, queued_by_job_id=2, pid=5385 2024-06-27T04:01:04.535666601Z [2024-06-27T04:01:04.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:00:00+00:00, map_index=-1, run_start_date=2024-06-27 04:01:02.319586+00:00, run_end_date=2024-06-27 04:01:03.663957+00:00, run_duration=1.344371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:01:00.501408+00:00, queued_by_job_id=2, pid=5384 2024-06-27T04:02:00.367691782Z [2024-06-27T04:02:00.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:02:00+00:00, run_after=2024-06-27T04:03:00+00:00 2024-06-27T04:02:00.380309948Z [2024-06-27T04:02:00.379+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:02:00+00:00, run_after=2024-06-27T04:03:00+00:00 2024-06-27T04:02:00.386829296Z [2024-06-27T04:02:00.386+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:02:00.392847836Z [2024-06-27T04:02:00.392+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:02:00.476110435Z [2024-06-27T04:02:00.475+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:02:00.476147328Z 2024-06-27T04:02:00.476155687Z 2024-06-27T04:02:00.476162298Z 2024-06-27T04:02:00.476169491Z 2024-06-27T04:02:00.476552912Z [2024-06-27T04:02:00.476+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:02:00.476917773Z [2024-06-27T04:02:00.476+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:02:00.477087120Z [2024-06-27T04:02:00.476+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:02:00.477246830Z [2024-06-27T04:02:00.477+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:02:00.478436187Z [2024-06-27T04:02:00.478+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:02:00.478445733Z 2024-06-27T04:02:00.478449349Z 2024-06-27T04:02:00.478452882Z 2024-06-27T04:02:00.478456209Z 2024-06-27T04:02:00.485589148Z [2024-06-27T04:02:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:02:00.485702694Z [2024-06-27T04:02:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:02:00.486210403Z [2024-06-27T04:02:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:02:00.486377346Z [2024-06-27T04:02:00.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:02:00.487295091Z [2024-06-27T04:02:00.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:02:00.487578248Z [2024-06-27T04:02:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:02:00.487836705Z [2024-06-27T04:02:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:02:00.487956549Z [2024-06-27T04:02:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:02:00.883652580Z [2024-06-27T04:02:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status queued for try_number 1 2024-06-27T04:02:00.886977578Z [2024-06-27T04:02:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:01:00+00:00 exited with status queued for try_number 1 2024-06-27T04:02:00.887925154Z [2024-06-27T04:02:00.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:01:00+00:00 exited with status queued for try_number 1 2024-06-27T04:02:00.888061973Z [2024-06-27T04:02:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:01:00+00:00 exited with status queued for try_number 1 2024-06-27T04:02:00.896848235Z [2024-06-27T04:02:00.896+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75df851c-97f5-476f-ae60-068c1f58e0fe 2024-06-27T04:02:00.897269547Z [2024-06-27T04:02:00.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bd663bf-3b30-4b6f-96a5-f643fb5d5619 2024-06-27T04:02:00.897585493Z [2024-06-27T04:02:00.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4f927b1-c8bf-4116-99d1-4d9d2200941a 2024-06-27T04:02:00.898091356Z [2024-06-27T04:02:00.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to b12a048e-633a-46f7-8866-91671e04a232 2024-06-27T04:02:02.905961491Z [2024-06-27T04:02:02.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:02:02.906893692Z [2024-06-27T04:02:02.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:00:00+00:00, run_id=scheduled__2024-06-27T04:00:00+00:00, run_start_date=2024-06-27 04:02:00.406955+00:00, run_end_date=2024-06-27 04:02:02.906046+00:00, run_duration=2.499091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:00:00+00:00, data_interval_end=2024-06-27 04:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:02:02.916247314Z [2024-06-27T04:02:02.915+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:02:00+00:00, run_after=2024-06-27T04:04:00+00:00 2024-06-27T04:02:02.924901180Z [2024-06-27T04:02:02.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:02:02.925322677Z [2024-06-27T04:02:02.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:01:00+00:00, run_id=scheduled__2024-06-27T04:01:00+00:00, run_start_date=2024-06-27 04:02:00.408357+00:00, run_end_date=2024-06-27 04:02:02.924857+00:00, run_duration=2.5165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:01:00+00:00, data_interval_end=2024-06-27 04:02:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:02:02.936740436Z [2024-06-27T04:02:02.936+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:02:00+00:00, run_after=2024-06-27T04:03:00+00:00 2024-06-27T04:02:02.987278489Z [2024-06-27T04:02:02.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status success for try_number 1 2024-06-27T04:02:02.987300305Z [2024-06-27T04:02:02.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:01:00+00:00 exited with status success for try_number 1 2024-06-27T04:02:02.996282162Z [2024-06-27T04:02:02.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:01:00+00:00, map_index=-1, run_start_date=2024-06-27 04:02:01.495419+00:00, run_end_date=2024-06-27 04:02:01.941526+00:00, run_duration=0.446107, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:02:00.480002+00:00, queued_by_job_id=2, pid=5429 2024-06-27T04:02:02.997212876Z [2024-06-27T04:02:02.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:00:00+00:00, map_index=-1, run_start_date=2024-06-27 04:02:01.504984+00:00, run_end_date=2024-06-27 04:02:02.039822+00:00, run_duration=0.534838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:02:00.480002+00:00, queued_by_job_id=2, pid=5430 2024-06-27T04:02:05.489761144Z [2024-06-27T04:02:05.489+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:02:05.490017284Z [2024-06-27T04:02:05.489+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:01:00+00:00, run_id=scheduled__2024-06-27T04:01:00+00:00, run_start_date=2024-06-27 04:02:00.409592+00:00, run_end_date=2024-06-27 04:02:05.489687+00:00, run_duration=5.080095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:01:00+00:00, data_interval_end=2024-06-27 04:02:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:02:05.499328256Z [2024-06-27T04:02:05.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:02:00+00:00, run_after=2024-06-27T04:03:00+00:00 2024-06-27T04:02:05.506132912Z [2024-06-27T04:02:05.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:02:05.506865361Z [2024-06-27T04:02:05.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:01:00+00:00, run_id=scheduled__2024-06-27T04:01:00+00:00, run_start_date=2024-06-27 04:02:00.410697+00:00, run_end_date=2024-06-27 04:02:05.506049+00:00, run_duration=5.095352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:01:00+00:00, data_interval_end=2024-06-27 04:02:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:02:05.516339597Z [2024-06-27T04:02:05.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:02:00+00:00, run_after=2024-06-27T04:03:00+00:00 2024-06-27T04:02:05.561826677Z [2024-06-27T04:02:05.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:01:00+00:00 exited with status success for try_number 1 2024-06-27T04:02:05.565264115Z [2024-06-27T04:02:05.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:01:00+00:00 exited with status success for try_number 1 2024-06-27T04:02:05.571952997Z [2024-06-27T04:02:05.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:01:00+00:00, map_index=-1, run_start_date=2024-06-27 04:02:02.528335+00:00, run_end_date=2024-06-27 04:02:04.350151+00:00, run_duration=1.821816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:02:00.480002+00:00, queued_by_job_id=2, pid=5469 2024-06-27T04:02:05.572641877Z [2024-06-27T04:02:05.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:01:00+00:00, map_index=-1, run_start_date=2024-06-27 04:02:02.572314+00:00, run_end_date=2024-06-27 04:02:04.708271+00:00, run_duration=2.135957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:02:00.480002+00:00, queued_by_job_id=2, pid=5470 2024-06-27T04:03:00.297102161Z [2024-06-27T04:03:00.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:03:00+00:00, run_after=2024-06-27T04:04:00+00:00 2024-06-27T04:03:00.312617915Z [2024-06-27T04:03:00.312+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:03:00+00:00, run_after=2024-06-27T04:04:00+00:00 2024-06-27T04:03:00.320274676Z [2024-06-27T04:03:00.319+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:03:00.411144441Z [2024-06-27T04:03:00.410+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:03:00.411192262Z 2024-06-27T04:03:00.411202291Z 2024-06-27T04:03:00.411210968Z 2024-06-27T04:03:00.411273839Z [2024-06-27T04:03:00.411+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:03:00.411344172Z [2024-06-27T04:03:00.411+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:03:00.411361097Z [2024-06-27T04:03:00.411+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:03:00.412045765Z [2024-06-27T04:03:00.411+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:03:00.412065784Z 2024-06-27T04:03:00.412074800Z 2024-06-27T04:03:00.412083441Z 2024-06-27T04:03:00.416040129Z [2024-06-27T04:03:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:03:00.416110405Z [2024-06-27T04:03:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:03:00.416354454Z [2024-06-27T04:03:00.416+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:03:00.416461074Z [2024-06-27T04:03:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:03:00.416688561Z [2024-06-27T04:03:00.416+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:03:00.416826716Z [2024-06-27T04:03:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:03:00.599040139Z [2024-06-27T04:03:00.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:02:00+00:00 exited with status queued for try_number 1 2024-06-27T04:03:00.599182061Z [2024-06-27T04:03:00.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:02:00+00:00 exited with status queued for try_number 1 2024-06-27T04:03:00.599324345Z [2024-06-27T04:03:00.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:02:00+00:00 exited with status queued for try_number 1 2024-06-27T04:03:00.605870819Z [2024-06-27T04:03:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cf9ad84-66c1-4075-af9b-bf1b311bcd6c 2024-06-27T04:03:00.605913569Z [2024-06-27T04:03:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8a4375b-1b82-47df-8b9d-21a8519e9e33 2024-06-27T04:03:00.606014584Z [2024-06-27T04:03:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d5fe4bb-0ba1-4f5f-9832-6fcea5b14235 2024-06-27T04:03:01.772645875Z [2024-06-27T04:03:01.771+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:03:01.773001430Z [2024-06-27T04:03:01.772+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:02:00+00:00, run_id=scheduled__2024-06-27T04:02:00+00:00, run_start_date=2024-06-27 04:03:00.334028+00:00, run_end_date=2024-06-27 04:03:01.772446+00:00, run_duration=1.438418, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:02:00+00:00, data_interval_end=2024-06-27 04:03:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:03:01.785753816Z [2024-06-27T04:03:01.785+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:03:00+00:00, run_after=2024-06-27T04:04:00+00:00 2024-06-27T04:03:01.827505075Z [2024-06-27T04:03:01.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:02:00+00:00 exited with status success for try_number 1 2024-06-27T04:03:01.833147982Z [2024-06-27T04:03:01.832+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:02:00+00:00, map_index=-1, run_start_date=2024-06-27 04:03:01.282623+00:00, run_end_date=2024-06-27 04:03:01.656234+00:00, run_duration=0.373611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:03:00.412912+00:00, queued_by_job_id=2, pid=5514 2024-06-27T04:03:04.478792430Z [2024-06-27T04:03:04.478+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:03:04.479138396Z [2024-06-27T04:03:04.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:02:00+00:00, run_id=scheduled__2024-06-27T04:02:00+00:00, run_start_date=2024-06-27 04:03:00.336935+00:00, run_end_date=2024-06-27 04:03:04.478797+00:00, run_duration=4.141862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:02:00+00:00, data_interval_end=2024-06-27 04:03:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:03:04.499918497Z [2024-06-27T04:03:04.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:03:00+00:00, run_after=2024-06-27T04:04:00+00:00 2024-06-27T04:03:04.510906075Z [2024-06-27T04:03:04.510+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:03:04.512048691Z [2024-06-27T04:03:04.511+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:02:00+00:00, run_id=scheduled__2024-06-27T04:02:00+00:00, run_start_date=2024-06-27 04:03:00.338846+00:00, run_end_date=2024-06-27 04:03:04.511514+00:00, run_duration=4.172668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:02:00+00:00, data_interval_end=2024-06-27 04:03:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:03:04.529849674Z [2024-06-27T04:03:04.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:03:00+00:00, run_after=2024-06-27T04:04:00+00:00 2024-06-27T04:03:04.591030515Z [2024-06-27T04:03:04.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:02:00+00:00 exited with status success for try_number 1 2024-06-27T04:03:04.591546968Z [2024-06-27T04:03:04.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:02:00+00:00 exited with status success for try_number 1 2024-06-27T04:03:04.612672591Z [2024-06-27T04:03:04.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:02:00+00:00, map_index=-1, run_start_date=2024-06-27 04:03:02.337367+00:00, run_end_date=2024-06-27 04:03:03.666724+00:00, run_duration=1.329357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:03:00.412912+00:00, queued_by_job_id=2, pid=5545 2024-06-27T04:03:04.613058697Z [2024-06-27T04:03:04.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:02:00+00:00, map_index=-1, run_start_date=2024-06-27 04:03:02.243835+00:00, run_end_date=2024-06-27 04:03:03.954035+00:00, run_duration=1.7102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:03:00.412912+00:00, queued_by_job_id=2, pid=5544 2024-06-27T04:04:00.779073005Z [2024-06-27T04:04:00.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:04:00+00:00, run_after=2024-06-27T04:05:00+00:00 2024-06-27T04:04:00.791688872Z [2024-06-27T04:04:00.791+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:04:00.805166299Z [2024-06-27T04:04:00.804+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:04:00+00:00, run_after=2024-06-27T04:05:00+00:00 2024-06-27T04:04:00.813620573Z [2024-06-27T04:04:00.813+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:04:00.900918440Z [2024-06-27T04:04:00.900+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:04:00.900946554Z 2024-06-27T04:04:00.900952038Z 2024-06-27T04:04:00.900955988Z 2024-06-27T04:04:00.900960167Z 2024-06-27T04:04:00.901242132Z [2024-06-27T04:04:00.900+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:04:00.901537027Z [2024-06-27T04:04:00.901+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:04:00.901869283Z [2024-06-27T04:04:00.901+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:04:00.902179833Z [2024-06-27T04:04:00.901+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:04:00.905806770Z [2024-06-27T04:04:00.905+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:04:00.905840793Z 2024-06-27T04:04:00.905850663Z 2024-06-27T04:04:00.905859259Z 2024-06-27T04:04:00.905867780Z 2024-06-27T04:04:00.912123932Z [2024-06-27T04:04:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:04:00.912160196Z [2024-06-27T04:04:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:04:00.912451185Z [2024-06-27T04:04:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:04:00.912572484Z [2024-06-27T04:04:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:04:00.912859538Z [2024-06-27T04:04:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:04:00.913060946Z [2024-06-27T04:04:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:04:00.913315044Z [2024-06-27T04:04:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:04:00.913450349Z [2024-06-27T04:04:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:04:01.289036863Z [2024-06-27T04:04:01.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:02:00+00:00 exited with status queued for try_number 1 2024-06-27T04:04:01.289173853Z [2024-06-27T04:04:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:03:00+00:00 exited with status queued for try_number 1 2024-06-27T04:04:01.289280648Z [2024-06-27T04:04:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:03:00+00:00 exited with status queued for try_number 1 2024-06-27T04:04:01.289384228Z [2024-06-27T04:04:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:03:00+00:00 exited with status queued for try_number 1 2024-06-27T04:04:01.301311901Z [2024-06-27T04:04:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37c7ad28-793c-4455-8468-8380cbbb5d6a 2024-06-27T04:04:01.301464505Z [2024-06-27T04:04:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to d62f9415-5111-4e1d-a9f5-be25b6f07370 2024-06-27T04:04:01.301619925Z [2024-06-27T04:04:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to aeae8530-865b-43f6-b39d-2e7c317ffe9b 2024-06-27T04:04:01.301762284Z [2024-06-27T04:04:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d3cd7f6-9dd7-433e-b833-e6560406e248 2024-06-27T04:04:02.643547946Z [2024-06-27T04:04:02.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:04:02.643964361Z [2024-06-27T04:04:02.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:02:00+00:00, run_id=scheduled__2024-06-27T04:02:00+00:00, run_start_date=2024-06-27 04:04:00.828611+00:00, run_end_date=2024-06-27 04:04:02.643471+00:00, run_duration=1.81486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:02:00+00:00, data_interval_end=2024-06-27 04:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:04:02.652004068Z [2024-06-27T04:04:02.651+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:04:00+00:00, run_after=2024-06-27T04:06:00+00:00 2024-06-27T04:04:02.674744870Z [2024-06-27T04:04:02.674+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:04:02.675040688Z [2024-06-27T04:04:02.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:03:00+00:00, run_id=scheduled__2024-06-27T04:03:00+00:00, run_start_date=2024-06-27 04:04:00.830086+00:00, run_end_date=2024-06-27 04:04:02.674633+00:00, run_duration=1.844547, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:03:00+00:00, data_interval_end=2024-06-27 04:04:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:04:02.686936765Z [2024-06-27T04:04:02.686+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:04:00+00:00, run_after=2024-06-27T04:05:00+00:00 2024-06-27T04:04:02.740874628Z [2024-06-27T04:04:02.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:02:00+00:00 exited with status success for try_number 1 2024-06-27T04:04:02.740899332Z [2024-06-27T04:04:02.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:03:00+00:00 exited with status success for try_number 1 2024-06-27T04:04:02.744970578Z [2024-06-27T04:04:02.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:02:00+00:00, map_index=-1, run_start_date=2024-06-27 04:04:01.724396+00:00, run_end_date=2024-06-27 04:04:02.191852+00:00, run_duration=0.467456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:04:00.906848+00:00, queued_by_job_id=2, pid=5590 2024-06-27T04:04:02.744996016Z [2024-06-27T04:04:02.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:03:00+00:00, map_index=-1, run_start_date=2024-06-27 04:04:01.973492+00:00, run_end_date=2024-06-27 04:04:02.374565+00:00, run_duration=0.401073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:04:00.906848+00:00, queued_by_job_id=2, pid=5591 2024-06-27T04:04:04.914492639Z [2024-06-27T04:04:04.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:04:04.914526807Z [2024-06-27T04:04:04.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:03:00+00:00, run_id=scheduled__2024-06-27T04:03:00+00:00, run_start_date=2024-06-27 04:04:00.831270+00:00, run_end_date=2024-06-27 04:04:04.911780+00:00, run_duration=4.08051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:03:00+00:00, data_interval_end=2024-06-27 04:04:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:04:04.920941533Z [2024-06-27T04:04:04.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:04:00+00:00, run_after=2024-06-27T04:05:00+00:00 2024-06-27T04:04:04.926249729Z [2024-06-27T04:04:04.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:04:04.926566411Z [2024-06-27T04:04:04.926+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:03:00+00:00, run_id=scheduled__2024-06-27T04:03:00+00:00, run_start_date=2024-06-27 04:04:00.832365+00:00, run_end_date=2024-06-27 04:04:04.926132+00:00, run_duration=4.093767, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:03:00+00:00, data_interval_end=2024-06-27 04:04:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:04:04.951577028Z [2024-06-27T04:04:04.951+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:04:00+00:00, run_after=2024-06-27T04:05:00+00:00 2024-06-27T04:04:05.012208540Z [2024-06-27T04:04:05.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:03:00+00:00 exited with status success for try_number 1 2024-06-27T04:04:05.012632639Z [2024-06-27T04:04:05.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:03:00+00:00 exited with status success for try_number 1 2024-06-27T04:04:05.026638105Z [2024-06-27T04:04:05.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:03:00+00:00, map_index=-1, run_start_date=2024-06-27 04:04:03.070310+00:00, run_end_date=2024-06-27 04:04:04.364564+00:00, run_duration=1.294254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:04:00.906848+00:00, queued_by_job_id=2, pid=5630 2024-06-27T04:04:05.026986118Z [2024-06-27T04:04:05.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:03:00+00:00, map_index=-1, run_start_date=2024-06-27 04:04:03.118367+00:00, run_end_date=2024-06-27 04:04:04.769336+00:00, run_duration=1.650969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:04:00.906848+00:00, queued_by_job_id=2, pid=5631 2024-06-27T04:05:00.666131120Z [2024-06-27T04:05:00.665+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:05:00+00:00, run_after=2024-06-27T04:06:00+00:00 2024-06-27T04:05:00.688512043Z [2024-06-27T04:05:00.688+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:05:00+00:00, run_after=2024-06-27T04:10:00+00:00 2024-06-27T04:05:00.704130753Z [2024-06-27T04:05:00.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:05:00+00:00, run_after=2024-06-27T04:06:00+00:00 2024-06-27T04:05:00.713261688Z [2024-06-27T04:05:00.712+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:05:00.828576698Z [2024-06-27T04:05:00.828+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:05:00.828659180Z 2024-06-27T04:05:00.828666377Z 2024-06-27T04:05:00.828671800Z 2024-06-27T04:05:00.828676860Z 2024-06-27T04:05:00.828716850Z [2024-06-27T04:05:00.828+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:05:00.828840607Z [2024-06-27T04:05:00.828+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:05:00.829020077Z [2024-06-27T04:05:00.828+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:05:00.829178818Z [2024-06-27T04:05:00.828+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:05:00.829941885Z [2024-06-27T04:05:00.829+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:05:00.829953028Z 2024-06-27T04:05:00.829957307Z 2024-06-27T04:05:00.829961478Z 2024-06-27T04:05:00.829965939Z 2024-06-27T04:05:00.833848772Z [2024-06-27T04:05:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:05:00.834099244Z [2024-06-27T04:05:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:05:00.834437074Z [2024-06-27T04:05:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:05:00.835147383Z [2024-06-27T04:05:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:05:00.835485461Z [2024-06-27T04:05:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:05:00.835772621Z [2024-06-27T04:05:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:05:00.836091270Z [2024-06-27T04:05:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:05:00.836261770Z [2024-06-27T04:05:00.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:05:01.281676780Z [2024-06-27T04:05:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status queued for try_number 1 2024-06-27T04:05:01.281882421Z [2024-06-27T04:05:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:04:00+00:00 exited with status queued for try_number 1 2024-06-27T04:05:01.282004708Z [2024-06-27T04:05:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:04:00+00:00 exited with status queued for try_number 1 2024-06-27T04:05:01.282107768Z [2024-06-27T04:05:01.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:04:00+00:00 exited with status queued for try_number 1 2024-06-27T04:05:01.292002572Z [2024-06-27T04:05:01.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2dfcd5a-479b-4079-abad-0f70108d9df9 2024-06-27T04:05:01.292198885Z [2024-06-27T04:05:01.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to d39bf43a-966b-40f4-9343-426133bfe16b 2024-06-27T04:05:01.293180051Z [2024-06-27T04:05:01.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d1c0790-55ea-4668-9272-bdd262100d88 2024-06-27T04:05:01.293345900Z [2024-06-27T04:05:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdfdbafa-43c7-4177-b536-37f811dc6e24 2024-06-27T04:05:03.201850272Z [2024-06-27T04:05:03.201+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:05:03.202143802Z [2024-06-27T04:05:03.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:04:00+00:00, run_id=scheduled__2024-06-27T04:04:00+00:00, run_start_date=2024-06-27 04:05:00.735284+00:00, run_end_date=2024-06-27 04:05:03.201780+00:00, run_duration=2.466496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:04:00+00:00, data_interval_end=2024-06-27 04:05:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:05:03.211708922Z [2024-06-27T04:05:03.211+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:05:00+00:00, run_after=2024-06-27T04:06:00+00:00 2024-06-27T04:05:03.284891666Z [2024-06-27T04:05:03.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:04:00+00:00 exited with status success for try_number 1 2024-06-27T04:05:03.293523355Z [2024-06-27T04:05:03.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:04:00+00:00, map_index=-1, run_start_date=2024-06-27 04:05:02.302141+00:00, run_end_date=2024-06-27 04:05:02.726476+00:00, run_duration=0.424335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:05:00.830960+00:00, queued_by_job_id=2, pid=5677 2024-06-27T04:05:04.381780286Z [2024-06-27T04:05:04.381+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:05:04.381861455Z 2024-06-27T04:05:04.381909609Z [2024-06-27T04:05:04.381+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:05:04.382588693Z [2024-06-27T04:05:04.382+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:05:04.382616844Z 2024-06-27T04:05:04.385120619Z [2024-06-27T04:05:04.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:05:04.385429641Z [2024-06-27T04:05:04.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:05:04.454288639Z [2024-06-27T04:05:04.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status queued for try_number 1 2024-06-27T04:05:04.454362691Z [2024-06-27T04:05:04.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status success for try_number 1 2024-06-27T04:05:04.474475352Z [2024-06-27T04:05:04.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4628297-040d-4a0e-aba2-668b03a5e01e 2024-06-27T04:05:04.474523664Z [2024-06-27T04:05:04.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:00:00+00:00, map_index=-1, run_start_date=2024-06-27 04:05:03.491609+00:00, run_end_date=2024-06-27 04:05:03.894131+00:00, run_duration=0.402522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:05:00.830960+00:00, queued_by_job_id=2, pid=5708 2024-06-27T04:05:05.150032587Z [2024-06-27T04:05:05.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:05:05.150684790Z [2024-06-27T04:05:05.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:04:00+00:00, run_id=scheduled__2024-06-27T04:04:00+00:00, run_start_date=2024-06-27 04:05:00.736429+00:00, run_end_date=2024-06-27 04:05:05.150188+00:00, run_duration=4.413759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:04:00+00:00, data_interval_end=2024-06-27 04:05:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:05:05.161401234Z [2024-06-27T04:05:05.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:05:00+00:00, run_after=2024-06-27T04:06:00+00:00 2024-06-27T04:05:05.228221906Z [2024-06-27T04:05:05.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:04:00+00:00 exited with status success for try_number 1 2024-06-27T04:05:05.239243251Z [2024-06-27T04:05:05.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:04:00+00:00, map_index=-1, run_start_date=2024-06-27 04:05:03.250425+00:00, run_end_date=2024-06-27 04:05:04.586667+00:00, run_duration=1.336242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:05:00.830960+00:00, queued_by_job_id=2, pid=5707 2024-06-27T04:05:05.252078443Z [2024-06-27T04:05:05.251+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T04:05:06.308555537Z [2024-06-27T04:05:06.307+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:05:06.310280957Z [2024-06-27T04:05:06.308+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:04:00+00:00, run_id=scheduled__2024-06-27T04:04:00+00:00, run_start_date=2024-06-27 04:05:00.737784+00:00, run_end_date=2024-06-27 04:05:06.308307+00:00, run_duration=5.570523, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:04:00+00:00, data_interval_end=2024-06-27 04:05:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:05:06.323963316Z [2024-06-27T04:05:06.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:05:00+00:00, run_after=2024-06-27T04:06:00+00:00 2024-06-27T04:05:06.376864643Z [2024-06-27T04:05:06.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:04:00+00:00 exited with status success for try_number 1 2024-06-27T04:05:06.389492941Z [2024-06-27T04:05:06.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:04:00+00:00, map_index=-1, run_start_date=2024-06-27 04:05:03.758841+00:00, run_end_date=2024-06-27 04:05:05.348240+00:00, run_duration=1.589399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:05:00.830960+00:00, queued_by_job_id=2, pid=5727 2024-06-27T04:05:07.482673252Z [2024-06-27T04:05:07.482+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:05:07.482720060Z 2024-06-27T04:05:07.483085062Z [2024-06-27T04:05:07.482+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:05:07.484107891Z [2024-06-27T04:05:07.483+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:05:07.484125146Z 2024-06-27T04:05:07.488384451Z [2024-06-27T04:05:07.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:05:07.488455629Z [2024-06-27T04:05:07.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:05:07.565134988Z [2024-06-27T04:05:07.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status queued for try_number 1 2024-06-27T04:05:07.566279068Z [2024-06-27T04:05:07.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status success for try_number 1 2024-06-27T04:05:07.573405256Z [2024-06-27T04:05:07.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5f088ba-c057-45c3-8c11-136a2461f7e2 2024-06-27T04:05:07.574317013Z [2024-06-27T04:05:07.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T04:00:00+00:00, map_index=-1, run_start_date=2024-06-27 04:05:06.167111+00:00, run_end_date=2024-06-27 04:05:06.547828+00:00, run_duration=0.380717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:05:04.383013+00:00, queued_by_job_id=2, pid=5757 2024-06-27T04:05:10.502646645Z [2024-06-27T04:05:10.502+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:05:10.502682622Z 2024-06-27T04:05:10.502771118Z [2024-06-27T04:05:10.502+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:05:10.503918648Z [2024-06-27T04:05:10.503+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:05:10.503929069Z 2024-06-27T04:05:10.507506168Z [2024-06-27T04:05:10.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:05:10.507777854Z [2024-06-27T04:05:10.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:05:10.575923890Z [2024-06-27T04:05:10.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status queued for try_number 1 2024-06-27T04:05:10.576033376Z [2024-06-27T04:05:10.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status success for try_number 1 2024-06-27T04:05:10.583540429Z [2024-06-27T04:05:10.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4f0a635-428e-47e8-885a-1d5db15d7d12 2024-06-27T04:05:10.583780715Z [2024-06-27T04:05:10.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:00:00+00:00, map_index=0, run_start_date=2024-06-27 04:05:09.341663+00:00, run_end_date=2024-06-27 04:05:09.748023+00:00, run_duration=0.40636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:05:07.484854+00:00, queued_by_job_id=2, pid=5769 2024-06-27T04:05:12.823644387Z [2024-06-27T04:05:12.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:05:12.824634832Z [2024-06-27T04:05:12.823+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:00:00+00:00, run_id=scheduled__2024-06-27T04:00:00+00:00, run_start_date=2024-06-27 04:05:00.733872+00:00, run_end_date=2024-06-27 04:05:12.823520+00:00, run_duration=12.089648, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:00:00+00:00, data_interval_end=2024-06-27 04:05:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T04:05:12.830964930Z [2024-06-27T04:05:12.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:05:00+00:00, run_after=2024-06-27T04:10:00+00:00 2024-06-27T04:05:13.396296360Z [2024-06-27T04:05:13.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:00:00+00:00 exited with status success for try_number 1 2024-06-27T04:05:13.403224373Z [2024-06-27T04:05:13.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:00:00+00:00, map_index=-1, run_start_date=2024-06-27 04:05:12.365425+00:00, run_end_date=2024-06-27 04:05:12.792972+00:00, run_duration=0.427547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:05:10.504646+00:00, queued_by_job_id=2, pid=5781 2024-06-27T04:06:00.686702216Z [2024-06-27T04:06:00.686+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:06:00+00:00, run_after=2024-06-27T04:07:00+00:00 2024-06-27T04:06:00.699427140Z [2024-06-27T04:06:00.698+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:06:00.710281609Z [2024-06-27T04:06:00.709+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:06:00.727468646Z [2024-06-27T04:06:00.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:06:00+00:00, run_after=2024-06-27T04:07:00+00:00 2024-06-27T04:06:00.861981032Z [2024-06-27T04:06:00.861+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:06:00.862020094Z 2024-06-27T04:06:00.862027451Z 2024-06-27T04:06:00.862033371Z 2024-06-27T04:06:00.862039131Z 2024-06-27T04:06:00.862330290Z [2024-06-27T04:06:00.861+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:06:00.862839520Z [2024-06-27T04:06:00.862+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:06:00.863472131Z [2024-06-27T04:06:00.862+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:06:00.863581941Z [2024-06-27T04:06:00.863+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:06:00.865000971Z [2024-06-27T04:06:00.864+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:06:00.865025060Z 2024-06-27T04:06:00.865032270Z 2024-06-27T04:06:00.865038411Z 2024-06-27T04:06:00.865044250Z 2024-06-27T04:06:00.873089132Z [2024-06-27T04:06:00.872+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:06:00.873526460Z [2024-06-27T04:06:00.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:06:00.874379113Z [2024-06-27T04:06:00.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:06:00.874676461Z [2024-06-27T04:06:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:06:00.875163535Z [2024-06-27T04:06:00.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:06:00.875539503Z [2024-06-27T04:06:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:06:00.875923666Z [2024-06-27T04:06:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:06:00.876197942Z [2024-06-27T04:06:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:06:01.237386779Z [2024-06-27T04:06:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:04:00+00:00 exited with status queued for try_number 1 2024-06-27T04:06:01.237708492Z [2024-06-27T04:06:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status queued for try_number 1 2024-06-27T04:06:01.237896281Z [2024-06-27T04:06:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status queued for try_number 1 2024-06-27T04:06:01.238096892Z [2024-06-27T04:06:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status queued for try_number 1 2024-06-27T04:06:01.248462665Z [2024-06-27T04:06:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f0e1da4-235d-4d14-b750-f39d6e43e636 2024-06-27T04:06:01.248718864Z [2024-06-27T04:06:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61b2915b-374c-4a42-8f28-e8263048a427 2024-06-27T04:06:01.248976049Z [2024-06-27T04:06:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b2cca65-e03a-4a95-bc42-2c5a689472a8 2024-06-27T04:06:01.249322744Z [2024-06-27T04:06:01.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7eeaac13-651d-4046-924a-471a16f77103 2024-06-27T04:06:02.421969335Z [2024-06-27T04:06:02.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:06:02.422539877Z [2024-06-27T04:06:02.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:04:00+00:00, run_id=scheduled__2024-06-27T04:04:00+00:00, run_start_date=2024-06-27 04:06:00.751134+00:00, run_end_date=2024-06-27 04:06:02.422113+00:00, run_duration=1.670979, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:04:00+00:00, data_interval_end=2024-06-27 04:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:06:02.431013855Z [2024-06-27T04:06:02.430+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:06:00+00:00, run_after=2024-06-27T04:08:00+00:00 2024-06-27T04:06:02.440058340Z [2024-06-27T04:06:02.439+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:06:02.441428069Z [2024-06-27T04:06:02.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:05:00+00:00, run_id=scheduled__2024-06-27T04:05:00+00:00, run_start_date=2024-06-27 04:06:00.753559+00:00, run_end_date=2024-06-27 04:06:02.441054+00:00, run_duration=1.687495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:05:00+00:00, data_interval_end=2024-06-27 04:06:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:06:02.452671274Z [2024-06-27T04:06:02.452+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:06:00+00:00, run_after=2024-06-27T04:07:00+00:00 2024-06-27T04:06:02.494123590Z [2024-06-27T04:06:02.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status success for try_number 1 2024-06-27T04:06:02.501241406Z [2024-06-27T04:06:02.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:05:00+00:00, map_index=-1, run_start_date=2024-06-27 04:06:01.794359+00:00, run_end_date=2024-06-27 04:06:02.186291+00:00, run_duration=0.391932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:06:00.867584+00:00, queued_by_job_id=2, pid=5808 2024-06-27T04:06:03.573090152Z [2024-06-27T04:06:03.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:04:00+00:00 exited with status success for try_number 1 2024-06-27T04:06:03.577298320Z [2024-06-27T04:06:03.576+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:04:00+00:00, map_index=-1, run_start_date=2024-06-27 04:06:01.901566+00:00, run_end_date=2024-06-27 04:06:02.347527+00:00, run_duration=0.445961, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:06:00.867584+00:00, queued_by_job_id=2, pid=5809 2024-06-27T04:06:05.864684481Z [2024-06-27T04:06:05.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:06:05.866381812Z [2024-06-27T04:06:05.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:05:00+00:00, run_id=scheduled__2024-06-27T04:05:00+00:00, run_start_date=2024-06-27 04:06:00.756686+00:00, run_end_date=2024-06-27 04:06:05.864488+00:00, run_duration=5.107802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:05:00+00:00, data_interval_end=2024-06-27 04:06:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:06:05.896085102Z [2024-06-27T04:06:05.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:06:00+00:00, run_after=2024-06-27T04:07:00+00:00 2024-06-27T04:06:05.914452615Z [2024-06-27T04:06:05.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:06:05.914643850Z [2024-06-27T04:06:05.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:05:00+00:00, run_id=scheduled__2024-06-27T04:05:00+00:00, run_start_date=2024-06-27 04:06:00.755346+00:00, run_end_date=2024-06-27 04:06:05.914355+00:00, run_duration=5.159009, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:05:00+00:00, data_interval_end=2024-06-27 04:06:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:06:05.938726195Z [2024-06-27T04:06:05.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:06:00+00:00, run_after=2024-06-27T04:07:00+00:00 2024-06-27T04:06:05.974405307Z [2024-06-27T04:06:05.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status success for try_number 1 2024-06-27T04:06:05.974725384Z [2024-06-27T04:06:05.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status success for try_number 1 2024-06-27T04:06:05.983579491Z [2024-06-27T04:06:05.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:05:00+00:00, map_index=-1, run_start_date=2024-06-27 04:06:03.064201+00:00, run_end_date=2024-06-27 04:06:05.696730+00:00, run_duration=2.632529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:06:00.867584+00:00, queued_by_job_id=2, pid=5847 2024-06-27T04:06:05.983946654Z [2024-06-27T04:06:05.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:05:00+00:00, map_index=-1, run_start_date=2024-06-27 04:06:03.125346+00:00, run_end_date=2024-06-27 04:06:05.400892+00:00, run_duration=2.275546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:06:00.867584+00:00, queued_by_job_id=2, pid=5848 2024-06-27T04:07:00.566654343Z [2024-06-27T04:07:00.566+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:07:00.580460647Z [2024-06-27T04:07:00.580+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:07:00+00:00, run_after=2024-06-27T04:08:00+00:00 2024-06-27T04:07:00.595637166Z [2024-06-27T04:07:00.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:07:00+00:00, run_after=2024-06-27T04:08:00+00:00 2024-06-27T04:07:00.693021830Z [2024-06-27T04:07:00.692+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:07:00.693086023Z 2024-06-27T04:07:00.693100121Z 2024-06-27T04:07:00.693111629Z 2024-06-27T04:07:00.693141084Z [2024-06-27T04:07:00.692+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:07:00.693648822Z [2024-06-27T04:07:00.693+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:07:00.693801015Z [2024-06-27T04:07:00.693+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:07:00.694828704Z [2024-06-27T04:07:00.694+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:07:00.694906976Z 2024-06-27T04:07:00.694917304Z 2024-06-27T04:07:00.694926458Z 2024-06-27T04:07:00.702937882Z [2024-06-27T04:07:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:07:00.703387808Z [2024-06-27T04:07:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:07:00.704264940Z [2024-06-27T04:07:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:07:00.704658798Z [2024-06-27T04:07:00.704+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:07:00.705245441Z [2024-06-27T04:07:00.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:07:00.705700551Z [2024-06-27T04:07:00.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:07:01.018266366Z [2024-06-27T04:07:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:06:00+00:00 exited with status queued for try_number 1 2024-06-27T04:07:01.020054813Z [2024-06-27T04:07:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:06:00+00:00 exited with status queued for try_number 1 2024-06-27T04:07:01.020321444Z [2024-06-27T04:07:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:06:00+00:00 exited with status queued for try_number 1 2024-06-27T04:07:01.033257313Z [2024-06-27T04:07:01.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31372990-8895-4239-9142-3a387ae20394 2024-06-27T04:07:01.033509384Z [2024-06-27T04:07:01.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69ee8e72-f1fe-4436-b3ae-f45728cf54e2 2024-06-27T04:07:01.033808661Z [2024-06-27T04:07:01.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11303766-b32d-4c2e-896d-80c9c51f046e 2024-06-27T04:07:02.256433790Z [2024-06-27T04:07:02.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:07:02.256787798Z [2024-06-27T04:07:02.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:06:00+00:00, run_id=scheduled__2024-06-27T04:06:00+00:00, run_start_date=2024-06-27 04:07:00.610793+00:00, run_end_date=2024-06-27 04:07:02.256358+00:00, run_duration=1.645565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:06:00+00:00, data_interval_end=2024-06-27 04:07:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:07:02.267922580Z [2024-06-27T04:07:02.267+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:07:00+00:00, run_after=2024-06-27T04:08:00+00:00 2024-06-27T04:07:02.314355975Z [2024-06-27T04:07:02.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:06:00+00:00 exited with status success for try_number 1 2024-06-27T04:07:02.326652455Z [2024-06-27T04:07:02.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:06:00+00:00, map_index=-1, run_start_date=2024-06-27 04:07:01.625400+00:00, run_end_date=2024-06-27 04:07:02.004223+00:00, run_duration=0.378823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:07:00.696836+00:00, queued_by_job_id=2, pid=5892 2024-06-27T04:07:05.719381475Z [2024-06-27T04:07:05.718+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:07:05.719573108Z [2024-06-27T04:07:05.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:06:00+00:00, run_id=scheduled__2024-06-27T04:06:00+00:00, run_start_date=2024-06-27 04:07:00.613861+00:00, run_end_date=2024-06-27 04:07:05.719129+00:00, run_duration=5.105268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:06:00+00:00, data_interval_end=2024-06-27 04:07:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:07:05.731345330Z [2024-06-27T04:07:05.730+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:07:00+00:00, run_after=2024-06-27T04:08:00+00:00 2024-06-27T04:07:05.740039532Z [2024-06-27T04:07:05.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:07:05.740454736Z [2024-06-27T04:07:05.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:06:00+00:00, run_id=scheduled__2024-06-27T04:06:00+00:00, run_start_date=2024-06-27 04:07:00.612426+00:00, run_end_date=2024-06-27 04:07:05.739870+00:00, run_duration=5.127444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:06:00+00:00, data_interval_end=2024-06-27 04:07:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:07:05.755765646Z [2024-06-27T04:07:05.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:07:00+00:00, run_after=2024-06-27T04:08:00+00:00 2024-06-27T04:07:05.797169707Z [2024-06-27T04:07:05.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:06:00+00:00 exited with status success for try_number 1 2024-06-27T04:07:05.797338350Z [2024-06-27T04:07:05.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:06:00+00:00 exited with status success for try_number 1 2024-06-27T04:07:05.806804520Z [2024-06-27T04:07:05.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:06:00+00:00, map_index=-1, run_start_date=2024-06-27 04:07:02.828413+00:00, run_end_date=2024-06-27 04:07:04.704822+00:00, run_duration=1.876409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:07:00.696836+00:00, queued_by_job_id=2, pid=5922 2024-06-27T04:07:05.807117607Z [2024-06-27T04:07:05.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:06:00+00:00, map_index=-1, run_start_date=2024-06-27 04:07:02.949558+00:00, run_end_date=2024-06-27 04:07:04.785424+00:00, run_duration=1.835866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:07:00.696836+00:00, queued_by_job_id=2, pid=5923 2024-06-27T04:08:00.526745610Z [2024-06-27T04:08:00.526+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:08:00+00:00, run_after=2024-06-27T04:09:00+00:00 2024-06-27T04:08:00.540501004Z [2024-06-27T04:08:00.540+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:08:00.566191863Z [2024-06-27T04:08:00.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:08:00+00:00, run_after=2024-06-27T04:09:00+00:00 2024-06-27T04:08:00.571469084Z [2024-06-27T04:08:00.571+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:08:00.660793232Z [2024-06-27T04:08:00.660+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:08:00.660816576Z 2024-06-27T04:08:00.660820409Z 2024-06-27T04:08:00.660823764Z 2024-06-27T04:08:00.660844801Z 2024-06-27T04:08:00.661017127Z [2024-06-27T04:08:00.660+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:08:00.661184093Z [2024-06-27T04:08:00.661+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:08:00.661334226Z [2024-06-27T04:08:00.661+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:08:00.661474168Z [2024-06-27T04:08:00.661+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:08:00.662283914Z [2024-06-27T04:08:00.662+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:08:00.662295524Z 2024-06-27T04:08:00.662299424Z 2024-06-27T04:08:00.662302653Z 2024-06-27T04:08:00.662305655Z 2024-06-27T04:08:00.666482989Z [2024-06-27T04:08:00.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:08:00.666769894Z [2024-06-27T04:08:00.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:08:00.667070913Z [2024-06-27T04:08:00.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:08:00.667235930Z [2024-06-27T04:08:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:08:00.667521790Z [2024-06-27T04:08:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:08:00.667711987Z [2024-06-27T04:08:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:08:00.668061229Z [2024-06-27T04:08:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:08:00.668215507Z [2024-06-27T04:08:00.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:08:00.978151271Z [2024-06-27T04:08:00.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:06:00+00:00 exited with status queued for try_number 1 2024-06-27T04:08:00.978355191Z [2024-06-27T04:08:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:07:00+00:00 exited with status queued for try_number 1 2024-06-27T04:08:00.978571493Z [2024-06-27T04:08:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:07:00+00:00 exited with status queued for try_number 1 2024-06-27T04:08:00.978708073Z [2024-06-27T04:08:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:07:00+00:00 exited with status queued for try_number 1 2024-06-27T04:08:00.990130735Z [2024-06-27T04:08:00.989+0000] {scheduler_job.py:635} INFO - Setting external_id for to a711b032-ce02-4f18-818e-72ec432e1dfc 2024-06-27T04:08:00.990184126Z [2024-06-27T04:08:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09b2298b-8ad3-47b0-9786-349258889441 2024-06-27T04:08:00.990273254Z [2024-06-27T04:08:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8adf55bc-ebea-43d2-bcc9-f5089c9eb958 2024-06-27T04:08:00.990382915Z [2024-06-27T04:08:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7038240d-b2be-427a-a860-b15726ece25c 2024-06-27T04:08:02.232993118Z [2024-06-27T04:08:02.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:08:02.233339574Z [2024-06-27T04:08:02.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:06:00+00:00, run_id=scheduled__2024-06-27T04:06:00+00:00, run_start_date=2024-06-27 04:08:00.582139+00:00, run_end_date=2024-06-27 04:08:02.233025+00:00, run_duration=1.650886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:06:00+00:00, data_interval_end=2024-06-27 04:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:08:02.247591992Z [2024-06-27T04:08:02.247+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:08:00+00:00, run_after=2024-06-27T04:10:00+00:00 2024-06-27T04:08:02.280061195Z [2024-06-27T04:08:02.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:08:02.280205333Z [2024-06-27T04:08:02.280+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:07:00+00:00, run_id=scheduled__2024-06-27T04:07:00+00:00, run_start_date=2024-06-27 04:08:00.583927+00:00, run_end_date=2024-06-27 04:08:02.279943+00:00, run_duration=1.696016, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:07:00+00:00, data_interval_end=2024-06-27 04:08:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:08:02.301672506Z [2024-06-27T04:08:02.301+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:08:00+00:00, run_after=2024-06-27T04:09:00+00:00 2024-06-27T04:08:03.453148550Z [2024-06-27T04:08:03.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:06:00+00:00 exited with status success for try_number 1 2024-06-27T04:08:03.453340129Z [2024-06-27T04:08:03.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:07:00+00:00 exited with status success for try_number 1 2024-06-27T04:08:03.461910993Z [2024-06-27T04:08:03.461+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:06:00+00:00, map_index=-1, run_start_date=2024-06-27 04:08:01.639635+00:00, run_end_date=2024-06-27 04:08:02.177519+00:00, run_duration=0.537884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:08:00.663376+00:00, queued_by_job_id=2, pid=5968 2024-06-27T04:08:03.462302236Z [2024-06-27T04:08:03.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:07:00+00:00, map_index=-1, run_start_date=2024-06-27 04:08:01.699768+00:00, run_end_date=2024-06-27 04:08:02.218345+00:00, run_duration=0.518577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:08:00.663376+00:00, queued_by_job_id=2, pid=5969 2024-06-27T04:08:04.527010885Z [2024-06-27T04:08:04.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:08:04.527427512Z [2024-06-27T04:08:04.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:07:00+00:00, run_id=scheduled__2024-06-27T04:07:00+00:00, run_start_date=2024-06-27 04:08:00.585722+00:00, run_end_date=2024-06-27 04:08:04.526856+00:00, run_duration=3.941134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:07:00+00:00, data_interval_end=2024-06-27 04:08:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:08:04.546363381Z [2024-06-27T04:08:04.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:08:00+00:00, run_after=2024-06-27T04:09:00+00:00 2024-06-27T04:08:04.612948843Z [2024-06-27T04:08:04.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:07:00+00:00 exited with status success for try_number 1 2024-06-27T04:08:04.623321625Z [2024-06-27T04:08:04.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:07:00+00:00, map_index=-1, run_start_date=2024-06-27 04:08:02.747702+00:00, run_end_date=2024-06-27 04:08:04.112644+00:00, run_duration=1.364942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:08:00.663376+00:00, queued_by_job_id=2, pid=5999 2024-06-27T04:08:05.694108542Z [2024-06-27T04:08:05.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:08:05.694543397Z [2024-06-27T04:08:05.694+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:07:00+00:00, run_id=scheduled__2024-06-27T04:07:00+00:00, run_start_date=2024-06-27 04:08:00.587202+00:00, run_end_date=2024-06-27 04:08:05.694044+00:00, run_duration=5.106842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:07:00+00:00, data_interval_end=2024-06-27 04:08:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:08:05.704239974Z [2024-06-27T04:08:05.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:08:00+00:00, run_after=2024-06-27T04:09:00+00:00 2024-06-27T04:08:05.733644547Z [2024-06-27T04:08:05.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:07:00+00:00 exited with status success for try_number 1 2024-06-27T04:08:05.738551255Z [2024-06-27T04:08:05.738+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:07:00+00:00, map_index=-1, run_start_date=2024-06-27 04:08:03.281863+00:00, run_end_date=2024-06-27 04:08:04.956543+00:00, run_duration=1.67468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:08:00.663376+00:00, queued_by_job_id=2, pid=6018 2024-06-27T04:09:00.080876763Z [2024-06-27T04:09:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:09:00+00:00, run_after=2024-06-27T04:10:00+00:00 2024-06-27T04:09:00.118781219Z [2024-06-27T04:09:00.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:09:00+00:00, run_after=2024-06-27T04:10:00+00:00 2024-06-27T04:09:00.127668407Z [2024-06-27T04:09:00.127+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:09:00.218680031Z [2024-06-27T04:09:00.218+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:09:00.218737192Z 2024-06-27T04:09:00.218751898Z 2024-06-27T04:09:00.218764659Z 2024-06-27T04:09:00.218831859Z [2024-06-27T04:09:00.218+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:09:00.218965444Z [2024-06-27T04:09:00.218+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:09:00.219090789Z [2024-06-27T04:09:00.218+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:09:00.219667759Z [2024-06-27T04:09:00.219+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:09:00.219682836Z 2024-06-27T04:09:00.219691565Z 2024-06-27T04:09:00.219700282Z 2024-06-27T04:09:00.222684682Z [2024-06-27T04:09:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:09:00.222787183Z [2024-06-27T04:09:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:09:00.223064414Z [2024-06-27T04:09:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:09:00.223220420Z [2024-06-27T04:09:00.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:09:00.223488490Z [2024-06-27T04:09:00.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:09:00.223680520Z [2024-06-27T04:09:00.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:09:00.431268215Z [2024-06-27T04:09:00.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:08:00+00:00 exited with status queued for try_number 1 2024-06-27T04:09:00.431593650Z [2024-06-27T04:09:00.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:08:00+00:00 exited with status queued for try_number 1 2024-06-27T04:09:00.431787387Z [2024-06-27T04:09:00.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:08:00+00:00 exited with status queued for try_number 1 2024-06-27T04:09:00.442166582Z [2024-06-27T04:09:00.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d3b3969-8c4a-4eb9-878f-5e5a3ec522a5 2024-06-27T04:09:00.442774688Z [2024-06-27T04:09:00.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to 787133f7-0172-412e-ae73-31a7d3715c59 2024-06-27T04:09:00.443027299Z [2024-06-27T04:09:00.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfb4eb0c-ba62-4118-ba96-def72ffee28e 2024-06-27T04:09:01.961987145Z [2024-06-27T04:09:01.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:09:01.962530447Z [2024-06-27T04:09:01.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:08:00+00:00, run_id=scheduled__2024-06-27T04:08:00+00:00, run_start_date=2024-06-27 04:09:00.138180+00:00, run_end_date=2024-06-27 04:09:01.962088+00:00, run_duration=1.823908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:08:00+00:00, data_interval_end=2024-06-27 04:09:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:09:01.978060327Z [2024-06-27T04:09:01.977+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:09:00+00:00, run_after=2024-06-27T04:10:00+00:00 2024-06-27T04:09:02.046170845Z [2024-06-27T04:09:02.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:08:00+00:00 exited with status success for try_number 1 2024-06-27T04:09:02.055854565Z [2024-06-27T04:09:02.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:08:00+00:00, map_index=-1, run_start_date=2024-06-27 04:09:01.103869+00:00, run_end_date=2024-06-27 04:09:01.540645+00:00, run_duration=0.436776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:09:00.220355+00:00, queued_by_job_id=2, pid=6052 2024-06-27T04:09:04.270627001Z [2024-06-27T04:09:04.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:09:04.270671327Z [2024-06-27T04:09:04.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:08:00+00:00, run_id=scheduled__2024-06-27T04:08:00+00:00, run_start_date=2024-06-27 04:09:00.147824+00:00, run_end_date=2024-06-27 04:09:04.267179+00:00, run_duration=4.119355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:08:00+00:00, data_interval_end=2024-06-27 04:09:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:09:04.292246027Z [2024-06-27T04:09:04.291+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:09:00+00:00, run_after=2024-06-27T04:10:00+00:00 2024-06-27T04:09:04.298264982Z [2024-06-27T04:09:04.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:09:04.298419256Z [2024-06-27T04:09:04.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:08:00+00:00, run_id=scheduled__2024-06-27T04:08:00+00:00, run_start_date=2024-06-27 04:09:00.141085+00:00, run_end_date=2024-06-27 04:09:04.298179+00:00, run_duration=4.157094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:08:00+00:00, data_interval_end=2024-06-27 04:09:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:09:04.312100111Z [2024-06-27T04:09:04.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:09:00+00:00, run_after=2024-06-27T04:10:00+00:00 2024-06-27T04:09:04.348443496Z [2024-06-27T04:09:04.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:08:00+00:00 exited with status success for try_number 1 2024-06-27T04:09:04.348507804Z [2024-06-27T04:09:04.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:08:00+00:00 exited with status success for try_number 1 2024-06-27T04:09:04.356938165Z [2024-06-27T04:09:04.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:08:00+00:00, map_index=-1, run_start_date=2024-06-27 04:09:02.103958+00:00, run_end_date=2024-06-27 04:09:03.860216+00:00, run_duration=1.756258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:09:00.220355+00:00, queued_by_job_id=2, pid=6082 2024-06-27T04:09:04.356965451Z [2024-06-27T04:09:04.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:08:00+00:00, map_index=-1, run_start_date=2024-06-27 04:09:02.152158+00:00, run_end_date=2024-06-27 04:09:03.415902+00:00, run_duration=1.263744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:09:00.220355+00:00, queued_by_job_id=2, pid=6083 2024-06-27T04:10:01.064817668Z [2024-06-27T04:10:01.063+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:10:01.090012319Z [2024-06-27T04:10:01.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:10:00+00:00, run_after=2024-06-27T04:15:00+00:00 2024-06-27T04:10:01.100483458Z [2024-06-27T04:10:01.096+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:10:00+00:00, run_after=2024-06-27T04:11:00+00:00 2024-06-27T04:10:01.104738638Z [2024-06-27T04:10:01.104+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:10:01.117608677Z [2024-06-27T04:10:01.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:10:00+00:00, run_after=2024-06-27T04:11:00+00:00 2024-06-27T04:10:01.252369782Z [2024-06-27T04:10:01.251+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T04:10:01.252490281Z 2024-06-27T04:10:01.252502352Z 2024-06-27T04:10:01.252512274Z 2024-06-27T04:10:01.252520726Z 2024-06-27T04:10:01.252529152Z 2024-06-27T04:10:01.252572513Z [2024-06-27T04:10:01.252+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:10:01.252796104Z [2024-06-27T04:10:01.252+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:10:01.252896057Z [2024-06-27T04:10:01.252+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:10:01.253202751Z [2024-06-27T04:10:01.252+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:10:01.253354669Z [2024-06-27T04:10:01.253+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:10:01.255892191Z [2024-06-27T04:10:01.254+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:10:01.255924735Z 2024-06-27T04:10:01.255934804Z 2024-06-27T04:10:01.255944201Z 2024-06-27T04:10:01.255952637Z 2024-06-27T04:10:01.255961355Z 2024-06-27T04:10:01.261523899Z [2024-06-27T04:10:01.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:10:01.261685074Z [2024-06-27T04:10:01.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:10:01.262202252Z [2024-06-27T04:10:01.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:10:01.262446616Z [2024-06-27T04:10:01.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:10:01.262955283Z [2024-06-27T04:10:01.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:10:01.263295560Z [2024-06-27T04:10:01.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:10:01.263809115Z [2024-06-27T04:10:01.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:10:01.264083947Z [2024-06-27T04:10:01.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:10:01.264483838Z [2024-06-27T04:10:01.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:10:01.264677296Z [2024-06-27T04:10:01.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:10:01.663716112Z [2024-06-27T04:10:01.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status queued for try_number 1 2024-06-27T04:10:01.664039079Z [2024-06-27T04:10:01.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:08:00+00:00 exited with status queued for try_number 1 2024-06-27T04:10:01.664131739Z [2024-06-27T04:10:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:09:00+00:00 exited with status queued for try_number 1 2024-06-27T04:10:01.664198290Z [2024-06-27T04:10:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:09:00+00:00 exited with status queued for try_number 1 2024-06-27T04:10:01.664276474Z [2024-06-27T04:10:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:09:00+00:00 exited with status queued for try_number 1 2024-06-27T04:10:01.674690591Z [2024-06-27T04:10:01.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5677627-9100-4adb-a63a-2211578c1333 2024-06-27T04:10:01.674719590Z [2024-06-27T04:10:01.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8f5e93e-e4a5-4264-be8c-aa44e6748b03 2024-06-27T04:10:01.674845791Z [2024-06-27T04:10:01.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a1ed601-a13b-4ca6-ad4c-424b1455adcb 2024-06-27T04:10:01.674938296Z [2024-06-27T04:10:01.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd16aabc-eae3-4352-bf73-f0a4cae35ac6 2024-06-27T04:10:01.675033978Z [2024-06-27T04:10:01.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 360a21ea-6a64-4907-8f05-77faf21ac8d2 2024-06-27T04:10:02.909077117Z [2024-06-27T04:10:02.908+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:10:02.910033535Z [2024-06-27T04:10:02.909+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:08:00+00:00, run_id=scheduled__2024-06-27T04:08:00+00:00, run_start_date=2024-06-27 04:10:01.142797+00:00, run_end_date=2024-06-27 04:10:02.909059+00:00, run_duration=1.766262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:08:00+00:00, data_interval_end=2024-06-27 04:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:10:02.918444231Z [2024-06-27T04:10:02.918+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:10:00+00:00, run_after=2024-06-27T04:12:00+00:00 2024-06-27T04:10:02.937796244Z [2024-06-27T04:10:02.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:10:02.938136953Z [2024-06-27T04:10:02.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:09:00+00:00, run_id=scheduled__2024-06-27T04:09:00+00:00, run_start_date=2024-06-27 04:10:01.144402+00:00, run_end_date=2024-06-27 04:10:02.937687+00:00, run_duration=1.793285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:09:00+00:00, data_interval_end=2024-06-27 04:10:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:10:02.956838156Z [2024-06-27T04:10:02.956+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:10:00+00:00, run_after=2024-06-27T04:11:00+00:00 2024-06-27T04:10:03.009180634Z [2024-06-27T04:10:03.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:08:00+00:00 exited with status success for try_number 1 2024-06-27T04:10:03.014326512Z [2024-06-27T04:10:03.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:08:00+00:00, map_index=-1, run_start_date=2024-06-27 04:10:02.215115+00:00, run_end_date=2024-06-27 04:10:02.619108+00:00, run_duration=0.403993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:10:01.256630+00:00, queued_by_job_id=2, pid=6130 2024-06-27T04:10:04.162673224Z [2024-06-27T04:10:04.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:09:00+00:00 exited with status success for try_number 1 2024-06-27T04:10:04.183018784Z [2024-06-27T04:10:04.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:09:00+00:00, map_index=-1, run_start_date=2024-06-27 04:10:02.290730+00:00, run_end_date=2024-06-27 04:10:02.839647+00:00, run_duration=0.548917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:10:01.256630+00:00, queued_by_job_id=2, pid=6131 2024-06-27T04:10:05.304288146Z [2024-06-27T04:10:05.303+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:10:05.304330725Z 2024-06-27T04:10:05.304579711Z [2024-06-27T04:10:05.304+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:10:05.305404827Z [2024-06-27T04:10:05.305+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:10:05.305431278Z 2024-06-27T04:10:05.310639675Z [2024-06-27T04:10:05.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:10:05.311040209Z [2024-06-27T04:10:05.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:10:05.370079548Z [2024-06-27T04:10:05.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status queued for try_number 1 2024-06-27T04:10:05.370309601Z [2024-06-27T04:10:05.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status success for try_number 1 2024-06-27T04:10:05.375449266Z [2024-06-27T04:10:05.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8516f042-0036-4ed2-b4e7-ed8ac5a6bd2b 2024-06-27T04:10:05.375655971Z [2024-06-27T04:10:05.375+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:05:00+00:00, map_index=-1, run_start_date=2024-06-27 04:10:03.815336+00:00, run_end_date=2024-06-27 04:10:04.273260+00:00, run_duration=0.457924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:10:01.256630+00:00, queued_by_job_id=2, pid=6181 2024-06-27T04:10:05.389398961Z [2024-06-27T04:10:05.388+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T04:10:05.629189915Z [2024-06-27T04:10:05.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:10:05.629420199Z [2024-06-27T04:10:05.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:09:00+00:00, run_id=scheduled__2024-06-27T04:09:00+00:00, run_start_date=2024-06-27 04:10:01.147209+00:00, run_end_date=2024-06-27 04:10:05.629087+00:00, run_duration=4.481878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:09:00+00:00, data_interval_end=2024-06-27 04:10:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:10:05.638109231Z [2024-06-27T04:10:05.637+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:10:00+00:00, run_after=2024-06-27T04:11:00+00:00 2024-06-27T04:10:05.645313542Z [2024-06-27T04:10:05.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:10:05.645516425Z [2024-06-27T04:10:05.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:09:00+00:00, run_id=scheduled__2024-06-27T04:09:00+00:00, run_start_date=2024-06-27 04:10:01.146097+00:00, run_end_date=2024-06-27 04:10:05.645138+00:00, run_duration=4.499041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:09:00+00:00, data_interval_end=2024-06-27 04:10:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:10:05.654918305Z [2024-06-27T04:10:05.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:10:00+00:00, run_after=2024-06-27T04:11:00+00:00 2024-06-27T04:10:05.731806955Z [2024-06-27T04:10:05.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:09:00+00:00 exited with status success for try_number 1 2024-06-27T04:10:05.732392765Z [2024-06-27T04:10:05.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:09:00+00:00 exited with status success for try_number 1 2024-06-27T04:10:05.746346817Z [2024-06-27T04:10:05.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:09:00+00:00, map_index=-1, run_start_date=2024-06-27 04:10:03.704336+00:00, run_end_date=2024-06-27 04:10:05.496342+00:00, run_duration=1.792006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:10:01.256630+00:00, queued_by_job_id=2, pid=6180 2024-06-27T04:10:05.746959883Z [2024-06-27T04:10:05.746+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:09:00+00:00, map_index=-1, run_start_date=2024-06-27 04:10:03.893064+00:00, run_end_date=2024-06-27 04:10:05.412421+00:00, run_duration=1.519357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:10:01.256630+00:00, queued_by_job_id=2, pid=6182 2024-06-27T04:10:07.959133622Z [2024-06-27T04:10:07.958+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:10:07.959178109Z 2024-06-27T04:10:07.959836802Z [2024-06-27T04:10:07.959+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:10:07.961368768Z [2024-06-27T04:10:07.960+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:10:07.961397198Z 2024-06-27T04:10:07.968297984Z [2024-06-27T04:10:07.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:10:07.968800926Z [2024-06-27T04:10:07.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:10:08.045225891Z [2024-06-27T04:10:08.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status queued for try_number 1 2024-06-27T04:10:08.045488083Z [2024-06-27T04:10:08.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status success for try_number 1 2024-06-27T04:10:08.051408203Z [2024-06-27T04:10:08.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0377ec54-cc4d-456b-b8d2-f1011c0d048b 2024-06-27T04:10:08.051879256Z [2024-06-27T04:10:08.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T04:05:00+00:00, map_index=-1, run_start_date=2024-06-27 04:10:06.999371+00:00, run_end_date=2024-06-27 04:10:07.430512+00:00, run_duration=0.431141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:10:05.306096+00:00, queued_by_job_id=2, pid=6221 2024-06-27T04:10:10.855063780Z [2024-06-27T04:10:10.854+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:10:10.855091505Z 2024-06-27T04:10:10.855527254Z [2024-06-27T04:10:10.855+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:10:10.856322064Z [2024-06-27T04:10:10.856+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:10:10.856348151Z 2024-06-27T04:10:10.859167207Z [2024-06-27T04:10:10.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:10:10.859440059Z [2024-06-27T04:10:10.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:10:10.931785554Z [2024-06-27T04:10:10.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status queued for try_number 1 2024-06-27T04:10:10.933976585Z [2024-06-27T04:10:10.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status success for try_number 1 2024-06-27T04:10:10.941179777Z [2024-06-27T04:10:10.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to a31c74dd-a24d-4ea3-90f5-0162d1b8304a 2024-06-27T04:10:10.941414473Z [2024-06-27T04:10:10.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:05:00+00:00, map_index=0, run_start_date=2024-06-27 04:10:09.772152+00:00, run_end_date=2024-06-27 04:10:10.096645+00:00, run_duration=0.324493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:10:07.962499+00:00, queued_by_job_id=2, pid=6233 2024-06-27T04:10:13.128930324Z [2024-06-27T04:10:13.128+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:10:13.129294807Z [2024-06-27T04:10:13.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:05:00+00:00, run_id=scheduled__2024-06-27T04:05:00+00:00, run_start_date=2024-06-27 04:10:01.138818+00:00, run_end_date=2024-06-27 04:10:13.128935+00:00, run_duration=11.990117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:05:00+00:00, data_interval_end=2024-06-27 04:10:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T04:10:13.136821316Z [2024-06-27T04:10:13.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:10:00+00:00, run_after=2024-06-27T04:15:00+00:00 2024-06-27T04:10:13.194143790Z [2024-06-27T04:10:13.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:05:00+00:00 exited with status success for try_number 1 2024-06-27T04:10:13.201618699Z [2024-06-27T04:10:13.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:05:00+00:00, map_index=-1, run_start_date=2024-06-27 04:10:12.584587+00:00, run_end_date=2024-06-27 04:10:12.980679+00:00, run_duration=0.396092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:10:10.856894+00:00, queued_by_job_id=2, pid=6245 2024-06-27T04:11:01.024283343Z [2024-06-27T04:11:01.023+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:11:00+00:00, run_after=2024-06-27T04:12:00+00:00 2024-06-27T04:11:01.035476051Z [2024-06-27T04:11:01.035+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:11:01.050817866Z [2024-06-27T04:11:01.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:11:00+00:00, run_after=2024-06-27T04:12:00+00:00 2024-06-27T04:11:01.165234158Z [2024-06-27T04:11:01.164+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:11:01.165259182Z 2024-06-27T04:11:01.165262618Z 2024-06-27T04:11:01.165265663Z 2024-06-27T04:11:01.165396057Z [2024-06-27T04:11:01.165+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:11:01.165617957Z [2024-06-27T04:11:01.165+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:11:01.165764895Z [2024-06-27T04:11:01.165+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:11:01.166379089Z [2024-06-27T04:11:01.166+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:11:01.166392297Z 2024-06-27T04:11:01.166398970Z 2024-06-27T04:11:01.166402328Z 2024-06-27T04:11:01.169817229Z [2024-06-27T04:11:01.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:11:01.170112114Z [2024-06-27T04:11:01.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:11:01.170456272Z [2024-06-27T04:11:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:11:01.170625650Z [2024-06-27T04:11:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:11:01.170908055Z [2024-06-27T04:11:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:11:01.171046781Z [2024-06-27T04:11:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:11:01.454159827Z [2024-06-27T04:11:01.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status queued for try_number 1 2024-06-27T04:11:01.454662461Z [2024-06-27T04:11:01.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status queued for try_number 1 2024-06-27T04:11:01.455416681Z [2024-06-27T04:11:01.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status queued for try_number 1 2024-06-27T04:11:01.475571650Z [2024-06-27T04:11:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbcfd9c1-5d64-4a41-8c7c-feef82a45285 2024-06-27T04:11:01.475600708Z [2024-06-27T04:11:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01c39d66-2dd2-47bb-9042-4f8c23895e44 2024-06-27T04:11:01.475604793Z [2024-06-27T04:11:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to 989cadb3-31ff-474d-8076-7691701bf86c 2024-06-27T04:11:02.661434322Z [2024-06-27T04:11:02.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:11:02.661716248Z [2024-06-27T04:11:02.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:10:00+00:00, run_id=scheduled__2024-06-27T04:10:00+00:00, run_start_date=2024-06-27 04:11:01.075912+00:00, run_end_date=2024-06-27 04:11:02.661397+00:00, run_duration=1.585485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:10:00+00:00, data_interval_end=2024-06-27 04:11:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:11:02.671864204Z [2024-06-27T04:11:02.671+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:11:00+00:00, run_after=2024-06-27T04:12:00+00:00 2024-06-27T04:11:02.737894668Z [2024-06-27T04:11:02.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status success for try_number 1 2024-06-27T04:11:02.743662952Z [2024-06-27T04:11:02.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:10:00+00:00, map_index=-1, run_start_date=2024-06-27 04:11:02.097761+00:00, run_end_date=2024-06-27 04:11:02.501586+00:00, run_duration=0.403825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:11:01.167036+00:00, queued_by_job_id=2, pid=6270 2024-06-27T04:11:07.279041994Z [2024-06-27T04:11:07.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:11:07.279442575Z [2024-06-27T04:11:07.279+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:10:00+00:00, run_id=scheduled__2024-06-27T04:10:00+00:00, run_start_date=2024-06-27 04:11:01.080059+00:00, run_end_date=2024-06-27 04:11:07.279041+00:00, run_duration=6.198982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:10:00+00:00, data_interval_end=2024-06-27 04:11:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:11:07.288641853Z [2024-06-27T04:11:07.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:11:00+00:00, run_after=2024-06-27T04:12:00+00:00 2024-06-27T04:11:07.297094345Z [2024-06-27T04:11:07.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:11:07.297401354Z [2024-06-27T04:11:07.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:10:00+00:00, run_id=scheduled__2024-06-27T04:10:00+00:00, run_start_date=2024-06-27 04:11:01.077616+00:00, run_end_date=2024-06-27 04:11:07.296971+00:00, run_duration=6.219355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:10:00+00:00, data_interval_end=2024-06-27 04:11:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:11:07.307415918Z [2024-06-27T04:11:07.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:11:00+00:00, run_after=2024-06-27T04:12:00+00:00 2024-06-27T04:11:07.343141810Z [2024-06-27T04:11:07.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status success for try_number 1 2024-06-27T04:11:07.343168970Z [2024-06-27T04:11:07.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status success for try_number 1 2024-06-27T04:11:07.349766247Z [2024-06-27T04:11:07.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:10:00+00:00, map_index=-1, run_start_date=2024-06-27 04:11:03.092471+00:00, run_end_date=2024-06-27 04:11:06.627050+00:00, run_duration=3.534579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:11:01.167036+00:00, queued_by_job_id=2, pid=6301 2024-06-27T04:11:07.349957566Z [2024-06-27T04:11:07.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:10:00+00:00, map_index=-1, run_start_date=2024-06-27 04:11:03.071777+00:00, run_end_date=2024-06-27 04:11:06.267106+00:00, run_duration=3.195329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:11:01.167036+00:00, queued_by_job_id=2, pid=6300 2024-06-27T04:12:00.898687368Z [2024-06-27T04:12:00.897+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:12:00.922759327Z [2024-06-27T04:12:00.922+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:12:00+00:00, run_after=2024-06-27T04:13:00+00:00 2024-06-27T04:12:00.938743720Z [2024-06-27T04:12:00.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:12:00+00:00, run_after=2024-06-27T04:13:00+00:00 2024-06-27T04:12:00.945218873Z [2024-06-27T04:12:00.944+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:12:01.029879314Z [2024-06-27T04:12:01.029+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:12:01.029923022Z 2024-06-27T04:12:01.029933718Z 2024-06-27T04:12:01.029966203Z 2024-06-27T04:12:01.029975279Z 2024-06-27T04:12:01.029998432Z [2024-06-27T04:12:01.029+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:12:01.030216196Z [2024-06-27T04:12:01.030+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:12:01.030470665Z [2024-06-27T04:12:01.030+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:12:01.030635662Z [2024-06-27T04:12:01.030+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:12:01.031375257Z [2024-06-27T04:12:01.031+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:12:01.031392990Z 2024-06-27T04:12:01.031402861Z 2024-06-27T04:12:01.031411315Z 2024-06-27T04:12:01.031419686Z 2024-06-27T04:12:01.035692434Z [2024-06-27T04:12:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:12:01.035740224Z [2024-06-27T04:12:01.035+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:12:01.036083868Z [2024-06-27T04:12:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:12:01.036227168Z [2024-06-27T04:12:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:12:01.036514177Z [2024-06-27T04:12:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:12:01.036694369Z [2024-06-27T04:12:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:12:01.037020711Z [2024-06-27T04:12:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:12:01.037403634Z [2024-06-27T04:12:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:12:01.517392050Z [2024-06-27T04:12:01.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status queued for try_number 1 2024-06-27T04:12:01.517466374Z [2024-06-27T04:12:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:11:00+00:00 exited with status queued for try_number 1 2024-06-27T04:12:01.517471480Z [2024-06-27T04:12:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:11:00+00:00 exited with status queued for try_number 1 2024-06-27T04:12:01.517521515Z [2024-06-27T04:12:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:11:00+00:00 exited with status queued for try_number 1 2024-06-27T04:12:01.530953925Z [2024-06-27T04:12:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to fadeaa98-87b8-434f-a6ee-397cf5f30e25 2024-06-27T04:12:01.531068890Z [2024-06-27T04:12:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 584b373a-0406-46da-82ae-ea286881910d 2024-06-27T04:12:01.531077567Z [2024-06-27T04:12:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef76a706-adc0-427a-8a55-c174320f37c9 2024-06-27T04:12:01.531207266Z [2024-06-27T04:12:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d1d8cb1-e7f4-417a-9fa3-48f2148d32db 2024-06-27T04:12:02.921030238Z [2024-06-27T04:12:02.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:12:02.925785092Z [2024-06-27T04:12:02.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:10:00+00:00, run_id=scheduled__2024-06-27T04:10:00+00:00, run_start_date=2024-06-27 04:12:00.957612+00:00, run_end_date=2024-06-27 04:12:02.925350+00:00, run_duration=1.967738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:10:00+00:00, data_interval_end=2024-06-27 04:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:12:02.941302142Z [2024-06-27T04:12:02.941+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:12:00+00:00, run_after=2024-06-27T04:14:00+00:00 2024-06-27T04:12:02.956556097Z [2024-06-27T04:12:02.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:12:02.957415038Z [2024-06-27T04:12:02.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:11:00+00:00, run_id=scheduled__2024-06-27T04:11:00+00:00, run_start_date=2024-06-27 04:12:00.959412+00:00, run_end_date=2024-06-27 04:12:02.956660+00:00, run_duration=1.997248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:11:00+00:00, data_interval_end=2024-06-27 04:12:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:12:02.972340574Z [2024-06-27T04:12:02.972+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:12:00+00:00, run_after=2024-06-27T04:13:00+00:00 2024-06-27T04:12:03.038260693Z [2024-06-27T04:12:03.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status success for try_number 1 2024-06-27T04:12:03.043702676Z [2024-06-27T04:12:03.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:10:00+00:00, map_index=-1, run_start_date=2024-06-27 04:12:01.992801+00:00, run_end_date=2024-06-27 04:12:02.503070+00:00, run_duration=0.510269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:12:01.032365+00:00, queued_by_job_id=2, pid=6347 2024-06-27T04:12:04.140205147Z [2024-06-27T04:12:04.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:11:00+00:00 exited with status success for try_number 1 2024-06-27T04:12:04.146561306Z [2024-06-27T04:12:04.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:11:00+00:00, map_index=-1, run_start_date=2024-06-27 04:12:02.095495+00:00, run_end_date=2024-06-27 04:12:02.767589+00:00, run_duration=0.672094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:12:01.032365+00:00, queued_by_job_id=2, pid=6348 2024-06-27T04:12:06.021899317Z [2024-06-27T04:12:06.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:12:06.022197361Z [2024-06-27T04:12:06.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:11:00+00:00, run_id=scheduled__2024-06-27T04:11:00+00:00, run_start_date=2024-06-27 04:12:00.962510+00:00, run_end_date=2024-06-27 04:12:06.021890+00:00, run_duration=5.05938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:11:00+00:00, data_interval_end=2024-06-27 04:12:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:12:06.030747295Z [2024-06-27T04:12:06.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:12:00+00:00, run_after=2024-06-27T04:13:00+00:00 2024-06-27T04:12:06.036693559Z [2024-06-27T04:12:06.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:12:06.036936638Z [2024-06-27T04:12:06.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:11:00+00:00, run_id=scheduled__2024-06-27T04:11:00+00:00, run_start_date=2024-06-27 04:12:00.960988+00:00, run_end_date=2024-06-27 04:12:06.036652+00:00, run_duration=5.075664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:11:00+00:00, data_interval_end=2024-06-27 04:12:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:12:06.046688182Z [2024-06-27T04:12:06.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:12:00+00:00, run_after=2024-06-27T04:13:00+00:00 2024-06-27T04:12:06.084190892Z [2024-06-27T04:12:06.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:11:00+00:00 exited with status success for try_number 1 2024-06-27T04:12:06.084612864Z [2024-06-27T04:12:06.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:11:00+00:00 exited with status success for try_number 1 2024-06-27T04:12:06.095788949Z [2024-06-27T04:12:06.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:11:00+00:00, map_index=-1, run_start_date=2024-06-27 04:12:03.234379+00:00, run_end_date=2024-06-27 04:12:05.254376+00:00, run_duration=2.019997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:12:01.032365+00:00, queued_by_job_id=2, pid=6387 2024-06-27T04:12:06.096329486Z [2024-06-27T04:12:06.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:11:00+00:00, map_index=-1, run_start_date=2024-06-27 04:12:03.348827+00:00, run_end_date=2024-06-27 04:12:05.076001+00:00, run_duration=1.727174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:12:01.032365+00:00, queued_by_job_id=2, pid=6388 2024-06-27T04:13:00.212736548Z [2024-06-27T04:13:00.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:13:00+00:00, run_after=2024-06-27T04:14:00+00:00 2024-06-27T04:13:00.224583154Z [2024-06-27T04:13:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:13:00+00:00, run_after=2024-06-27T04:14:00+00:00 2024-06-27T04:13:00.231375935Z [2024-06-27T04:13:00.230+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:13:00.307389005Z [2024-06-27T04:13:00.306+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:13:00.307432859Z 2024-06-27T04:13:00.307442572Z 2024-06-27T04:13:00.307451380Z 2024-06-27T04:13:00.307722401Z [2024-06-27T04:13:00.307+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:13:00.308006345Z [2024-06-27T04:13:00.307+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:13:00.308257498Z [2024-06-27T04:13:00.307+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:13:00.309586888Z [2024-06-27T04:13:00.309+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:13:00.309597664Z 2024-06-27T04:13:00.309601274Z 2024-06-27T04:13:00.309604566Z 2024-06-27T04:13:00.314781004Z [2024-06-27T04:13:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:13:00.315356270Z [2024-06-27T04:13:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:13:00.316474783Z [2024-06-27T04:13:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:13:00.316842300Z [2024-06-27T04:13:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:13:00.317738740Z [2024-06-27T04:13:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:13:00.318084422Z [2024-06-27T04:13:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:13:00.538111151Z [2024-06-27T04:13:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:12:00+00:00 exited with status queued for try_number 1 2024-06-27T04:13:00.538396195Z [2024-06-27T04:13:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:12:00+00:00 exited with status queued for try_number 1 2024-06-27T04:13:00.538564971Z [2024-06-27T04:13:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:12:00+00:00 exited with status queued for try_number 1 2024-06-27T04:13:00.549266124Z [2024-06-27T04:13:00.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c0a042c-8c69-4970-90c9-8182f021a1ce 2024-06-27T04:13:00.549582026Z [2024-06-27T04:13:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to eda48f3a-0b52-41c7-a423-393d9aa9e37d 2024-06-27T04:13:00.549847394Z [2024-06-27T04:13:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fa87ab1-e66d-4113-8777-6f873e1baade 2024-06-27T04:13:01.971014639Z [2024-06-27T04:13:01.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:13:01.971200767Z [2024-06-27T04:13:01.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:12:00+00:00, run_id=scheduled__2024-06-27T04:12:00+00:00, run_start_date=2024-06-27 04:13:00.241230+00:00, run_end_date=2024-06-27 04:13:01.970932+00:00, run_duration=1.729702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:12:00+00:00, data_interval_end=2024-06-27 04:13:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:13:01.981007705Z [2024-06-27T04:13:01.980+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:13:00+00:00, run_after=2024-06-27T04:14:00+00:00 2024-06-27T04:13:02.024037567Z [2024-06-27T04:13:02.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:12:00+00:00 exited with status success for try_number 1 2024-06-27T04:13:02.028558568Z [2024-06-27T04:13:02.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:12:00+00:00, map_index=-1, run_start_date=2024-06-27 04:13:01.143333+00:00, run_end_date=2024-06-27 04:13:01.735890+00:00, run_duration=0.592557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:13:00.310818+00:00, queued_by_job_id=2, pid=6432 2024-06-27T04:13:04.203940931Z [2024-06-27T04:13:04.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:13:04.204261861Z [2024-06-27T04:13:04.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:12:00+00:00, run_id=scheduled__2024-06-27T04:12:00+00:00, run_start_date=2024-06-27 04:13:00.243305+00:00, run_end_date=2024-06-27 04:13:04.203836+00:00, run_duration=3.960531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:12:00+00:00, data_interval_end=2024-06-27 04:13:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:13:04.222022502Z [2024-06-27T04:13:04.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:13:00+00:00, run_after=2024-06-27T04:14:00+00:00 2024-06-27T04:13:04.281548279Z [2024-06-27T04:13:04.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:12:00+00:00 exited with status success for try_number 1 2024-06-27T04:13:04.288973378Z [2024-06-27T04:13:04.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:12:00+00:00, map_index=-1, run_start_date=2024-06-27 04:13:02.238470+00:00, run_end_date=2024-06-27 04:13:03.528673+00:00, run_duration=1.290203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:13:00.310818+00:00, queued_by_job_id=2, pid=6462 2024-06-27T04:13:05.360692641Z [2024-06-27T04:13:05.360+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:13:05.361083325Z [2024-06-27T04:13:05.360+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:12:00+00:00, run_id=scheduled__2024-06-27T04:12:00+00:00, run_start_date=2024-06-27 04:13:00.245564+00:00, run_end_date=2024-06-27 04:13:05.360564+00:00, run_duration=5.115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:12:00+00:00, data_interval_end=2024-06-27 04:13:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:13:05.372910004Z [2024-06-27T04:13:05.372+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:13:00+00:00, run_after=2024-06-27T04:14:00+00:00 2024-06-27T04:13:05.408653401Z [2024-06-27T04:13:05.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:12:00+00:00 exited with status success for try_number 1 2024-06-27T04:13:05.414361076Z [2024-06-27T04:13:05.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:12:00+00:00, map_index=-1, run_start_date=2024-06-27 04:13:02.269973+00:00, run_end_date=2024-06-27 04:13:04.254560+00:00, run_duration=1.984587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:13:00.310818+00:00, queued_by_job_id=2, pid=6463 2024-06-27T04:14:00.657070502Z [2024-06-27T04:14:00.656+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:14:00.667239349Z [2024-06-27T04:14:00.666+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:14:00.679971620Z [2024-06-27T04:14:00.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:14:00+00:00, run_after=2024-06-27T04:15:00+00:00 2024-06-27T04:14:00.694067814Z [2024-06-27T04:14:00.693+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:14:00+00:00, run_after=2024-06-27T04:15:00+00:00 2024-06-27T04:14:00.819649647Z [2024-06-27T04:14:00.819+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:14:00.819701601Z 2024-06-27T04:14:00.819715118Z 2024-06-27T04:14:00.819725417Z 2024-06-27T04:14:00.819735358Z 2024-06-27T04:14:00.820081341Z [2024-06-27T04:14:00.819+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:14:00.820366436Z [2024-06-27T04:14:00.820+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:14:00.820624190Z [2024-06-27T04:14:00.820+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:14:00.820907875Z [2024-06-27T04:14:00.820+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:14:00.821753488Z [2024-06-27T04:14:00.821+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:14:00.821808032Z 2024-06-27T04:14:00.821820137Z 2024-06-27T04:14:00.821830198Z 2024-06-27T04:14:00.821840266Z 2024-06-27T04:14:00.827006124Z [2024-06-27T04:14:00.826+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:14:00.827323128Z [2024-06-27T04:14:00.827+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:14:00.827731811Z [2024-06-27T04:14:00.827+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:14:00.827824254Z [2024-06-27T04:14:00.827+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:14:00.828111816Z [2024-06-27T04:14:00.827+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:14:00.828277649Z [2024-06-27T04:14:00.828+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:14:00.828546937Z [2024-06-27T04:14:00.828+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:14:00.828723481Z [2024-06-27T04:14:00.828+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:14:01.212484282Z [2024-06-27T04:14:01.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:12:00+00:00 exited with status queued for try_number 1 2024-06-27T04:14:01.212998084Z [2024-06-27T04:14:01.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:13:00+00:00 exited with status queued for try_number 1 2024-06-27T04:14:01.213122392Z [2024-06-27T04:14:01.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:13:00+00:00 exited with status queued for try_number 1 2024-06-27T04:14:01.213232177Z [2024-06-27T04:14:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:13:00+00:00 exited with status queued for try_number 1 2024-06-27T04:14:01.230262487Z [2024-06-27T04:14:01.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75b44f84-f60f-43b3-b65d-30915430e26f 2024-06-27T04:14:01.230408808Z [2024-06-27T04:14:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e5782db-bcbb-4f3f-bf57-07d043e4c70e 2024-06-27T04:14:01.230607320Z [2024-06-27T04:14:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to 617bb491-b720-40d7-878d-407c0319c0f0 2024-06-27T04:14:01.230766329Z [2024-06-27T04:14:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to 554a6ead-529c-45b0-aea4-a11e7b3940f4 2024-06-27T04:14:03.187567252Z [2024-06-27T04:14:03.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:14:03.188947168Z [2024-06-27T04:14:03.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:12:00+00:00, run_id=scheduled__2024-06-27T04:12:00+00:00, run_start_date=2024-06-27 04:14:00.708270+00:00, run_end_date=2024-06-27 04:14:03.188276+00:00, run_duration=2.480006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:12:00+00:00, data_interval_end=2024-06-27 04:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:14:03.202988945Z [2024-06-27T04:14:03.202+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:14:00+00:00, run_after=2024-06-27T04:16:00+00:00 2024-06-27T04:14:03.212034245Z [2024-06-27T04:14:03.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:14:03.212375350Z [2024-06-27T04:14:03.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:13:00+00:00, run_id=scheduled__2024-06-27T04:13:00+00:00, run_start_date=2024-06-27 04:14:00.710287+00:00, run_end_date=2024-06-27 04:14:03.212058+00:00, run_duration=2.501771, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:13:00+00:00, data_interval_end=2024-06-27 04:14:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:14:03.225818836Z [2024-06-27T04:14:03.225+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:14:00+00:00, run_after=2024-06-27T04:15:00+00:00 2024-06-27T04:14:03.341572259Z [2024-06-27T04:14:03.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:12:00+00:00 exited with status success for try_number 1 2024-06-27T04:14:03.341611129Z [2024-06-27T04:14:03.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:13:00+00:00 exited with status success for try_number 1 2024-06-27T04:14:03.351897828Z [2024-06-27T04:14:03.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:13:00+00:00, map_index=-1, run_start_date=2024-06-27 04:14:02.219227+00:00, run_end_date=2024-06-27 04:14:02.824747+00:00, run_duration=0.60552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:14:00.822855+00:00, queued_by_job_id=2, pid=6510 2024-06-27T04:14:03.352029273Z [2024-06-27T04:14:03.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:12:00+00:00, map_index=-1, run_start_date=2024-06-27 04:14:02.132290+00:00, run_end_date=2024-06-27 04:14:02.569525+00:00, run_duration=0.437235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:14:00.822855+00:00, queued_by_job_id=2, pid=6509 2024-06-27T04:14:05.524545986Z [2024-06-27T04:14:05.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:14:05.524914567Z [2024-06-27T04:14:05.524+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:13:00+00:00, run_id=scheduled__2024-06-27T04:13:00+00:00, run_start_date=2024-06-27 04:14:00.714175+00:00, run_end_date=2024-06-27 04:14:05.524446+00:00, run_duration=4.810271, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:13:00+00:00, data_interval_end=2024-06-27 04:14:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:14:05.533729664Z [2024-06-27T04:14:05.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:14:00+00:00, run_after=2024-06-27T04:15:00+00:00 2024-06-27T04:14:05.540095370Z [2024-06-27T04:14:05.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:14:05.540428987Z [2024-06-27T04:14:05.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:13:00+00:00, run_id=scheduled__2024-06-27T04:13:00+00:00, run_start_date=2024-06-27 04:14:00.712053+00:00, run_end_date=2024-06-27 04:14:05.540065+00:00, run_duration=4.828012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:13:00+00:00, data_interval_end=2024-06-27 04:14:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:14:05.551462776Z [2024-06-27T04:14:05.551+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:14:00+00:00, run_after=2024-06-27T04:15:00+00:00 2024-06-27T04:14:05.599426594Z [2024-06-27T04:14:05.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:13:00+00:00 exited with status success for try_number 1 2024-06-27T04:14:05.603905641Z [2024-06-27T04:14:05.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:13:00+00:00 exited with status success for try_number 1 2024-06-27T04:14:05.613393335Z [2024-06-27T04:14:05.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:13:00+00:00, map_index=-1, run_start_date=2024-06-27 04:14:03.431155+00:00, run_end_date=2024-06-27 04:14:05.305399+00:00, run_duration=1.874244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:14:00.822855+00:00, queued_by_job_id=2, pid=6540 2024-06-27T04:14:05.613679617Z [2024-06-27T04:14:05.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:13:00+00:00, map_index=-1, run_start_date=2024-06-27 04:14:03.778722+00:00, run_end_date=2024-06-27 04:14:05.317797+00:00, run_duration=1.539075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:14:00.822855+00:00, queued_by_job_id=2, pid=6552 2024-06-27T04:15:00.097455179Z [2024-06-27T04:15:00.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:15:00.115398090Z [2024-06-27T04:15:00.115+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:15:00+00:00, run_after=2024-06-27T04:16:00+00:00 2024-06-27T04:15:00.132770170Z [2024-06-27T04:15:00.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:15:00+00:00, run_after=2024-06-27T04:16:00+00:00 2024-06-27T04:15:00.147234523Z [2024-06-27T04:15:00.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:15:00+00:00, run_after=2024-06-27T04:20:00+00:00 2024-06-27T04:15:00.233883559Z [2024-06-27T04:15:00.233+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:15:00.233923096Z 2024-06-27T04:15:00.233933639Z 2024-06-27T04:15:00.233941619Z 2024-06-27T04:15:00.233949726Z 2024-06-27T04:15:00.234368108Z [2024-06-27T04:15:00.234+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:15:00.234807318Z [2024-06-27T04:15:00.234+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:15:00.235210392Z [2024-06-27T04:15:00.234+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:15:00.235596754Z [2024-06-27T04:15:00.235+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:15:00.237135313Z [2024-06-27T04:15:00.236+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:15:00.237147731Z 2024-06-27T04:15:00.237152135Z 2024-06-27T04:15:00.237155388Z 2024-06-27T04:15:00.237159021Z 2024-06-27T04:15:00.243133518Z [2024-06-27T04:15:00.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:15:00.243563041Z [2024-06-27T04:15:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:15:00.244106622Z [2024-06-27T04:15:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:15:00.244491164Z [2024-06-27T04:15:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:15:00.245051987Z [2024-06-27T04:15:00.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:15:00.245374277Z [2024-06-27T04:15:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:15:00.246006224Z [2024-06-27T04:15:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:15:00.246348461Z [2024-06-27T04:15:00.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:15:00.712027913Z [2024-06-27T04:15:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status queued for try_number 1 2024-06-27T04:15:00.712266078Z [2024-06-27T04:15:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:14:00+00:00 exited with status queued for try_number 1 2024-06-27T04:15:00.712426876Z [2024-06-27T04:15:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:14:00+00:00 exited with status queued for try_number 1 2024-06-27T04:15:00.712617541Z [2024-06-27T04:15:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:14:00+00:00 exited with status queued for try_number 1 2024-06-27T04:15:00.723575834Z [2024-06-27T04:15:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff03e67d-b276-4fb9-b604-18b7d3deda67 2024-06-27T04:15:00.723984280Z [2024-06-27T04:15:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to bef28cdd-4538-4598-b10a-467711ce24b8 2024-06-27T04:15:00.724232668Z [2024-06-27T04:15:00.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to beb3d9a1-d564-4d92-be83-36750f0caf59 2024-06-27T04:15:00.724431209Z [2024-06-27T04:15:00.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to af277a33-00bb-4992-abec-65b99a6e4768 2024-06-27T04:15:03.047489061Z [2024-06-27T04:15:03.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:15:03.047868027Z [2024-06-27T04:15:03.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:14:00+00:00, run_id=scheduled__2024-06-27T04:14:00+00:00, run_start_date=2024-06-27 04:15:00.159663+00:00, run_end_date=2024-06-27 04:15:03.047414+00:00, run_duration=2.887751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:14:00+00:00, data_interval_end=2024-06-27 04:15:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:15:03.071143655Z [2024-06-27T04:15:03.070+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:15:00+00:00, run_after=2024-06-27T04:16:00+00:00 2024-06-27T04:15:03.126057560Z [2024-06-27T04:15:03.125+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:15:03.126112407Z 2024-06-27T04:15:03.127718501Z [2024-06-27T04:15:03.127+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:15:03.128300004Z [2024-06-27T04:15:03.128+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:15:03.128323949Z 2024-06-27T04:15:03.132124286Z [2024-06-27T04:15:03.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:15:03.132334256Z [2024-06-27T04:15:03.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:15:03.180443101Z [2024-06-27T04:15:03.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status queued for try_number 1 2024-06-27T04:15:03.180580415Z [2024-06-27T04:15:03.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status success for try_number 1 2024-06-27T04:15:03.180837983Z [2024-06-27T04:15:03.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:14:00+00:00 exited with status success for try_number 1 2024-06-27T04:15:03.186562431Z [2024-06-27T04:15:03.186+0000] {scheduler_job.py:635} INFO - Setting external_id for to 020e0129-7b96-4359-8955-9d394ea442ff 2024-06-27T04:15:03.186889728Z [2024-06-27T04:15:03.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:14:00+00:00, map_index=-1, run_start_date=2024-06-27 04:15:01.436557+00:00, run_end_date=2024-06-27 04:15:02.016452+00:00, run_duration=0.579895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:15:00.239204+00:00, queued_by_job_id=2, pid=6597 2024-06-27T04:15:03.187200320Z [2024-06-27T04:15:03.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:10:00+00:00, map_index=-1, run_start_date=2024-06-27 04:15:02.410010+00:00, run_end_date=2024-06-27 04:15:02.903880+00:00, run_duration=0.49387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:15:00.239204+00:00, queued_by_job_id=2, pid=6636 2024-06-27T04:15:04.359654462Z [2024-06-27T04:15:04.359+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:15:04.359851670Z [2024-06-27T04:15:04.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:14:00+00:00, run_id=scheduled__2024-06-27T04:14:00+00:00, run_start_date=2024-06-27 04:15:00.160680+00:00, run_end_date=2024-06-27 04:15:04.359482+00:00, run_duration=4.198802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:14:00+00:00, data_interval_end=2024-06-27 04:15:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:15:04.371601536Z [2024-06-27T04:15:04.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:15:00+00:00, run_after=2024-06-27T04:16:00+00:00 2024-06-27T04:15:04.439149633Z [2024-06-27T04:15:04.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:14:00+00:00 exited with status success for try_number 1 2024-06-27T04:15:04.446417187Z [2024-06-27T04:15:04.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:14:00+00:00, map_index=-1, run_start_date=2024-06-27 04:15:02.596438+00:00, run_end_date=2024-06-27 04:15:04.051560+00:00, run_duration=1.455122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:15:00.239204+00:00, queued_by_job_id=2, pid=6638 2024-06-27T04:15:05.459319876Z [2024-06-27T04:15:05.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:15:05.467564118Z [2024-06-27T04:15:05.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:14:00+00:00, run_id=scheduled__2024-06-27T04:14:00+00:00, run_start_date=2024-06-27 04:15:00.161661+00:00, run_end_date=2024-06-27 04:15:05.459246+00:00, run_duration=5.297585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:14:00+00:00, data_interval_end=2024-06-27 04:15:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:15:05.492352194Z [2024-06-27T04:15:05.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:15:00+00:00, run_after=2024-06-27T04:16:00+00:00 2024-06-27T04:15:05.523290512Z [2024-06-27T04:15:05.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:14:00+00:00 exited with status success for try_number 1 2024-06-27T04:15:05.533592409Z [2024-06-27T04:15:05.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:14:00+00:00, map_index=-1, run_start_date=2024-06-27 04:15:02.564726+00:00, run_end_date=2024-06-27 04:15:04.394044+00:00, run_duration=1.829318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:15:00.239204+00:00, queued_by_job_id=2, pid=6637 2024-06-27T04:15:05.546330266Z [2024-06-27T04:15:05.546+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T04:15:06.636536345Z [2024-06-27T04:15:06.636+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:15:06.636556319Z 2024-06-27T04:15:06.636967941Z [2024-06-27T04:15:06.636+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:15:06.637648870Z [2024-06-27T04:15:06.637+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:15:06.637659778Z 2024-06-27T04:15:06.640169407Z [2024-06-27T04:15:06.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:15:06.640375364Z [2024-06-27T04:15:06.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:15:06.706741250Z [2024-06-27T04:15:06.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status queued for try_number 1 2024-06-27T04:15:06.706772034Z [2024-06-27T04:15:06.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status success for try_number 1 2024-06-27T04:15:06.742536515Z [2024-06-27T04:15:06.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to d36cc069-a749-4c7a-8b7e-48d83593ec71 2024-06-27T04:15:06.746955371Z [2024-06-27T04:15:06.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T04:10:00+00:00, map_index=-1, run_start_date=2024-06-27 04:15:05.007689+00:00, run_end_date=2024-06-27 04:15:05.349429+00:00, run_duration=0.34174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:15:03.129377+00:00, queued_by_job_id=2, pid=6677 2024-06-27T04:15:09.429692807Z [2024-06-27T04:15:09.429+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:15:09.429728993Z 2024-06-27T04:15:09.430197193Z [2024-06-27T04:15:09.429+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:15:09.431199130Z [2024-06-27T04:15:09.430+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:15:09.431214199Z 2024-06-27T04:15:09.434694592Z [2024-06-27T04:15:09.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:15:09.435052599Z [2024-06-27T04:15:09.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:15:09.489537238Z [2024-06-27T04:15:09.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status queued for try_number 1 2024-06-27T04:15:09.489839777Z [2024-06-27T04:15:09.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status success for try_number 1 2024-06-27T04:15:09.503320658Z [2024-06-27T04:15:09.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70e10bbf-f4b3-49f4-a824-76931f13c677 2024-06-27T04:15:09.504227529Z [2024-06-27T04:15:09.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:10:00+00:00, map_index=0, run_start_date=2024-06-27 04:15:08.282082+00:00, run_end_date=2024-06-27 04:15:08.649620+00:00, run_duration=0.367538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:15:06.638129+00:00, queued_by_job_id=2, pid=6689 2024-06-27T04:15:12.270728420Z [2024-06-27T04:15:12.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:15:12.271112773Z [2024-06-27T04:15:12.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:10:00+00:00, run_id=scheduled__2024-06-27T04:10:00+00:00, run_start_date=2024-06-27 04:15:00.158353+00:00, run_end_date=2024-06-27 04:15:12.270559+00:00, run_duration=12.112206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:10:00+00:00, data_interval_end=2024-06-27 04:15:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T04:15:12.278463519Z [2024-06-27T04:15:12.278+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:15:00+00:00, run_after=2024-06-27T04:20:00+00:00 2024-06-27T04:15:12.315168855Z [2024-06-27T04:15:12.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:10:00+00:00 exited with status success for try_number 1 2024-06-27T04:15:12.323816765Z [2024-06-27T04:15:12.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:10:00+00:00, map_index=-1, run_start_date=2024-06-27 04:15:11.102167+00:00, run_end_date=2024-06-27 04:15:11.478114+00:00, run_duration=0.375947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:15:09.431859+00:00, queued_by_job_id=2, pid=6701 2024-06-27T04:16:00.270174273Z [2024-06-27T04:16:00.269+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:16:00+00:00, run_after=2024-06-27T04:17:00+00:00 2024-06-27T04:16:00.302907813Z [2024-06-27T04:16:00.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:16:00+00:00, run_after=2024-06-27T04:17:00+00:00 2024-06-27T04:16:00.313599833Z [2024-06-27T04:16:00.313+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:16:00.322941697Z [2024-06-27T04:16:00.322+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:16:00.425582781Z [2024-06-27T04:16:00.424+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:16:00.425735451Z 2024-06-27T04:16:00.425962442Z 2024-06-27T04:16:00.426054565Z 2024-06-27T04:16:00.426070434Z 2024-06-27T04:16:00.426084195Z [2024-06-27T04:16:00.425+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:16:00.426183688Z [2024-06-27T04:16:00.425+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:16:00.426199407Z [2024-06-27T04:16:00.425+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:16:00.426213137Z [2024-06-27T04:16:00.425+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:16:00.426764171Z [2024-06-27T04:16:00.426+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:16:00.426795659Z 2024-06-27T04:16:00.426832112Z 2024-06-27T04:16:00.426845342Z 2024-06-27T04:16:00.426857795Z 2024-06-27T04:16:00.432946198Z [2024-06-27T04:16:00.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:16:00.433005961Z [2024-06-27T04:16:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:16:00.433382349Z [2024-06-27T04:16:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:16:00.433405510Z [2024-06-27T04:16:00.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:16:00.433771243Z [2024-06-27T04:16:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:16:00.433824467Z [2024-06-27T04:16:00.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:16:00.434198725Z [2024-06-27T04:16:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:16:00.434280370Z [2024-06-27T04:16:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:16:00.697984197Z [2024-06-27T04:16:00.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:14:00+00:00 exited with status queued for try_number 1 2024-06-27T04:16:00.698020269Z [2024-06-27T04:16:00.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status queued for try_number 1 2024-06-27T04:16:00.700064686Z [2024-06-27T04:16:00.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status queued for try_number 1 2024-06-27T04:16:00.700325051Z [2024-06-27T04:16:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status queued for try_number 1 2024-06-27T04:16:00.708407944Z [2024-06-27T04:16:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 431cdad0-baee-4990-bf6c-a3b926b04164 2024-06-27T04:16:00.708604356Z [2024-06-27T04:16:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to e842ee97-014e-495f-ba32-3cb26bb5f844 2024-06-27T04:16:00.708696376Z [2024-06-27T04:16:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to c673f282-07b2-4abd-acdf-cf32be15c75c 2024-06-27T04:16:00.708871028Z [2024-06-27T04:16:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d5dd324-92fc-4f17-8cac-30564045cf24 2024-06-27T04:16:03.188014366Z [2024-06-27T04:16:03.186+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:16:03.188040711Z [2024-06-27T04:16:03.187+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:14:00+00:00, run_id=scheduled__2024-06-27T04:14:00+00:00, run_start_date=2024-06-27 04:16:00.336551+00:00, run_end_date=2024-06-27 04:16:03.187388+00:00, run_duration=2.850837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:14:00+00:00, data_interval_end=2024-06-27 04:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:16:03.199622489Z [2024-06-27T04:16:03.199+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:16:00+00:00, run_after=2024-06-27T04:18:00+00:00 2024-06-27T04:16:03.207425388Z [2024-06-27T04:16:03.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:16:03.207523105Z [2024-06-27T04:16:03.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:15:00+00:00, run_id=scheduled__2024-06-27T04:15:00+00:00, run_start_date=2024-06-27 04:16:00.338945+00:00, run_end_date=2024-06-27 04:16:03.207291+00:00, run_duration=2.868346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:15:00+00:00, data_interval_end=2024-06-27 04:16:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:16:03.217971345Z [2024-06-27T04:16:03.217+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:16:00+00:00, run_after=2024-06-27T04:17:00+00:00 2024-06-27T04:16:03.282319837Z [2024-06-27T04:16:03.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:14:00+00:00 exited with status success for try_number 1 2024-06-27T04:16:03.282404081Z [2024-06-27T04:16:03.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status success for try_number 1 2024-06-27T04:16:03.290242446Z [2024-06-27T04:16:03.289+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:14:00+00:00, map_index=-1, run_start_date=2024-06-27 04:16:01.612779+00:00, run_end_date=2024-06-27 04:16:02.352488+00:00, run_duration=0.739709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:16:00.427660+00:00, queued_by_job_id=2, pid=6721 2024-06-27T04:16:03.290330354Z [2024-06-27T04:16:03.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:15:00+00:00, map_index=-1, run_start_date=2024-06-27 04:16:01.951048+00:00, run_end_date=2024-06-27 04:16:02.454599+00:00, run_duration=0.503551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:16:00.427660+00:00, queued_by_job_id=2, pid=6730 2024-06-27T04:16:05.379018695Z [2024-06-27T04:16:05.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:16:05.379521965Z [2024-06-27T04:16:05.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:15:00+00:00, run_id=scheduled__2024-06-27T04:15:00+00:00, run_start_date=2024-06-27 04:16:00.340316+00:00, run_end_date=2024-06-27 04:16:05.379149+00:00, run_duration=5.038833, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:15:00+00:00, data_interval_end=2024-06-27 04:16:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:16:05.388501908Z [2024-06-27T04:16:05.388+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:16:00+00:00, run_after=2024-06-27T04:17:00+00:00 2024-06-27T04:16:05.399000676Z [2024-06-27T04:16:05.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:16:05.402384174Z [2024-06-27T04:16:05.401+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:15:00+00:00, run_id=scheduled__2024-06-27T04:15:00+00:00, run_start_date=2024-06-27 04:16:00.341731+00:00, run_end_date=2024-06-27 04:16:05.401170+00:00, run_duration=5.059439, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:15:00+00:00, data_interval_end=2024-06-27 04:16:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:16:05.422323892Z [2024-06-27T04:16:05.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:16:00+00:00, run_after=2024-06-27T04:17:00+00:00 2024-06-27T04:16:05.473498454Z [2024-06-27T04:16:05.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status success for try_number 1 2024-06-27T04:16:05.473545713Z [2024-06-27T04:16:05.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status success for try_number 1 2024-06-27T04:16:05.481338649Z [2024-06-27T04:16:05.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:15:00+00:00, map_index=-1, run_start_date=2024-06-27 04:16:03.191401+00:00, run_end_date=2024-06-27 04:16:04.565956+00:00, run_duration=1.374555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:16:00.427660+00:00, queued_by_job_id=2, pid=6769 2024-06-27T04:16:05.482329681Z [2024-06-27T04:16:05.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:15:00+00:00, map_index=-1, run_start_date=2024-06-27 04:16:03.139750+00:00, run_end_date=2024-06-27 04:16:04.865200+00:00, run_duration=1.72545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:16:00.427660+00:00, queued_by_job_id=2, pid=6768 2024-06-27T04:17:00.232629528Z [2024-06-27T04:17:00.227+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:17:00.258524278Z [2024-06-27T04:17:00.249+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:17:00+00:00, run_after=2024-06-27T04:18:00+00:00 2024-06-27T04:17:00.280902490Z [2024-06-27T04:17:00.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:17:00+00:00, run_after=2024-06-27T04:18:00+00:00 2024-06-27T04:17:00.339855641Z [2024-06-27T04:17:00.339+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:17:00.339894321Z 2024-06-27T04:17:00.339897863Z 2024-06-27T04:17:00.339900999Z 2024-06-27T04:17:00.340330347Z [2024-06-27T04:17:00.339+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:17:00.340984889Z [2024-06-27T04:17:00.340+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:17:00.341371734Z [2024-06-27T04:17:00.341+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:17:00.343383778Z [2024-06-27T04:17:00.342+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:17:00.343392043Z 2024-06-27T04:17:00.343395316Z 2024-06-27T04:17:00.343398091Z 2024-06-27T04:17:00.349725040Z [2024-06-27T04:17:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:17:00.350019262Z [2024-06-27T04:17:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:17:00.350461785Z [2024-06-27T04:17:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:17:00.350704835Z [2024-06-27T04:17:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:17:00.351084736Z [2024-06-27T04:17:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:17:00.351343863Z [2024-06-27T04:17:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:17:00.559887234Z [2024-06-27T04:17:00.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:16:00+00:00 exited with status queued for try_number 1 2024-06-27T04:17:00.560028648Z [2024-06-27T04:17:00.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:16:00+00:00 exited with status queued for try_number 1 2024-06-27T04:17:00.560177216Z [2024-06-27T04:17:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:16:00+00:00 exited with status queued for try_number 1 2024-06-27T04:17:00.567890739Z [2024-06-27T04:17:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80564acd-4bfa-406d-b521-77d1bb4e9b44 2024-06-27T04:17:00.568082590Z [2024-06-27T04:17:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65afa0e2-2530-483f-ad48-fda9945fa8a5 2024-06-27T04:17:00.568248405Z [2024-06-27T04:17:00.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30e01b5d-3f4f-46e1-8b49-15ed8df116f2 2024-06-27T04:17:01.725284530Z [2024-06-27T04:17:01.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:17:01.725709001Z [2024-06-27T04:17:01.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:16:00+00:00, run_id=scheduled__2024-06-27T04:16:00+00:00, run_start_date=2024-06-27 04:17:00.291219+00:00, run_end_date=2024-06-27 04:17:01.725342+00:00, run_duration=1.434123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:16:00+00:00, data_interval_end=2024-06-27 04:17:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:17:01.735432209Z [2024-06-27T04:17:01.735+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:17:00+00:00, run_after=2024-06-27T04:18:00+00:00 2024-06-27T04:17:01.785786958Z [2024-06-27T04:17:01.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:16:00+00:00 exited with status success for try_number 1 2024-06-27T04:17:01.793416722Z [2024-06-27T04:17:01.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:16:00+00:00, map_index=-1, run_start_date=2024-06-27 04:17:01.177321+00:00, run_end_date=2024-06-27 04:17:01.568058+00:00, run_duration=0.390737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:17:00.345171+00:00, queued_by_job_id=2, pid=6813 2024-06-27T04:17:04.015076655Z [2024-06-27T04:17:04.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:17:04.015417661Z [2024-06-27T04:17:04.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:16:00+00:00, run_id=scheduled__2024-06-27T04:16:00+00:00, run_start_date=2024-06-27 04:17:00.293503+00:00, run_end_date=2024-06-27 04:17:04.015005+00:00, run_duration=3.721502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:16:00+00:00, data_interval_end=2024-06-27 04:17:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:17:04.025019021Z [2024-06-27T04:17:04.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:17:00+00:00, run_after=2024-06-27T04:18:00+00:00 2024-06-27T04:17:04.032477670Z [2024-06-27T04:17:04.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:17:04.032995657Z [2024-06-27T04:17:04.032+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:16:00+00:00, run_id=scheduled__2024-06-27T04:16:00+00:00, run_start_date=2024-06-27 04:17:00.292467+00:00, run_end_date=2024-06-27 04:17:04.032604+00:00, run_duration=3.740137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:16:00+00:00, data_interval_end=2024-06-27 04:17:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:17:04.043020156Z [2024-06-27T04:17:04.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:17:00+00:00, run_after=2024-06-27T04:18:00+00:00 2024-06-27T04:17:04.086391292Z [2024-06-27T04:17:04.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:16:00+00:00 exited with status success for try_number 1 2024-06-27T04:17:04.086519089Z [2024-06-27T04:17:04.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:16:00+00:00 exited with status success for try_number 1 2024-06-27T04:17:04.094451591Z [2024-06-27T04:17:04.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:16:00+00:00, map_index=-1, run_start_date=2024-06-27 04:17:02.224216+00:00, run_end_date=2024-06-27 04:17:03.847296+00:00, run_duration=1.62308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:17:00.345171+00:00, queued_by_job_id=2, pid=6843 2024-06-27T04:17:04.094504728Z [2024-06-27T04:17:04.094+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:16:00+00:00, map_index=-1, run_start_date=2024-06-27 04:17:02.401058+00:00, run_end_date=2024-06-27 04:17:03.725985+00:00, run_duration=1.324927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:17:00.345171+00:00, queued_by_job_id=2, pid=6844 2024-06-27T04:18:00.215553696Z [2024-06-27T04:18:00.214+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:18:00.235889138Z [2024-06-27T04:18:00.235+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:18:00+00:00, run_after=2024-06-27T04:19:00+00:00 2024-06-27T04:18:00.255285909Z [2024-06-27T04:18:00.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:18:00+00:00, run_after=2024-06-27T04:19:00+00:00 2024-06-27T04:18:00.269331236Z [2024-06-27T04:18:00.268+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:18:00.350961474Z [2024-06-27T04:18:00.350+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:18:00.351011496Z 2024-06-27T04:18:00.351023511Z 2024-06-27T04:18:00.351032395Z 2024-06-27T04:18:00.351040906Z 2024-06-27T04:18:00.351119235Z [2024-06-27T04:18:00.350+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:18:00.351257560Z [2024-06-27T04:18:00.351+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:18:00.351428539Z [2024-06-27T04:18:00.351+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:18:00.351526100Z [2024-06-27T04:18:00.351+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:18:00.352117766Z [2024-06-27T04:18:00.351+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:18:00.352133862Z 2024-06-27T04:18:00.352140391Z 2024-06-27T04:18:00.352146348Z 2024-06-27T04:18:00.352152499Z 2024-06-27T04:18:00.357933699Z [2024-06-27T04:18:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:18:00.358134801Z [2024-06-27T04:18:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:18:00.358392159Z [2024-06-27T04:18:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:18:00.358589950Z [2024-06-27T04:18:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:18:00.358898848Z [2024-06-27T04:18:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:18:00.359090394Z [2024-06-27T04:18:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:18:00.359418063Z [2024-06-27T04:18:00.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:18:00.359578069Z [2024-06-27T04:18:00.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:18:00.739113386Z [2024-06-27T04:18:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:16:00+00:00 exited with status queued for try_number 1 2024-06-27T04:18:00.740345504Z [2024-06-27T04:18:00.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:17:00+00:00 exited with status queued for try_number 1 2024-06-27T04:18:00.740636371Z [2024-06-27T04:18:00.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:17:00+00:00 exited with status queued for try_number 1 2024-06-27T04:18:00.740897800Z [2024-06-27T04:18:00.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:17:00+00:00 exited with status queued for try_number 1 2024-06-27T04:18:00.774752239Z [2024-06-27T04:18:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 897f6297-6154-4b26-91ca-396f84713e53 2024-06-27T04:18:00.774769442Z [2024-06-27T04:18:00.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b1ce845-5282-4b22-ba0a-87072ae13715 2024-06-27T04:18:00.774773502Z [2024-06-27T04:18:00.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0f34d05-2e67-4886-9246-ad6303170253 2024-06-27T04:18:00.774776886Z [2024-06-27T04:18:00.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bedc76f-547e-44d6-9ace-049fb375de3e 2024-06-27T04:18:02.672163174Z [2024-06-27T04:18:02.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:18:02.672842723Z [2024-06-27T04:18:02.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:16:00+00:00, run_id=scheduled__2024-06-27T04:16:00+00:00, run_start_date=2024-06-27 04:18:00.283253+00:00, run_end_date=2024-06-27 04:18:02.672081+00:00, run_duration=2.388828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:16:00+00:00, data_interval_end=2024-06-27 04:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:18:02.683946975Z [2024-06-27T04:18:02.683+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:18:00+00:00, run_after=2024-06-27T04:20:00+00:00 2024-06-27T04:18:02.695801431Z [2024-06-27T04:18:02.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:18:02.696362765Z [2024-06-27T04:18:02.696+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:17:00+00:00, run_id=scheduled__2024-06-27T04:17:00+00:00, run_start_date=2024-06-27 04:18:00.284705+00:00, run_end_date=2024-06-27 04:18:02.695720+00:00, run_duration=2.411015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:17:00+00:00, data_interval_end=2024-06-27 04:18:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:18:02.706892975Z [2024-06-27T04:18:02.706+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:18:00+00:00, run_after=2024-06-27T04:19:00+00:00 2024-06-27T04:18:02.805099861Z [2024-06-27T04:18:02.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:16:00+00:00 exited with status success for try_number 1 2024-06-27T04:18:02.805336601Z [2024-06-27T04:18:02.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:17:00+00:00 exited with status success for try_number 1 2024-06-27T04:18:02.815151511Z [2024-06-27T04:18:02.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:16:00+00:00, map_index=-1, run_start_date=2024-06-27 04:18:01.514503+00:00, run_end_date=2024-06-27 04:18:01.973641+00:00, run_duration=0.459138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:18:00.352874+00:00, queued_by_job_id=2, pid=6889 2024-06-27T04:18:02.815515030Z [2024-06-27T04:18:02.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:17:00+00:00, map_index=-1, run_start_date=2024-06-27 04:18:01.633148+00:00, run_end_date=2024-06-27 04:18:01.972671+00:00, run_duration=0.339523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:18:00.352874+00:00, queued_by_job_id=2, pid=6890 2024-06-27T04:18:04.977228552Z [2024-06-27T04:18:04.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:18:04.979139168Z [2024-06-27T04:18:04.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:17:00+00:00, run_id=scheduled__2024-06-27T04:17:00+00:00, run_start_date=2024-06-27 04:18:00.286872+00:00, run_end_date=2024-06-27 04:18:04.978575+00:00, run_duration=4.691703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:17:00+00:00, data_interval_end=2024-06-27 04:18:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:18:04.993937348Z [2024-06-27T04:18:04.993+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:18:00+00:00, run_after=2024-06-27T04:19:00+00:00 2024-06-27T04:18:05.004416541Z [2024-06-27T04:18:05.003+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:18:05.004790334Z [2024-06-27T04:18:05.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:17:00+00:00, run_id=scheduled__2024-06-27T04:17:00+00:00, run_start_date=2024-06-27 04:18:00.285857+00:00, run_end_date=2024-06-27 04:18:05.004339+00:00, run_duration=4.718482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:17:00+00:00, data_interval_end=2024-06-27 04:18:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:18:05.016053947Z [2024-06-27T04:18:05.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:18:00+00:00, run_after=2024-06-27T04:19:00+00:00 2024-06-27T04:18:05.063175235Z [2024-06-27T04:18:05.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:17:00+00:00 exited with status success for try_number 1 2024-06-27T04:18:05.068418685Z [2024-06-27T04:18:05.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:17:00+00:00, map_index=-1, run_start_date=2024-06-27 04:18:02.655176+00:00, run_end_date=2024-06-27 04:18:04.384559+00:00, run_duration=1.729383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:18:00.352874+00:00, queued_by_job_id=2, pid=6929 2024-06-27T04:18:06.163531872Z [2024-06-27T04:18:06.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:17:00+00:00 exited with status success for try_number 1 2024-06-27T04:18:06.171684549Z [2024-06-27T04:18:06.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:17:00+00:00, map_index=-1, run_start_date=2024-06-27 04:18:02.950520+00:00, run_end_date=2024-06-27 04:18:04.916585+00:00, run_duration=1.966065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:18:00.352874+00:00, queued_by_job_id=2, pid=6930 2024-06-27T04:19:00.665213171Z [2024-06-27T04:19:00.664+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:19:00.677659334Z [2024-06-27T04:19:00.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:19:00+00:00, run_after=2024-06-27T04:20:00+00:00 2024-06-27T04:19:00.688565409Z [2024-06-27T04:19:00.688+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:19:00+00:00, run_after=2024-06-27T04:20:00+00:00 2024-06-27T04:19:00.774036216Z [2024-06-27T04:19:00.773+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:19:00.774068393Z 2024-06-27T04:19:00.774075170Z 2024-06-27T04:19:00.774081281Z 2024-06-27T04:19:00.774174456Z [2024-06-27T04:19:00.773+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:19:00.774349637Z [2024-06-27T04:19:00.774+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:19:00.774500860Z [2024-06-27T04:19:00.774+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:19:00.775188512Z [2024-06-27T04:19:00.774+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:19:00.775200187Z 2024-06-27T04:19:00.775206179Z 2024-06-27T04:19:00.775227751Z 2024-06-27T04:19:00.779922504Z [2024-06-27T04:19:00.779+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:19:00.780159039Z [2024-06-27T04:19:00.779+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:19:00.780504533Z [2024-06-27T04:19:00.780+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:19:00.780674402Z [2024-06-27T04:19:00.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:19:00.780977755Z [2024-06-27T04:19:00.780+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:19:00.781140127Z [2024-06-27T04:19:00.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:19:01.016838961Z [2024-06-27T04:19:01.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:18:00+00:00 exited with status queued for try_number 1 2024-06-27T04:19:01.016871894Z [2024-06-27T04:19:01.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:18:00+00:00 exited with status queued for try_number 1 2024-06-27T04:19:01.017011368Z [2024-06-27T04:19:01.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:18:00+00:00 exited with status queued for try_number 1 2024-06-27T04:19:01.024597466Z [2024-06-27T04:19:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to ded9aced-3b8d-404a-9513-b1d1d418a562 2024-06-27T04:19:01.024663925Z [2024-06-27T04:19:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9296b49a-d2ae-435a-9d02-0190c5bcbac2 2024-06-27T04:19:01.024864627Z [2024-06-27T04:19:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a7f374e-4ca9-4662-baf8-7284d04d0e17 2024-06-27T04:19:02.235992558Z [2024-06-27T04:19:02.235+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:19:02.237048205Z [2024-06-27T04:19:02.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:18:00+00:00, run_id=scheduled__2024-06-27T04:18:00+00:00, run_start_date=2024-06-27 04:19:00.703507+00:00, run_end_date=2024-06-27 04:19:02.236202+00:00, run_duration=1.532695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:18:00+00:00, data_interval_end=2024-06-27 04:19:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:19:02.259289668Z [2024-06-27T04:19:02.258+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:19:00+00:00, run_after=2024-06-27T04:20:00+00:00 2024-06-27T04:19:02.302184829Z [2024-06-27T04:19:02.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:18:00+00:00 exited with status success for try_number 1 2024-06-27T04:19:02.311481423Z [2024-06-27T04:19:02.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:18:00+00:00, map_index=-1, run_start_date=2024-06-27 04:19:01.615839+00:00, run_end_date=2024-06-27 04:19:01.975100+00:00, run_duration=0.359261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:19:00.776012+00:00, queued_by_job_id=2, pid=6974 2024-06-27T04:19:04.831120299Z [2024-06-27T04:19:04.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:19:04.831514710Z [2024-06-27T04:19:04.831+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:18:00+00:00, run_id=scheduled__2024-06-27T04:18:00+00:00, run_start_date=2024-06-27 04:19:00.704839+00:00, run_end_date=2024-06-27 04:19:04.831152+00:00, run_duration=4.126313, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:18:00+00:00, data_interval_end=2024-06-27 04:19:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:19:04.840946354Z [2024-06-27T04:19:04.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:19:00+00:00, run_after=2024-06-27T04:20:00+00:00 2024-06-27T04:19:04.889122860Z [2024-06-27T04:19:04.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:18:00+00:00 exited with status success for try_number 1 2024-06-27T04:19:04.894855381Z [2024-06-27T04:19:04.894+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:18:00+00:00, map_index=-1, run_start_date=2024-06-27 04:19:02.769306+00:00, run_end_date=2024-06-27 04:19:04.684528+00:00, run_duration=1.915222, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:19:00.776012+00:00, queued_by_job_id=2, pid=7005 2024-06-27T04:19:05.945408539Z [2024-06-27T04:19:05.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:19:05.945848932Z [2024-06-27T04:19:05.945+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:18:00+00:00, run_id=scheduled__2024-06-27T04:18:00+00:00, run_start_date=2024-06-27 04:19:00.705895+00:00, run_end_date=2024-06-27 04:19:05.945510+00:00, run_duration=5.239615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:18:00+00:00, data_interval_end=2024-06-27 04:19:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:19:05.955010055Z [2024-06-27T04:19:05.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:19:00+00:00, run_after=2024-06-27T04:20:00+00:00 2024-06-27T04:19:05.998557544Z [2024-06-27T04:19:05.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:18:00+00:00 exited with status success for try_number 1 2024-06-27T04:19:06.010275426Z [2024-06-27T04:19:06.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:18:00+00:00, map_index=-1, run_start_date=2024-06-27 04:19:02.685009+00:00, run_end_date=2024-06-27 04:19:05.116378+00:00, run_duration=2.431369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:19:00.776012+00:00, queued_by_job_id=2, pid=7004 2024-06-27T04:20:00.073345587Z [2024-06-27T04:20:00.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:20:00+00:00, run_after=2024-06-27T04:21:00+00:00 2024-06-27T04:20:00.082193206Z [2024-06-27T04:20:00.081+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:20:00.094703188Z [2024-06-27T04:20:00.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:20:00+00:00, run_after=2024-06-27T04:25:00+00:00 2024-06-27T04:20:00.107709221Z [2024-06-27T04:20:00.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:20:00+00:00, run_after=2024-06-27T04:21:00+00:00 2024-06-27T04:20:00.120079835Z [2024-06-27T04:20:00.119+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:20:00.243910960Z [2024-06-27T04:20:00.243+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T04:20:00.243949015Z 2024-06-27T04:20:00.243952822Z 2024-06-27T04:20:00.243957014Z 2024-06-27T04:20:00.243960037Z 2024-06-27T04:20:00.243963284Z 2024-06-27T04:20:00.244269448Z [2024-06-27T04:20:00.244+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:20:00.244554492Z [2024-06-27T04:20:00.244+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:20:00.244832049Z [2024-06-27T04:20:00.244+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:20:00.245079088Z [2024-06-27T04:20:00.244+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:20:00.245334542Z [2024-06-27T04:20:00.245+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:20:00.246163006Z [2024-06-27T04:20:00.245+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:20:00.246174121Z 2024-06-27T04:20:00.246178369Z 2024-06-27T04:20:00.246181690Z 2024-06-27T04:20:00.246198941Z 2024-06-27T04:20:00.246202077Z 2024-06-27T04:20:00.250267082Z [2024-06-27T04:20:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:20:00.250698549Z [2024-06-27T04:20:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:20:00.251116013Z [2024-06-27T04:20:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:20:00.251362009Z [2024-06-27T04:20:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:20:00.251688401Z [2024-06-27T04:20:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:20:00.251925948Z [2024-06-27T04:20:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:20:00.252243510Z [2024-06-27T04:20:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:20:00.252481258Z [2024-06-27T04:20:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:20:00.252875427Z [2024-06-27T04:20:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:20:00.253101745Z [2024-06-27T04:20:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:20:00.727255132Z [2024-06-27T04:20:00.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status queued for try_number 1 2024-06-27T04:20:00.727604588Z [2024-06-27T04:20:00.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:18:00+00:00 exited with status queued for try_number 1 2024-06-27T04:20:00.727763208Z [2024-06-27T04:20:00.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:19:00+00:00 exited with status queued for try_number 1 2024-06-27T04:20:00.727853254Z [2024-06-27T04:20:00.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:19:00+00:00 exited with status queued for try_number 1 2024-06-27T04:20:00.727908477Z [2024-06-27T04:20:00.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:19:00+00:00 exited with status queued for try_number 1 2024-06-27T04:20:00.750489864Z [2024-06-27T04:20:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to d630ed8c-3f10-4abb-86aa-dd260bd8cd43 2024-06-27T04:20:00.750615809Z [2024-06-27T04:20:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c4ef8c0-2256-4507-a163-7dfdc80bdc6c 2024-06-27T04:20:00.750836823Z [2024-06-27T04:20:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to 438ba811-8070-426e-90c2-5e4bf6e5bff1 2024-06-27T04:20:00.751047360Z [2024-06-27T04:20:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02d04b31-a91b-4708-bfd6-556b4b364fa1 2024-06-27T04:20:00.751229298Z [2024-06-27T04:20:00.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1859aca-8a97-4ce2-99c0-77069d6e74b7 2024-06-27T04:20:02.065287850Z [2024-06-27T04:20:02.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:20:02.067641893Z [2024-06-27T04:20:02.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:18:00+00:00, run_id=scheduled__2024-06-27T04:18:00+00:00, run_start_date=2024-06-27 04:20:00.135281+00:00, run_end_date=2024-06-27 04:20:02.065219+00:00, run_duration=1.929938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:18:00+00:00, data_interval_end=2024-06-27 04:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:20:02.086381005Z [2024-06-27T04:20:02.086+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:20:00+00:00, run_after=2024-06-27T04:22:00+00:00 2024-06-27T04:20:02.107885446Z [2024-06-27T04:20:02.107+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:20:02.108124424Z [2024-06-27T04:20:02.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:19:00+00:00, run_id=scheduled__2024-06-27T04:19:00+00:00, run_start_date=2024-06-27 04:20:00.136625+00:00, run_end_date=2024-06-27 04:20:02.107767+00:00, run_duration=1.971142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:19:00+00:00, data_interval_end=2024-06-27 04:20:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:20:02.119202647Z [2024-06-27T04:20:02.118+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:20:00+00:00, run_after=2024-06-27T04:21:00+00:00 2024-06-27T04:20:02.149816433Z [2024-06-27T04:20:02.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:18:00+00:00 exited with status success for try_number 1 2024-06-27T04:20:02.149852949Z [2024-06-27T04:20:02.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:19:00+00:00 exited with status success for try_number 1 2024-06-27T04:20:02.156282465Z [2024-06-27T04:20:02.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:19:00+00:00, map_index=-1, run_start_date=2024-06-27 04:20:01.355770+00:00, run_end_date=2024-06-27 04:20:01.823543+00:00, run_duration=0.467773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:20:00.247396+00:00, queued_by_job_id=2, pid=7051 2024-06-27T04:20:02.156359055Z [2024-06-27T04:20:02.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:18:00+00:00, map_index=-1, run_start_date=2024-06-27 04:20:01.481511+00:00, run_end_date=2024-06-27 04:20:01.892991+00:00, run_duration=0.41148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:20:00.247396+00:00, queued_by_job_id=2, pid=7052 2024-06-27T04:20:03.260213864Z [2024-06-27T04:20:03.259+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:20:03.260246806Z 2024-06-27T04:20:03.260315804Z [2024-06-27T04:20:03.260+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:20:03.260991316Z [2024-06-27T04:20:03.260+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:20:03.261003989Z 2024-06-27T04:20:03.263856291Z [2024-06-27T04:20:03.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:20:03.264080058Z [2024-06-27T04:20:03.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:20:03.332940315Z [2024-06-27T04:20:03.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status queued for try_number 1 2024-06-27T04:20:03.341079844Z [2024-06-27T04:20:03.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fe04fbb-7f45-4384-aecc-ed676456ee83 2024-06-27T04:20:03.461983700Z [2024-06-27T04:20:03.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status success for try_number 1 2024-06-27T04:20:03.467354964Z [2024-06-27T04:20:03.467+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:15:00+00:00, map_index=-1, run_start_date=2024-06-27 04:20:02.636469+00:00, run_end_date=2024-06-27 04:20:03.146822+00:00, run_duration=0.510353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:20:00.247396+00:00, queued_by_job_id=2, pid=7100 2024-06-27T04:20:04.710848729Z [2024-06-27T04:20:04.710+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:20:04.711350589Z [2024-06-27T04:20:04.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:19:00+00:00, run_id=scheduled__2024-06-27T04:19:00+00:00, run_start_date=2024-06-27 04:20:00.137702+00:00, run_end_date=2024-06-27 04:20:04.710951+00:00, run_duration=4.573249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:19:00+00:00, data_interval_end=2024-06-27 04:20:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:20:04.723154461Z [2024-06-27T04:20:04.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:20:00+00:00, run_after=2024-06-27T04:21:00+00:00 2024-06-27T04:20:04.792996560Z [2024-06-27T04:20:04.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:19:00+00:00 exited with status success for try_number 1 2024-06-27T04:20:04.798614333Z [2024-06-27T04:20:04.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:19:00+00:00, map_index=-1, run_start_date=2024-06-27 04:20:02.739643+00:00, run_end_date=2024-06-27 04:20:04.249572+00:00, run_duration=1.509929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:20:00.247396+00:00, queued_by_job_id=2, pid=7101 2024-06-27T04:20:05.604250223Z [2024-06-27T04:20:05.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:20:05.604582548Z [2024-06-27T04:20:05.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:19:00+00:00, run_id=scheduled__2024-06-27T04:19:00+00:00, run_start_date=2024-06-27 04:20:00.138814+00:00, run_end_date=2024-06-27 04:20:05.604191+00:00, run_duration=5.465377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:19:00+00:00, data_interval_end=2024-06-27 04:20:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:20:05.613014340Z [2024-06-27T04:20:05.612+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:20:00+00:00, run_after=2024-06-27T04:21:00+00:00 2024-06-27T04:20:05.630672781Z [2024-06-27T04:20:05.630+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:20:05.630749384Z 2024-06-27T04:20:05.630886334Z [2024-06-27T04:20:05.630+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:20:05.631533223Z [2024-06-27T04:20:05.631+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:20:05.631546822Z 2024-06-27T04:20:05.633865286Z [2024-06-27T04:20:05.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:20:05.634072628Z [2024-06-27T04:20:05.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:20:05.715341631Z [2024-06-27T04:20:05.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status queued for try_number 1 2024-06-27T04:20:05.715414780Z [2024-06-27T04:20:05.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:19:00+00:00 exited with status success for try_number 1 2024-06-27T04:20:05.715464003Z [2024-06-27T04:20:05.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status success for try_number 1 2024-06-27T04:20:05.722914298Z [2024-06-27T04:20:05.722+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:19:00+00:00, map_index=-1, run_start_date=2024-06-27 04:20:02.930290+00:00, run_end_date=2024-06-27 04:20:04.769279+00:00, run_duration=1.838989, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:20:00.247396+00:00, queued_by_job_id=2, pid=7102 2024-06-27T04:20:05.722998633Z [2024-06-27T04:20:05.722+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T04:15:00+00:00, map_index=-1, run_start_date=2024-06-27 04:20:05.060493+00:00, run_end_date=2024-06-27 04:20:05.434729+00:00, run_duration=0.374236, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:20:03.261989+00:00, queued_by_job_id=2, pid=7141 2024-06-27T04:20:05.723068695Z [2024-06-27T04:20:05.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17f18aff-91d9-4e10-9a60-1fafa90212c6 2024-06-27T04:20:05.736899407Z [2024-06-27T04:20:05.736+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T04:20:08.030472623Z [2024-06-27T04:20:08.030+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:20:08.030514661Z 2024-06-27T04:20:08.030601925Z [2024-06-27T04:20:08.030+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:20:08.031093805Z [2024-06-27T04:20:08.030+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:20:08.031107322Z 2024-06-27T04:20:08.034031705Z [2024-06-27T04:20:08.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:20:08.034115876Z [2024-06-27T04:20:08.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:20:08.120909453Z [2024-06-27T04:20:08.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status queued for try_number 1 2024-06-27T04:20:08.120949436Z [2024-06-27T04:20:08.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status success for try_number 1 2024-06-27T04:20:08.131167129Z [2024-06-27T04:20:08.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to a07452f1-3b7c-4f1d-936c-fe8c7d23b244 2024-06-27T04:20:08.131207483Z [2024-06-27T04:20:08.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:15:00+00:00, map_index=0, run_start_date=2024-06-27 04:20:07.371207+00:00, run_end_date=2024-06-27 04:20:07.738018+00:00, run_duration=0.366811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:20:05.631924+00:00, queued_by_job_id=2, pid=7153 2024-06-27T04:20:10.502358688Z [2024-06-27T04:20:10.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:20:10.502992538Z [2024-06-27T04:20:10.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:15:00+00:00, run_id=scheduled__2024-06-27T04:15:00+00:00, run_start_date=2024-06-27 04:20:00.133362+00:00, run_end_date=2024-06-27 04:20:10.502474+00:00, run_duration=10.369112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:15:00+00:00, data_interval_end=2024-06-27 04:20:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T04:20:10.513963760Z [2024-06-27T04:20:10.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:20:00+00:00, run_after=2024-06-27T04:25:00+00:00 2024-06-27T04:20:10.559787633Z [2024-06-27T04:20:10.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:15:00+00:00 exited with status success for try_number 1 2024-06-27T04:20:10.576079702Z [2024-06-27T04:20:10.575+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:15:00+00:00, map_index=-1, run_start_date=2024-06-27 04:20:09.801621+00:00, run_end_date=2024-06-27 04:20:10.148683+00:00, run_duration=0.347062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:20:08.031428+00:00, queued_by_job_id=2, pid=7165 2024-06-27T04:21:00.642122345Z [2024-06-27T04:21:00.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:21:00+00:00, run_after=2024-06-27T04:22:00+00:00 2024-06-27T04:21:00.653842115Z [2024-06-27T04:21:00.653+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:21:00.669740903Z [2024-06-27T04:21:00.669+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:21:00+00:00, run_after=2024-06-27T04:22:00+00:00 2024-06-27T04:21:00.765080346Z [2024-06-27T04:21:00.764+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:21:00.765109631Z 2024-06-27T04:21:00.765115081Z 2024-06-27T04:21:00.765120292Z 2024-06-27T04:21:00.765320169Z [2024-06-27T04:21:00.765+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:21:00.765581712Z [2024-06-27T04:21:00.765+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:21:00.765711273Z [2024-06-27T04:21:00.765+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:21:00.766351172Z [2024-06-27T04:21:00.766+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:21:00.766364210Z 2024-06-27T04:21:00.766368982Z 2024-06-27T04:21:00.766373626Z 2024-06-27T04:21:00.774179184Z [2024-06-27T04:21:00.773+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:21:00.774356099Z [2024-06-27T04:21:00.774+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:21:00.774655747Z [2024-06-27T04:21:00.774+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:21:00.774802835Z [2024-06-27T04:21:00.774+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:21:00.775069443Z [2024-06-27T04:21:00.774+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:21:00.775202427Z [2024-06-27T04:21:00.775+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:21:01.077971419Z [2024-06-27T04:21:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status queued for try_number 1 2024-06-27T04:21:01.078004255Z [2024-06-27T04:21:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status queued for try_number 1 2024-06-27T04:21:01.078053064Z [2024-06-27T04:21:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status queued for try_number 1 2024-06-27T04:21:01.086993271Z [2024-06-27T04:21:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e7bf34a-e11f-4ad0-b7b6-806db60688c8 2024-06-27T04:21:01.087081098Z [2024-06-27T04:21:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5f91930-2e4c-40f3-8a2e-6e41cef562b2 2024-06-27T04:21:01.087129094Z [2024-06-27T04:21:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to 232acf9f-5155-40f6-be38-854fa980ec14 2024-06-27T04:21:02.303574695Z [2024-06-27T04:21:02.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:21:02.303938906Z [2024-06-27T04:21:02.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:20:00+00:00, run_id=scheduled__2024-06-27T04:20:00+00:00, run_start_date=2024-06-27 04:21:00.682722+00:00, run_end_date=2024-06-27 04:21:02.303569+00:00, run_duration=1.620847, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:20:00+00:00, data_interval_end=2024-06-27 04:21:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:21:02.330118324Z [2024-06-27T04:21:02.329+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:21:00+00:00, run_after=2024-06-27T04:22:00+00:00 2024-06-27T04:21:02.365519332Z [2024-06-27T04:21:02.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status success for try_number 1 2024-06-27T04:21:02.372835440Z [2024-06-27T04:21:02.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:20:00+00:00, map_index=-1, run_start_date=2024-06-27 04:21:01.726751+00:00, run_end_date=2024-06-27 04:21:02.137644+00:00, run_duration=0.410893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:21:00.767107+00:00, queued_by_job_id=2, pid=7191 2024-06-27T04:21:04.541759182Z [2024-06-27T04:21:04.541+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:21:04.542426015Z [2024-06-27T04:21:04.542+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:20:00+00:00, run_id=scheduled__2024-06-27T04:20:00+00:00, run_start_date=2024-06-27 04:21:00.684425+00:00, run_end_date=2024-06-27 04:21:04.541849+00:00, run_duration=3.857424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:20:00+00:00, data_interval_end=2024-06-27 04:21:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:21:04.557885020Z [2024-06-27T04:21:04.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:21:00+00:00, run_after=2024-06-27T04:22:00+00:00 2024-06-27T04:21:05.657571939Z [2024-06-27T04:21:05.656+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:21:05.658198681Z [2024-06-27T04:21:05.657+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:20:00+00:00, run_id=scheduled__2024-06-27T04:20:00+00:00, run_start_date=2024-06-27 04:21:00.686178+00:00, run_end_date=2024-06-27 04:21:05.657733+00:00, run_duration=4.971555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:20:00+00:00, data_interval_end=2024-06-27 04:21:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:21:05.669983784Z [2024-06-27T04:21:05.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:21:00+00:00, run_after=2024-06-27T04:22:00+00:00 2024-06-27T04:21:05.717262940Z [2024-06-27T04:21:05.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status success for try_number 1 2024-06-27T04:21:05.717874070Z [2024-06-27T04:21:05.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status success for try_number 1 2024-06-27T04:21:05.728801815Z [2024-06-27T04:21:05.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:20:00+00:00, map_index=-1, run_start_date=2024-06-27 04:21:02.680495+00:00, run_end_date=2024-06-27 04:21:04.463935+00:00, run_duration=1.78344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:21:00.767107+00:00, queued_by_job_id=2, pid=7221 2024-06-27T04:21:05.729474915Z [2024-06-27T04:21:05.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:20:00+00:00, map_index=-1, run_start_date=2024-06-27 04:21:02.734574+00:00, run_end_date=2024-06-27 04:21:05.338567+00:00, run_duration=2.603993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:21:00.767107+00:00, queued_by_job_id=2, pid=7222 2024-06-27T04:22:00.300169795Z [2024-06-27T04:22:00.299+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:22:00.315725192Z [2024-06-27T04:22:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:22:00+00:00, run_after=2024-06-27T04:23:00+00:00 2024-06-27T04:22:00.331708268Z [2024-06-27T04:22:00.331+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:22:00+00:00, run_after=2024-06-27T04:23:00+00:00 2024-06-27T04:22:00.338402837Z [2024-06-27T04:22:00.338+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:22:00.408601058Z [2024-06-27T04:22:00.408+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:22:00.408625132Z 2024-06-27T04:22:00.408629696Z 2024-06-27T04:22:00.408633098Z 2024-06-27T04:22:00.408636503Z 2024-06-27T04:22:00.408687733Z [2024-06-27T04:22:00.408+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:22:00.408875062Z [2024-06-27T04:22:00.408+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:22:00.408985048Z [2024-06-27T04:22:00.408+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:22:00.409106457Z [2024-06-27T04:22:00.408+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:22:00.409675011Z [2024-06-27T04:22:00.409+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:22:00.409684947Z 2024-06-27T04:22:00.409689602Z 2024-06-27T04:22:00.409693730Z 2024-06-27T04:22:00.409698234Z 2024-06-27T04:22:00.412774772Z [2024-06-27T04:22:00.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:22:00.412839826Z [2024-06-27T04:22:00.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:22:00.413220313Z [2024-06-27T04:22:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:22:00.413357129Z [2024-06-27T04:22:00.413+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:22:00.413610364Z [2024-06-27T04:22:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:22:00.413737401Z [2024-06-27T04:22:00.413+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:22:00.413950351Z [2024-06-27T04:22:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:22:00.414079655Z [2024-06-27T04:22:00.413+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:22:00.723410997Z [2024-06-27T04:22:00.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status queued for try_number 1 2024-06-27T04:22:00.723686493Z [2024-06-27T04:22:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:21:00+00:00 exited with status queued for try_number 1 2024-06-27T04:22:00.723880060Z [2024-06-27T04:22:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:21:00+00:00 exited with status queued for try_number 1 2024-06-27T04:22:00.724062586Z [2024-06-27T04:22:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:21:00+00:00 exited with status queued for try_number 1 2024-06-27T04:22:00.733670936Z [2024-06-27T04:22:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6db792e8-9ba9-4c40-8f14-488bdf8f8679 2024-06-27T04:22:00.733946354Z [2024-06-27T04:22:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 016d7551-6ec1-45a6-8c44-0e2e26996904 2024-06-27T04:22:00.734161320Z [2024-06-27T04:22:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5848880-86e4-4421-a4b2-874acfe85365 2024-06-27T04:22:00.734510578Z [2024-06-27T04:22:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fa0855b-e83c-4b85-963d-82e47d27b367 2024-06-27T04:22:02.833645267Z [2024-06-27T04:22:02.833+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:22:02.834111104Z [2024-06-27T04:22:02.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:20:00+00:00, run_id=scheduled__2024-06-27T04:20:00+00:00, run_start_date=2024-06-27 04:22:00.350479+00:00, run_end_date=2024-06-27 04:22:02.833572+00:00, run_duration=2.483093, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:20:00+00:00, data_interval_end=2024-06-27 04:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:22:02.842951336Z [2024-06-27T04:22:02.842+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:22:00+00:00, run_after=2024-06-27T04:24:00+00:00 2024-06-27T04:22:02.855464264Z [2024-06-27T04:22:02.855+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:22:02.856049593Z [2024-06-27T04:22:02.855+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:21:00+00:00, run_id=scheduled__2024-06-27T04:21:00+00:00, run_start_date=2024-06-27 04:22:00.351681+00:00, run_end_date=2024-06-27 04:22:02.855373+00:00, run_duration=2.503692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:21:00+00:00, data_interval_end=2024-06-27 04:22:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:22:02.875234164Z [2024-06-27T04:22:02.874+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:22:00+00:00, run_after=2024-06-27T04:23:00+00:00 2024-06-27T04:22:02.976055006Z [2024-06-27T04:22:02.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status success for try_number 1 2024-06-27T04:22:02.977222647Z [2024-06-27T04:22:02.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:21:00+00:00 exited with status success for try_number 1 2024-06-27T04:22:02.996273006Z [2024-06-27T04:22:02.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:20:00+00:00, map_index=-1, run_start_date=2024-06-27 04:22:01.417627+00:00, run_end_date=2024-06-27 04:22:01.925343+00:00, run_duration=0.507716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:22:00.410441+00:00, queued_by_job_id=2, pid=7268 2024-06-27T04:22:02.997606099Z [2024-06-27T04:22:02.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:21:00+00:00, map_index=-1, run_start_date=2024-06-27 04:22:01.406767+00:00, run_end_date=2024-06-27 04:22:01.878676+00:00, run_duration=0.471909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:22:00.410441+00:00, queued_by_job_id=2, pid=7267 2024-06-27T04:22:05.182140179Z [2024-06-27T04:22:05.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:22:05.182681921Z [2024-06-27T04:22:05.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:21:00+00:00, run_id=scheduled__2024-06-27T04:21:00+00:00, run_start_date=2024-06-27 04:22:00.353695+00:00, run_end_date=2024-06-27 04:22:05.181995+00:00, run_duration=4.8283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:21:00+00:00, data_interval_end=2024-06-27 04:22:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:22:05.193011921Z [2024-06-27T04:22:05.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:22:00+00:00, run_after=2024-06-27T04:23:00+00:00 2024-06-27T04:22:05.200964954Z [2024-06-27T04:22:05.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:22:05.201348508Z [2024-06-27T04:22:05.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:21:00+00:00, run_id=scheduled__2024-06-27T04:21:00+00:00, run_start_date=2024-06-27 04:22:00.352663+00:00, run_end_date=2024-06-27 04:22:05.201010+00:00, run_duration=4.848347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:21:00+00:00, data_interval_end=2024-06-27 04:22:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:22:05.211577676Z [2024-06-27T04:22:05.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:22:00+00:00, run_after=2024-06-27T04:23:00+00:00 2024-06-27T04:22:05.265096879Z [2024-06-27T04:22:05.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:21:00+00:00 exited with status success for try_number 1 2024-06-27T04:22:05.265367061Z [2024-06-27T04:22:05.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:21:00+00:00 exited with status success for try_number 1 2024-06-27T04:22:05.275339465Z [2024-06-27T04:22:05.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:21:00+00:00, map_index=-1, run_start_date=2024-06-27 04:22:02.564194+00:00, run_end_date=2024-06-27 04:22:04.591333+00:00, run_duration=2.027139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:22:00.410441+00:00, queued_by_job_id=2, pid=7307 2024-06-27T04:22:05.275652511Z [2024-06-27T04:22:05.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:21:00+00:00, map_index=-1, run_start_date=2024-06-27 04:22:02.787360+00:00, run_end_date=2024-06-27 04:22:04.217862+00:00, run_duration=1.430502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:22:00.410441+00:00, queued_by_job_id=2, pid=7308 2024-06-27T04:23:00.576091239Z [2024-06-27T04:23:00.575+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:23:00+00:00, run_after=2024-06-27T04:24:00+00:00 2024-06-27T04:23:00.586620334Z [2024-06-27T04:23:00.585+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:23:00.607254069Z [2024-06-27T04:23:00.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:23:00+00:00, run_after=2024-06-27T04:24:00+00:00 2024-06-27T04:23:00.722673874Z [2024-06-27T04:23:00.722+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:23:00.722704021Z 2024-06-27T04:23:00.722710391Z 2024-06-27T04:23:00.722715692Z 2024-06-27T04:23:00.722897199Z [2024-06-27T04:23:00.722+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:23:00.723204227Z [2024-06-27T04:23:00.722+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:23:00.723454002Z [2024-06-27T04:23:00.723+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:23:00.724488494Z [2024-06-27T04:23:00.724+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:23:00.724503115Z 2024-06-27T04:23:00.724508760Z 2024-06-27T04:23:00.724513933Z 2024-06-27T04:23:00.729598090Z [2024-06-27T04:23:00.729+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:23:00.729841140Z [2024-06-27T04:23:00.729+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:23:00.730315070Z [2024-06-27T04:23:00.730+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:23:00.730601224Z [2024-06-27T04:23:00.730+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:23:00.731000440Z [2024-06-27T04:23:00.730+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:23:00.731260837Z [2024-06-27T04:23:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:23:01.148703365Z [2024-06-27T04:23:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:22:00+00:00 exited with status queued for try_number 1 2024-06-27T04:23:01.149296032Z [2024-06-27T04:23:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:22:00+00:00 exited with status queued for try_number 1 2024-06-27T04:23:01.149685860Z [2024-06-27T04:23:01.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:22:00+00:00 exited with status queued for try_number 1 2024-06-27T04:23:01.174635567Z [2024-06-27T04:23:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e249213-7fe7-42af-b0bc-1d8397729aa0 2024-06-27T04:23:01.174657177Z [2024-06-27T04:23:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dca462f-231e-453f-a28b-a53d64422241 2024-06-27T04:23:01.175566993Z [2024-06-27T04:23:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44dc0865-727d-4582-a94c-00812d7a21d3 2024-06-27T04:23:02.240685775Z [2024-06-27T04:23:02.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:23:02.241192772Z [2024-06-27T04:23:02.240+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:22:00+00:00, run_id=scheduled__2024-06-27T04:22:00+00:00, run_start_date=2024-06-27 04:23:00.627171+00:00, run_end_date=2024-06-27 04:23:02.240589+00:00, run_duration=1.613418, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:22:00+00:00, data_interval_end=2024-06-27 04:23:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:23:02.256152071Z [2024-06-27T04:23:02.255+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:23:00+00:00, run_after=2024-06-27T04:24:00+00:00 2024-06-27T04:23:03.486611291Z [2024-06-27T04:23:03.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:22:00+00:00 exited with status success for try_number 1 2024-06-27T04:23:03.495615755Z [2024-06-27T04:23:03.495+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:22:00+00:00, map_index=-1, run_start_date=2024-06-27 04:23:01.709023+00:00, run_end_date=2024-06-27 04:23:02.174544+00:00, run_duration=0.465521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:23:00.725718+00:00, queued_by_job_id=2, pid=7352 2024-06-27T04:23:04.554345368Z [2024-06-27T04:23:04.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:23:04.554667643Z [2024-06-27T04:23:04.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:22:00+00:00, run_id=scheduled__2024-06-27T04:22:00+00:00, run_start_date=2024-06-27 04:23:00.629268+00:00, run_end_date=2024-06-27 04:23:04.554348+00:00, run_duration=3.92508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:22:00+00:00, data_interval_end=2024-06-27 04:23:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:23:04.569783393Z [2024-06-27T04:23:04.569+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:23:00+00:00, run_after=2024-06-27T04:24:00+00:00 2024-06-27T04:23:05.714844852Z [2024-06-27T04:23:05.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:22:00+00:00 exited with status success for try_number 1 2024-06-27T04:23:05.722082455Z [2024-06-27T04:23:05.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:22:00+00:00, map_index=-1, run_start_date=2024-06-27 04:23:02.935816+00:00, run_end_date=2024-06-27 04:23:04.492679+00:00, run_duration=1.556863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:23:00.725718+00:00, queued_by_job_id=2, pid=7382 2024-06-27T04:23:06.932162252Z [2024-06-27T04:23:06.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:23:06.932731547Z [2024-06-27T04:23:06.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:22:00+00:00, run_id=scheduled__2024-06-27T04:22:00+00:00, run_start_date=2024-06-27 04:23:00.631023+00:00, run_end_date=2024-06-27 04:23:06.932275+00:00, run_duration=6.301252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:22:00+00:00, data_interval_end=2024-06-27 04:23:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:23:06.942784422Z [2024-06-27T04:23:06.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:23:00+00:00, run_after=2024-06-27T04:24:00+00:00 2024-06-27T04:23:06.990796874Z [2024-06-27T04:23:06.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:22:00+00:00 exited with status success for try_number 1 2024-06-27T04:23:06.999863393Z [2024-06-27T04:23:06.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:22:00+00:00, map_index=-1, run_start_date=2024-06-27 04:23:03.069286+00:00, run_end_date=2024-06-27 04:23:06.750123+00:00, run_duration=3.680837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:23:00.725718+00:00, queued_by_job_id=2, pid=7383 2024-06-27T04:24:00.868800254Z [2024-06-27T04:24:00.868+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:24:00+00:00, run_after=2024-06-27T04:25:00+00:00 2024-06-27T04:24:00.890426771Z [2024-06-27T04:24:00.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:24:00+00:00, run_after=2024-06-27T04:25:00+00:00 2024-06-27T04:24:00.898706321Z [2024-06-27T04:24:00.898+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:24:00.908757627Z [2024-06-27T04:24:00.908+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:24:01.006946610Z [2024-06-27T04:24:01.006+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:24:01.006994615Z 2024-06-27T04:24:01.007000279Z 2024-06-27T04:24:01.007024164Z 2024-06-27T04:24:01.007028608Z 2024-06-27T04:24:01.007275963Z [2024-06-27T04:24:01.006+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:24:01.007504314Z [2024-06-27T04:24:01.007+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:24:01.007644352Z [2024-06-27T04:24:01.007+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:24:01.007853444Z [2024-06-27T04:24:01.007+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:24:01.009096725Z [2024-06-27T04:24:01.008+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:24:01.009106475Z 2024-06-27T04:24:01.009115094Z 2024-06-27T04:24:01.009119114Z 2024-06-27T04:24:01.009123086Z 2024-06-27T04:24:01.014229050Z [2024-06-27T04:24:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:24:01.014631323Z [2024-06-27T04:24:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:24:01.014977672Z [2024-06-27T04:24:01.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:24:01.015106704Z [2024-06-27T04:24:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:24:01.015436388Z [2024-06-27T04:24:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:24:01.015488691Z [2024-06-27T04:24:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:24:01.015788249Z [2024-06-27T04:24:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:24:01.015916440Z [2024-06-27T04:24:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:24:01.327487722Z [2024-06-27T04:24:01.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:22:00+00:00 exited with status queued for try_number 1 2024-06-27T04:24:01.329985155Z [2024-06-27T04:24:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:23:00+00:00 exited with status queued for try_number 1 2024-06-27T04:24:01.330213671Z [2024-06-27T04:24:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:23:00+00:00 exited with status queued for try_number 1 2024-06-27T04:24:01.330305579Z [2024-06-27T04:24:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:23:00+00:00 exited with status queued for try_number 1 2024-06-27T04:24:01.342048810Z [2024-06-27T04:24:01.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e017668-8d84-4986-a945-b46201efd72f 2024-06-27T04:24:01.342084991Z [2024-06-27T04:24:01.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba375c81-2301-4c67-8a15-5a37bef763fe 2024-06-27T04:24:01.342203597Z [2024-06-27T04:24:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff784237-a4ca-4c6a-88a6-487c3cfedad8 2024-06-27T04:24:01.342408612Z [2024-06-27T04:24:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0639a45d-0991-4acb-b6de-48b5aae0961f 2024-06-27T04:24:02.594851474Z [2024-06-27T04:24:02.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:24:02.595401107Z [2024-06-27T04:24:02.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:22:00+00:00, run_id=scheduled__2024-06-27T04:22:00+00:00, run_start_date=2024-06-27 04:24:00.927541+00:00, run_end_date=2024-06-27 04:24:02.594765+00:00, run_duration=1.667224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:22:00+00:00, data_interval_end=2024-06-27 04:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:24:02.608276813Z [2024-06-27T04:24:02.607+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:24:00+00:00, run_after=2024-06-27T04:26:00+00:00 2024-06-27T04:24:02.618353513Z [2024-06-27T04:24:02.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:24:02.618680908Z [2024-06-27T04:24:02.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:23:00+00:00, run_id=scheduled__2024-06-27T04:23:00+00:00, run_start_date=2024-06-27 04:24:00.928955+00:00, run_end_date=2024-06-27 04:24:02.618216+00:00, run_duration=1.689261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:23:00+00:00, data_interval_end=2024-06-27 04:24:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:24:02.634851820Z [2024-06-27T04:24:02.634+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:24:00+00:00, run_after=2024-06-27T04:25:00+00:00 2024-06-27T04:24:02.712013492Z [2024-06-27T04:24:02.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:22:00+00:00 exited with status success for try_number 1 2024-06-27T04:24:02.720562417Z [2024-06-27T04:24:02.719+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:22:00+00:00, map_index=-1, run_start_date=2024-06-27 04:24:01.857027+00:00, run_end_date=2024-06-27 04:24:02.199927+00:00, run_duration=0.3429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:24:01.010686+00:00, queued_by_job_id=2, pid=7428 2024-06-27T04:24:02.924535771Z [2024-06-27T04:24:02.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:23:00+00:00 exited with status success for try_number 1 2024-06-27T04:24:02.929538167Z [2024-06-27T04:24:02.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:23:00+00:00, map_index=-1, run_start_date=2024-06-27 04:24:02.109200+00:00, run_end_date=2024-06-27 04:24:02.501337+00:00, run_duration=0.392137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:24:01.010686+00:00, queued_by_job_id=2, pid=7437 2024-06-27T04:24:05.096147730Z [2024-06-27T04:24:05.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:24:05.096598015Z [2024-06-27T04:24:05.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:23:00+00:00, run_id=scheduled__2024-06-27T04:23:00+00:00, run_start_date=2024-06-27 04:24:00.930149+00:00, run_end_date=2024-06-27 04:24:05.096036+00:00, run_duration=4.165887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:23:00+00:00, data_interval_end=2024-06-27 04:24:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:24:05.106897119Z [2024-06-27T04:24:05.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:24:00+00:00, run_after=2024-06-27T04:25:00+00:00 2024-06-27T04:24:05.115241577Z [2024-06-27T04:24:05.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:24:05.115582889Z [2024-06-27T04:24:05.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:23:00+00:00, run_id=scheduled__2024-06-27T04:23:00+00:00, run_start_date=2024-06-27 04:24:00.931503+00:00, run_end_date=2024-06-27 04:24:05.115101+00:00, run_duration=4.183598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:23:00+00:00, data_interval_end=2024-06-27 04:24:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:24:05.126660776Z [2024-06-27T04:24:05.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:24:00+00:00, run_after=2024-06-27T04:25:00+00:00 2024-06-27T04:24:05.179269203Z [2024-06-27T04:24:05.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:23:00+00:00 exited with status success for try_number 1 2024-06-27T04:24:05.179561589Z [2024-06-27T04:24:05.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:23:00+00:00 exited with status success for try_number 1 2024-06-27T04:24:05.222215725Z [2024-06-27T04:24:05.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:23:00+00:00, map_index=-1, run_start_date=2024-06-27 04:24:03.243424+00:00, run_end_date=2024-06-27 04:24:04.521391+00:00, run_duration=1.277967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:24:01.010686+00:00, queued_by_job_id=2, pid=7469 2024-06-27T04:24:05.223161459Z [2024-06-27T04:24:05.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:23:00+00:00, map_index=-1, run_start_date=2024-06-27 04:24:03.095448+00:00, run_end_date=2024-06-27 04:24:04.638753+00:00, run_duration=1.543305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:24:01.010686+00:00, queued_by_job_id=2, pid=7468 2024-06-27T04:25:00.110184703Z [2024-06-27T04:25:00.109+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:25:00.124726173Z [2024-06-27T04:25:00.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:25:00+00:00, run_after=2024-06-27T04:30:00+00:00 2024-06-27T04:25:00.139609551Z [2024-06-27T04:25:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:25:00+00:00, run_after=2024-06-27T04:26:00+00:00 2024-06-27T04:25:00.155823410Z [2024-06-27T04:25:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:25:00+00:00, run_after=2024-06-27T04:26:00+00:00 2024-06-27T04:25:00.283534708Z [2024-06-27T04:25:00.282+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:25:00.283576108Z 2024-06-27T04:25:00.283585168Z 2024-06-27T04:25:00.283615611Z 2024-06-27T04:25:00.283623213Z 2024-06-27T04:25:00.283910346Z [2024-06-27T04:25:00.283+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:25:00.284659664Z [2024-06-27T04:25:00.284+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:25:00.286085819Z [2024-06-27T04:25:00.285+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:25:00.286473294Z [2024-06-27T04:25:00.286+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:25:00.287855225Z [2024-06-27T04:25:00.287+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:25:00.287891864Z 2024-06-27T04:25:00.287907738Z 2024-06-27T04:25:00.287921979Z 2024-06-27T04:25:00.287935640Z 2024-06-27T04:25:00.295839659Z [2024-06-27T04:25:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:25:00.296091774Z [2024-06-27T04:25:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:25:00.296624232Z [2024-06-27T04:25:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:25:00.296875464Z [2024-06-27T04:25:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:25:00.297330491Z [2024-06-27T04:25:00.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:25:00.297609892Z [2024-06-27T04:25:00.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:25:00.298059474Z [2024-06-27T04:25:00.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:25:00.298399329Z [2024-06-27T04:25:00.298+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:25:00.673198767Z [2024-06-27T04:25:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status queued for try_number 1 2024-06-27T04:25:00.673651233Z [2024-06-27T04:25:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:24:00+00:00 exited with status queued for try_number 1 2024-06-27T04:25:00.673833381Z [2024-06-27T04:25:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:24:00+00:00 exited with status queued for try_number 1 2024-06-27T04:25:00.674021521Z [2024-06-27T04:25:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:24:00+00:00 exited with status queued for try_number 1 2024-06-27T04:25:00.683051289Z [2024-06-27T04:25:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to c693af3a-f47c-42c0-81dd-570e87f8db47 2024-06-27T04:25:00.683578752Z [2024-06-27T04:25:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 805bff90-6639-4823-ab01-e50248bfa156 2024-06-27T04:25:00.683833241Z [2024-06-27T04:25:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ba2b615-189f-49cf-8f53-278f4fac99f1 2024-06-27T04:25:00.684066556Z [2024-06-27T04:25:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 221e3094-1ba8-4f41-98e1-9e1cf4de3430 2024-06-27T04:25:01.898863721Z [2024-06-27T04:25:01.898+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:25:01.899315142Z [2024-06-27T04:25:01.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:24:00+00:00, run_id=scheduled__2024-06-27T04:24:00+00:00, run_start_date=2024-06-27 04:25:00.171331+00:00, run_end_date=2024-06-27 04:25:01.898782+00:00, run_duration=1.727451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:24:00+00:00, data_interval_end=2024-06-27 04:25:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:25:01.921918700Z [2024-06-27T04:25:01.921+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:25:00+00:00, run_after=2024-06-27T04:26:00+00:00 2024-06-27T04:25:01.969203279Z [2024-06-27T04:25:01.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:24:00+00:00 exited with status success for try_number 1 2024-06-27T04:25:01.977403749Z [2024-06-27T04:25:01.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:24:00+00:00, map_index=-1, run_start_date=2024-06-27 04:25:01.131012+00:00, run_end_date=2024-06-27 04:25:01.550570+00:00, run_duration=0.419558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:25:00.290594+00:00, queued_by_job_id=2, pid=7513 2024-06-27T04:25:03.436886684Z [2024-06-27T04:25:03.436+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:25:03.436914441Z 2024-06-27T04:25:03.437091584Z [2024-06-27T04:25:03.436+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:25:03.437880366Z [2024-06-27T04:25:03.437+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:25:03.437906191Z 2024-06-27T04:25:03.440989023Z [2024-06-27T04:25:03.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:25:03.441027566Z [2024-06-27T04:25:03.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:25:03.502200100Z [2024-06-27T04:25:03.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status queued for try_number 1 2024-06-27T04:25:03.502254420Z [2024-06-27T04:25:03.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status success for try_number 1 2024-06-27T04:25:03.514252428Z [2024-06-27T04:25:03.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3d5fb72-34cb-49e9-9b86-e98ff5f75408 2024-06-27T04:25:03.514468105Z [2024-06-27T04:25:03.514+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:20:00+00:00, map_index=-1, run_start_date=2024-06-27 04:25:02.542230+00:00, run_end_date=2024-06-27 04:25:03.084613+00:00, run_duration=0.542383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:25:00.290594+00:00, queued_by_job_id=2, pid=7554 2024-06-27T04:25:03.844504650Z [2024-06-27T04:25:03.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:25:03.844648160Z [2024-06-27T04:25:03.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:24:00+00:00, run_id=scheduled__2024-06-27T04:24:00+00:00, run_start_date=2024-06-27 04:25:00.172534+00:00, run_end_date=2024-06-27 04:25:03.844361+00:00, run_duration=3.671827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:24:00+00:00, data_interval_end=2024-06-27 04:25:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:25:03.858226745Z [2024-06-27T04:25:03.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:25:00+00:00, run_after=2024-06-27T04:26:00+00:00 2024-06-27T04:25:05.036981403Z [2024-06-27T04:25:05.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:25:05.037070645Z [2024-06-27T04:25:05.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:24:00+00:00, run_id=scheduled__2024-06-27T04:24:00+00:00, run_start_date=2024-06-27 04:25:00.173778+00:00, run_end_date=2024-06-27 04:25:05.036682+00:00, run_duration=4.862904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:24:00+00:00, data_interval_end=2024-06-27 04:25:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:25:05.046958254Z [2024-06-27T04:25:05.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:25:00+00:00, run_after=2024-06-27T04:26:00+00:00 2024-06-27T04:25:05.114806411Z [2024-06-27T04:25:05.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:24:00+00:00 exited with status success for try_number 1 2024-06-27T04:25:05.114842807Z [2024-06-27T04:25:05.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:24:00+00:00 exited with status success for try_number 1 2024-06-27T04:25:05.121342690Z [2024-06-27T04:25:05.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:24:00+00:00, map_index=-1, run_start_date=2024-06-27 04:25:02.359875+00:00, run_end_date=2024-06-27 04:25:03.744118+00:00, run_duration=1.384243, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:25:00.290594+00:00, queued_by_job_id=2, pid=7553 2024-06-27T04:25:05.121937123Z [2024-06-27T04:25:05.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:24:00+00:00, map_index=-1, run_start_date=2024-06-27 04:25:02.575063+00:00, run_end_date=2024-06-27 04:25:04.404994+00:00, run_duration=1.829931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:25:00.290594+00:00, queued_by_job_id=2, pid=7555 2024-06-27T04:25:05.798799021Z [2024-06-27T04:25:05.798+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:25:05.798829952Z 2024-06-27T04:25:05.799020749Z [2024-06-27T04:25:05.798+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:25:05.799651763Z [2024-06-27T04:25:05.799+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:25:05.799662767Z 2024-06-27T04:25:05.802231739Z [2024-06-27T04:25:05.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:25:05.802352609Z [2024-06-27T04:25:05.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:25:05.858638956Z [2024-06-27T04:25:05.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status queued for try_number 1 2024-06-27T04:25:05.858778439Z [2024-06-27T04:25:05.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status success for try_number 1 2024-06-27T04:25:05.865325119Z [2024-06-27T04:25:05.865+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92a1a4b8-0535-45af-84a2-41595f328b3e 2024-06-27T04:25:05.865549264Z [2024-06-27T04:25:05.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T04:20:00+00:00, map_index=-1, run_start_date=2024-06-27 04:25:05.192077+00:00, run_end_date=2024-06-27 04:25:05.589915+00:00, run_duration=0.397838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:25:03.438339+00:00, queued_by_job_id=2, pid=7594 2024-06-27T04:25:05.879330547Z [2024-06-27T04:25:05.878+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T04:25:09.139485984Z [2024-06-27T04:25:09.138+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:25:09.139517942Z 2024-06-27T04:25:09.139757245Z [2024-06-27T04:25:09.139+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:25:09.140636905Z [2024-06-27T04:25:09.140+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:25:09.140663866Z 2024-06-27T04:25:09.144147645Z [2024-06-27T04:25:09.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:25:09.144389059Z [2024-06-27T04:25:09.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:25:09.245979776Z [2024-06-27T04:25:09.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status queued for try_number 1 2024-06-27T04:25:09.246167537Z [2024-06-27T04:25:09.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status success for try_number 1 2024-06-27T04:25:09.256455843Z [2024-06-27T04:25:09.256+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba4cc5f9-2b86-4e9e-b703-3b7dd740f13c 2024-06-27T04:25:09.256663454Z [2024-06-27T04:25:09.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:20:00+00:00, map_index=0, run_start_date=2024-06-27 04:25:07.575443+00:00, run_end_date=2024-06-27 04:25:07.967342+00:00, run_duration=0.391899, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:25:05.800036+00:00, queued_by_job_id=2, pid=7606 2024-06-27T04:25:12.028180040Z [2024-06-27T04:25:12.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:25:12.028851723Z [2024-06-27T04:25:12.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:20:00+00:00, run_id=scheduled__2024-06-27T04:20:00+00:00, run_start_date=2024-06-27 04:25:00.169756+00:00, run_end_date=2024-06-27 04:25:12.028048+00:00, run_duration=11.858292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:20:00+00:00, data_interval_end=2024-06-27 04:25:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T04:25:12.037146903Z [2024-06-27T04:25:12.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:25:00+00:00, run_after=2024-06-27T04:30:00+00:00 2024-06-27T04:25:12.089120836Z [2024-06-27T04:25:12.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:20:00+00:00 exited with status success for try_number 1 2024-06-27T04:25:12.099577575Z [2024-06-27T04:25:12.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:20:00+00:00, map_index=-1, run_start_date=2024-06-27 04:25:10.873004+00:00, run_end_date=2024-06-27 04:25:11.308469+00:00, run_duration=0.435465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:25:09.141304+00:00, queued_by_job_id=2, pid=7618 2024-06-27T04:26:00.041476548Z [2024-06-27T04:26:00.040+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:26:00+00:00, run_after=2024-06-27T04:27:00+00:00 2024-06-27T04:26:00.049514945Z [2024-06-27T04:26:00.049+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:26:00.061528593Z [2024-06-27T04:26:00.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:26:00+00:00, run_after=2024-06-27T04:27:00+00:00 2024-06-27T04:26:00.067757700Z [2024-06-27T04:26:00.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:26:00.149019117Z [2024-06-27T04:26:00.148+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:26:00.149051661Z 2024-06-27T04:26:00.149057550Z 2024-06-27T04:26:00.149062663Z 2024-06-27T04:26:00.149067195Z 2024-06-27T04:26:00.149157571Z [2024-06-27T04:26:00.149+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:26:00.149297403Z [2024-06-27T04:26:00.149+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:26:00.149434954Z [2024-06-27T04:26:00.149+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:26:00.149536768Z [2024-06-27T04:26:00.149+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:26:00.150125707Z [2024-06-27T04:26:00.149+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:26:00.150135424Z 2024-06-27T04:26:00.150144446Z 2024-06-27T04:26:00.150148906Z 2024-06-27T04:26:00.150153272Z 2024-06-27T04:26:00.156760263Z [2024-06-27T04:26:00.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:26:00.157075111Z [2024-06-27T04:26:00.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:26:00.158243443Z [2024-06-27T04:26:00.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:26:00.158482119Z [2024-06-27T04:26:00.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:26:00.158711548Z [2024-06-27T04:26:00.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:26:00.158854895Z [2024-06-27T04:26:00.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:26:00.159066978Z [2024-06-27T04:26:00.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:26:00.159219760Z [2024-06-27T04:26:00.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:26:00.666376838Z [2024-06-27T04:26:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:24:00+00:00 exited with status queued for try_number 1 2024-06-27T04:26:00.666405474Z [2024-06-27T04:26:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status queued for try_number 1 2024-06-27T04:26:00.666409180Z [2024-06-27T04:26:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status queued for try_number 1 2024-06-27T04:26:00.666440390Z [2024-06-27T04:26:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status queued for try_number 1 2024-06-27T04:26:00.685531093Z [2024-06-27T04:26:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f908653-c1b6-4872-b37a-b98856701636 2024-06-27T04:26:00.685718640Z [2024-06-27T04:26:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to e49ded94-9ed9-4d14-87ca-f5a2c4f08530 2024-06-27T04:26:00.685913404Z [2024-06-27T04:26:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7181e24e-eb94-4280-b6a0-2db2299947fe 2024-06-27T04:26:00.686069180Z [2024-06-27T04:26:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6a403d3-4c8b-4b7f-bce9-3469f9273d07 2024-06-27T04:26:02.035507616Z [2024-06-27T04:26:02.035+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:26:02.035981880Z [2024-06-27T04:26:02.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:24:00+00:00, run_id=scheduled__2024-06-27T04:24:00+00:00, run_start_date=2024-06-27 04:26:00.079213+00:00, run_end_date=2024-06-27 04:26:02.035361+00:00, run_duration=1.956148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:24:00+00:00, data_interval_end=2024-06-27 04:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:26:02.043545191Z [2024-06-27T04:26:02.043+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:26:00+00:00, run_after=2024-06-27T04:28:00+00:00 2024-06-27T04:26:02.049565903Z [2024-06-27T04:26:02.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:26:02.049828280Z [2024-06-27T04:26:02.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:25:00+00:00, run_id=scheduled__2024-06-27T04:25:00+00:00, run_start_date=2024-06-27 04:26:00.080738+00:00, run_end_date=2024-06-27 04:26:02.049429+00:00, run_duration=1.968691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:25:00+00:00, data_interval_end=2024-06-27 04:26:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:26:02.058981956Z [2024-06-27T04:26:02.058+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:26:00+00:00, run_after=2024-06-27T04:27:00+00:00 2024-06-27T04:26:02.101517489Z [2024-06-27T04:26:02.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:24:00+00:00 exited with status success for try_number 1 2024-06-27T04:26:02.101757615Z [2024-06-27T04:26:02.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status success for try_number 1 2024-06-27T04:26:02.109307781Z [2024-06-27T04:26:02.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:25:00+00:00, map_index=-1, run_start_date=2024-06-27 04:26:01.159645+00:00, run_end_date=2024-06-27 04:26:01.671270+00:00, run_duration=0.511625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:26:00.151018+00:00, queued_by_job_id=2, pid=7645 2024-06-27T04:26:02.109516419Z [2024-06-27T04:26:02.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:24:00+00:00, map_index=-1, run_start_date=2024-06-27 04:26:01.264441+00:00, run_end_date=2024-06-27 04:26:01.692302+00:00, run_duration=0.427861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:26:00.151018+00:00, queued_by_job_id=2, pid=7646 2024-06-27T04:26:05.081146754Z [2024-06-27T04:26:05.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:26:05.081210017Z [2024-06-27T04:26:05.080+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:25:00+00:00, run_id=scheduled__2024-06-27T04:25:00+00:00, run_start_date=2024-06-27 04:26:00.081809+00:00, run_end_date=2024-06-27 04:26:05.080881+00:00, run_duration=4.999072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:25:00+00:00, data_interval_end=2024-06-27 04:26:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:26:05.091693941Z [2024-06-27T04:26:05.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:26:00+00:00, run_after=2024-06-27T04:27:00+00:00 2024-06-27T04:26:05.097885852Z [2024-06-27T04:26:05.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:26:05.097943398Z [2024-06-27T04:26:05.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:25:00+00:00, run_id=scheduled__2024-06-27T04:25:00+00:00, run_start_date=2024-06-27 04:26:00.082774+00:00, run_end_date=2024-06-27 04:26:05.097700+00:00, run_duration=5.014926, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:25:00+00:00, data_interval_end=2024-06-27 04:26:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:26:05.106142327Z [2024-06-27T04:26:05.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:26:00+00:00, run_after=2024-06-27T04:27:00+00:00 2024-06-27T04:26:05.134728380Z [2024-06-27T04:26:05.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status success for try_number 1 2024-06-27T04:26:05.134770017Z [2024-06-27T04:26:05.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status success for try_number 1 2024-06-27T04:26:05.141820546Z [2024-06-27T04:26:05.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:25:00+00:00, map_index=-1, run_start_date=2024-06-27 04:26:02.594517+00:00, run_end_date=2024-06-27 04:26:04.180150+00:00, run_duration=1.585633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:26:00.151018+00:00, queued_by_job_id=2, pid=7686 2024-06-27T04:26:05.141876588Z [2024-06-27T04:26:05.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:25:00+00:00, map_index=-1, run_start_date=2024-06-27 04:26:02.429854+00:00, run_end_date=2024-06-27 04:26:04.513358+00:00, run_duration=2.083504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:26:00.151018+00:00, queued_by_job_id=2, pid=7685 2024-06-27T04:27:00.690026527Z [2024-06-27T04:27:00.689+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:27:00.712318301Z [2024-06-27T04:27:00.711+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:27:00+00:00, run_after=2024-06-27T04:28:00+00:00 2024-06-27T04:27:00.736252176Z [2024-06-27T04:27:00.735+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:27:00+00:00, run_after=2024-06-27T04:28:00+00:00 2024-06-27T04:27:00.828947216Z [2024-06-27T04:27:00.828+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:27:00.829029558Z 2024-06-27T04:27:00.829041204Z 2024-06-27T04:27:00.829082204Z 2024-06-27T04:27:00.829155084Z [2024-06-27T04:27:00.828+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:27:00.829175161Z [2024-06-27T04:27:00.829+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:27:00.829310505Z [2024-06-27T04:27:00.829+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:27:00.829958580Z [2024-06-27T04:27:00.829+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:27:00.829970559Z 2024-06-27T04:27:00.829975136Z 2024-06-27T04:27:00.829979553Z 2024-06-27T04:27:00.834355874Z [2024-06-27T04:27:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:27:00.834528280Z [2024-06-27T04:27:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:27:00.834804031Z [2024-06-27T04:27:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:27:00.835032241Z [2024-06-27T04:27:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:27:00.835329913Z [2024-06-27T04:27:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:27:00.835467911Z [2024-06-27T04:27:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:27:01.205784956Z [2024-06-27T04:27:01.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:26:00+00:00 exited with status queued for try_number 1 2024-06-27T04:27:01.205831925Z [2024-06-27T04:27:01.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:26:00+00:00 exited with status queued for try_number 1 2024-06-27T04:27:01.205897951Z [2024-06-27T04:27:01.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:26:00+00:00 exited with status queued for try_number 1 2024-06-27T04:27:01.221316224Z [2024-06-27T04:27:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01daf724-9084-446c-b701-f12909824bd8 2024-06-27T04:27:01.221415393Z [2024-06-27T04:27:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7425c02-0532-4073-9598-dc7a34601b18 2024-06-27T04:27:01.221607813Z [2024-06-27T04:27:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to faaa4982-9045-4757-8b7f-cf1da41c55a3 2024-06-27T04:27:02.905640399Z [2024-06-27T04:27:02.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:27:02.905928759Z [2024-06-27T04:27:02.905+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:26:00+00:00, run_id=scheduled__2024-06-27T04:26:00+00:00, run_start_date=2024-06-27 04:27:00.750765+00:00, run_end_date=2024-06-27 04:27:02.905641+00:00, run_duration=2.154876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:26:00+00:00, data_interval_end=2024-06-27 04:27:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:27:02.914430739Z [2024-06-27T04:27:02.914+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:27:00+00:00, run_after=2024-06-27T04:28:00+00:00 2024-06-27T04:27:02.948081946Z [2024-06-27T04:27:02.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:26:00+00:00 exited with status success for try_number 1 2024-06-27T04:27:02.954004638Z [2024-06-27T04:27:02.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:26:00+00:00, map_index=-1, run_start_date=2024-06-27 04:27:01.724247+00:00, run_end_date=2024-06-27 04:27:02.109092+00:00, run_duration=0.384845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:27:00.830711+00:00, queued_by_job_id=2, pid=7730 2024-06-27T04:27:04.038540910Z [2024-06-27T04:27:04.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:27:04.039544130Z [2024-06-27T04:27:04.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:26:00+00:00, run_id=scheduled__2024-06-27T04:26:00+00:00, run_start_date=2024-06-27 04:27:00.752187+00:00, run_end_date=2024-06-27 04:27:04.038320+00:00, run_duration=3.286133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:26:00+00:00, data_interval_end=2024-06-27 04:27:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:27:04.050141638Z [2024-06-27T04:27:04.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:27:00+00:00, run_after=2024-06-27T04:28:00+00:00 2024-06-27T04:27:04.465574214Z [2024-06-27T04:27:04.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:27:04.467194186Z [2024-06-27T04:27:04.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:26:00+00:00, run_id=scheduled__2024-06-27T04:26:00+00:00, run_start_date=2024-06-27 04:27:00.753390+00:00, run_end_date=2024-06-27 04:27:04.466708+00:00, run_duration=3.713318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:26:00+00:00, data_interval_end=2024-06-27 04:27:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:27:04.477298354Z [2024-06-27T04:27:04.477+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:27:00+00:00, run_after=2024-06-27T04:28:00+00:00 2024-06-27T04:27:04.510687365Z [2024-06-27T04:27:04.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:26:00+00:00 exited with status success for try_number 1 2024-06-27T04:27:04.518034557Z [2024-06-27T04:27:04.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:26:00+00:00, map_index=-1, run_start_date=2024-06-27 04:27:02.685700+00:00, run_end_date=2024-06-27 04:27:03.938248+00:00, run_duration=1.252548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:27:00.830711+00:00, queued_by_job_id=2, pid=7760 2024-06-27T04:27:05.580016089Z [2024-06-27T04:27:05.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:26:00+00:00 exited with status success for try_number 1 2024-06-27T04:27:05.584687954Z [2024-06-27T04:27:05.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:26:00+00:00, map_index=-1, run_start_date=2024-06-27 04:27:02.689707+00:00, run_end_date=2024-06-27 04:27:04.330307+00:00, run_duration=1.6406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:27:00.830711+00:00, queued_by_job_id=2, pid=7761 2024-06-27T04:28:00.942646264Z [2024-06-27T04:28:00.941+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:28:00.954510107Z [2024-06-27T04:28:00.953+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:28:00.985608598Z [2024-06-27T04:28:00.985+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:28:00+00:00, run_after=2024-06-27T04:29:00+00:00 2024-06-27T04:28:01.003862913Z [2024-06-27T04:28:01.003+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:28:00+00:00, run_after=2024-06-27T04:29:00+00:00 2024-06-27T04:28:01.138812023Z [2024-06-27T04:28:01.138+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:28:01.138830719Z 2024-06-27T04:28:01.138834885Z 2024-06-27T04:28:01.138837909Z 2024-06-27T04:28:01.138841108Z 2024-06-27T04:28:01.139806475Z [2024-06-27T04:28:01.139+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:28:01.140179013Z [2024-06-27T04:28:01.140+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:28:01.143578136Z [2024-06-27T04:28:01.140+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:28:01.143900014Z [2024-06-27T04:28:01.143+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:28:01.144876698Z [2024-06-27T04:28:01.144+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:28:01.144892905Z 2024-06-27T04:28:01.144897987Z 2024-06-27T04:28:01.144911922Z 2024-06-27T04:28:01.144916970Z 2024-06-27T04:28:01.152209416Z [2024-06-27T04:28:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:28:01.152483029Z [2024-06-27T04:28:01.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:28:01.152809204Z [2024-06-27T04:28:01.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:28:01.152969133Z [2024-06-27T04:28:01.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:28:01.153222472Z [2024-06-27T04:28:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:28:01.153347696Z [2024-06-27T04:28:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:28:01.153593180Z [2024-06-27T04:28:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:28:01.153709316Z [2024-06-27T04:28:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:28:01.512263841Z [2024-06-27T04:28:01.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:26:00+00:00 exited with status queued for try_number 1 2024-06-27T04:28:01.512464849Z [2024-06-27T04:28:01.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:27:00+00:00 exited with status queued for try_number 1 2024-06-27T04:28:01.512635196Z [2024-06-27T04:28:01.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:27:00+00:00 exited with status queued for try_number 1 2024-06-27T04:28:01.512734215Z [2024-06-27T04:28:01.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:27:00+00:00 exited with status queued for try_number 1 2024-06-27T04:28:01.523852860Z [2024-06-27T04:28:01.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to a98b57ab-6124-41f0-a799-f0a839f79da7 2024-06-27T04:28:01.524515938Z [2024-06-27T04:28:01.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3596d2a-287b-4e14-8724-fd7aeb7cda7f 2024-06-27T04:28:01.525097195Z [2024-06-27T04:28:01.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to d02a051d-cdff-441b-8493-0e16938bda39 2024-06-27T04:28:01.525585708Z [2024-06-27T04:28:01.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 185d62e1-55ed-4c45-98dd-e2b4cdb74aee 2024-06-27T04:28:02.802022071Z [2024-06-27T04:28:02.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:28:02.802486507Z [2024-06-27T04:28:02.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:26:00+00:00, run_id=scheduled__2024-06-27T04:26:00+00:00, run_start_date=2024-06-27 04:28:01.021974+00:00, run_end_date=2024-06-27 04:28:02.801942+00:00, run_duration=1.779968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:26:00+00:00, data_interval_end=2024-06-27 04:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:28:02.817240013Z [2024-06-27T04:28:02.816+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:28:00+00:00, run_after=2024-06-27T04:30:00+00:00 2024-06-27T04:28:02.832061134Z [2024-06-27T04:28:02.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:28:02.832214404Z [2024-06-27T04:28:02.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:27:00+00:00, run_id=scheduled__2024-06-27T04:27:00+00:00, run_start_date=2024-06-27 04:28:01.024442+00:00, run_end_date=2024-06-27 04:28:02.831945+00:00, run_duration=1.807503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:27:00+00:00, data_interval_end=2024-06-27 04:28:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:28:02.843643858Z [2024-06-27T04:28:02.843+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:28:00+00:00, run_after=2024-06-27T04:29:00+00:00 2024-06-27T04:28:02.898349075Z [2024-06-27T04:28:02.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:26:00+00:00 exited with status success for try_number 1 2024-06-27T04:28:02.898383840Z [2024-06-27T04:28:02.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:27:00+00:00 exited with status success for try_number 1 2024-06-27T04:28:02.915102634Z [2024-06-27T04:28:02.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:26:00+00:00, map_index=-1, run_start_date=2024-06-27 04:28:02.087251+00:00, run_end_date=2024-06-27 04:28:02.420332+00:00, run_duration=0.333081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:28:01.146833+00:00, queued_by_job_id=2, pid=7808 2024-06-27T04:28:02.915364639Z [2024-06-27T04:28:02.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:27:00+00:00, map_index=-1, run_start_date=2024-06-27 04:28:01.994397+00:00, run_end_date=2024-06-27 04:28:02.367026+00:00, run_duration=0.372629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:28:01.146833+00:00, queued_by_job_id=2, pid=7807 2024-06-27T04:28:04.953719990Z [2024-06-27T04:28:04.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:28:04.954545107Z [2024-06-27T04:28:04.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:27:00+00:00, run_id=scheduled__2024-06-27T04:27:00+00:00, run_start_date=2024-06-27 04:28:01.025787+00:00, run_end_date=2024-06-27 04:28:04.953580+00:00, run_duration=3.927793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:27:00+00:00, data_interval_end=2024-06-27 04:28:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:28:04.962752406Z [2024-06-27T04:28:04.962+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:28:00+00:00, run_after=2024-06-27T04:29:00+00:00 2024-06-27T04:28:05.024047814Z [2024-06-27T04:28:05.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:27:00+00:00 exited with status success for try_number 1 2024-06-27T04:28:05.030879506Z [2024-06-27T04:28:05.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:27:00+00:00, map_index=-1, run_start_date=2024-06-27 04:28:03.411901+00:00, run_end_date=2024-06-27 04:28:04.776695+00:00, run_duration=1.364794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:28:01.146833+00:00, queued_by_job_id=2, pid=7847 2024-06-27T04:28:06.100803379Z [2024-06-27T04:28:06.100+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:28:06.101196110Z [2024-06-27T04:28:06.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:27:00+00:00, run_id=scheduled__2024-06-27T04:27:00+00:00, run_start_date=2024-06-27 04:28:01.027067+00:00, run_end_date=2024-06-27 04:28:06.100546+00:00, run_duration=5.073479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:27:00+00:00, data_interval_end=2024-06-27 04:28:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:28:06.115226198Z [2024-06-27T04:28:06.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:28:00+00:00, run_after=2024-06-27T04:29:00+00:00 2024-06-27T04:28:06.155213526Z [2024-06-27T04:28:06.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:27:00+00:00 exited with status success for try_number 1 2024-06-27T04:28:06.162569300Z [2024-06-27T04:28:06.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:27:00+00:00, map_index=-1, run_start_date=2024-06-27 04:28:03.245553+00:00, run_end_date=2024-06-27 04:28:04.947429+00:00, run_duration=1.701876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:28:01.146833+00:00, queued_by_job_id=2, pid=7846 2024-06-27T04:28:54.842227434Z [2024-06-27T04:28:54.841+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:28:54.842279700Z 2024-06-27T04:28:54.842883422Z [2024-06-27T04:28:54.841+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-06-27T04:28:54.845036549Z [2024-06-27T04:28:54.844+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:28:54.845056986Z 2024-06-27T04:28:54.850132063Z [2024-06-27T04:28:54.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240627042853_216819', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:28:54.850634076Z [2024-06-27T04:28:54.850+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240627042853_216819', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-06-27T04:28:54.906041776Z [2024-06-27T04:28:54.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240627042853_216819 exited with status queued for try_number 1 2024-06-27T04:28:54.910889291Z [2024-06-27T04:28:54.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c67fe6c-d11d-4c31-9cfb-33fbfd34bfb6 2024-06-27T04:28:56.427958687Z [2024-06-27T04:28:56.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:28:56.427985415Z [2024-06-27T04:28:56.425+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-06-27 04:28:53.830509+00:00, run_id=vdu_down_20240627042853_216819, run_start_date=2024-06-27 04:28:54.780406+00:00, run_end_date=2024-06-27 04:28:56.425602+00:00, run_duration=1.645196, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-27 04:28:53.830509+00:00, data_interval_end=2024-06-27 04:28:53.830509+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-06-27T04:28:56.433212244Z [2024-06-27T04:28:56.429+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-06-27T04:28:56.459970684Z [2024-06-27T04:28:56.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240627042853_216819 exited with status success for try_number 1 2024-06-27T04:28:56.465794258Z [2024-06-27T04:28:56.465+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240627042853_216819, map_index=-1, run_start_date=2024-06-27 04:28:55.655168+00:00, run_end_date=2024-06-27 04:28:56.136018+00:00, run_duration=0.48085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:28:54.846021+00:00, queued_by_job_id=2, pid=7880 2024-06-27T04:29:00.124912935Z [2024-06-27T04:29:00.124+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:29:00+00:00, run_after=2024-06-27T04:30:00+00:00 2024-06-27T04:29:00.144284926Z [2024-06-27T04:29:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:29:00+00:00, run_after=2024-06-27T04:30:00+00:00 2024-06-27T04:29:00.152881522Z [2024-06-27T04:29:00.151+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:29:00.230195686Z [2024-06-27T04:29:00.229+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:29:00.230222256Z 2024-06-27T04:29:00.230227050Z 2024-06-27T04:29:00.230238898Z 2024-06-27T04:29:00.230251366Z [2024-06-27T04:29:00.230+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:29:00.230377515Z [2024-06-27T04:29:00.230+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:29:00.230459839Z [2024-06-27T04:29:00.230+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:29:00.231090171Z [2024-06-27T04:29:00.230+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:29:00.231099870Z 2024-06-27T04:29:00.231104385Z 2024-06-27T04:29:00.231108725Z 2024-06-27T04:29:00.234662595Z [2024-06-27T04:29:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:29:00.234787891Z [2024-06-27T04:29:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:29:00.235003225Z [2024-06-27T04:29:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:29:00.235081121Z [2024-06-27T04:29:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:29:00.235303271Z [2024-06-27T04:29:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:29:00.235374650Z [2024-06-27T04:29:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:29:00.424243724Z [2024-06-27T04:29:00.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:28:00+00:00 exited with status queued for try_number 1 2024-06-27T04:29:00.424332678Z [2024-06-27T04:29:00.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:28:00+00:00 exited with status queued for try_number 1 2024-06-27T04:29:00.424479697Z [2024-06-27T04:29:00.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:28:00+00:00 exited with status queued for try_number 1 2024-06-27T04:29:00.433229038Z [2024-06-27T04:29:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 233e4567-0088-468d-b6f9-bcbd381b9f77 2024-06-27T04:29:00.433533915Z [2024-06-27T04:29:00.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95a5ee9c-bfca-4ec8-96a3-caa5bd9eeb10 2024-06-27T04:29:00.434490424Z [2024-06-27T04:29:00.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to b28e5d76-08eb-47a0-b597-f637858e6323 2024-06-27T04:29:01.604238489Z [2024-06-27T04:29:01.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:29:01.604896331Z [2024-06-27T04:29:01.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:28:00+00:00, run_id=scheduled__2024-06-27T04:28:00+00:00, run_start_date=2024-06-27 04:29:00.163546+00:00, run_end_date=2024-06-27 04:29:01.604358+00:00, run_duration=1.440812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:28:00+00:00, data_interval_end=2024-06-27 04:29:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:29:01.616675660Z [2024-06-27T04:29:01.616+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:29:00+00:00, run_after=2024-06-27T04:30:00+00:00 2024-06-27T04:29:02.788901796Z [2024-06-27T04:29:02.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:28:00+00:00 exited with status success for try_number 1 2024-06-27T04:29:02.795517724Z [2024-06-27T04:29:02.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:28:00+00:00, map_index=-1, run_start_date=2024-06-27 04:29:01.053763+00:00, run_end_date=2024-06-27 04:29:01.549849+00:00, run_duration=0.496086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:29:00.231863+00:00, queued_by_job_id=2, pid=7903 2024-06-27T04:29:03.850273907Z [2024-06-27T04:29:03.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:29:03.852902535Z [2024-06-27T04:29:03.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:28:00+00:00, run_id=scheduled__2024-06-27T04:28:00+00:00, run_start_date=2024-06-27 04:29:00.164928+00:00, run_end_date=2024-06-27 04:29:03.850230+00:00, run_duration=3.685302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:28:00+00:00, data_interval_end=2024-06-27 04:29:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:29:03.873831729Z [2024-06-27T04:29:03.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:29:00+00:00, run_after=2024-06-27T04:30:00+00:00 2024-06-27T04:29:03.882738359Z [2024-06-27T04:29:03.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:29:03.883310004Z [2024-06-27T04:29:03.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:28:00+00:00, run_id=scheduled__2024-06-27T04:28:00+00:00, run_start_date=2024-06-27 04:29:00.166112+00:00, run_end_date=2024-06-27 04:29:03.882549+00:00, run_duration=3.716437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:28:00+00:00, data_interval_end=2024-06-27 04:29:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:29:03.902608065Z [2024-06-27T04:29:03.901+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:29:00+00:00, run_after=2024-06-27T04:30:00+00:00 2024-06-27T04:29:03.954328703Z [2024-06-27T04:29:03.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:28:00+00:00 exited with status success for try_number 1 2024-06-27T04:29:03.962018845Z [2024-06-27T04:29:03.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:28:00+00:00, map_index=-1, run_start_date=2024-06-27 04:29:02.068410+00:00, run_end_date=2024-06-27 04:29:03.307368+00:00, run_duration=1.238958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:29:00.231863+00:00, queued_by_job_id=2, pid=7934 2024-06-27T04:29:05.075885480Z [2024-06-27T04:29:05.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:28:00+00:00 exited with status success for try_number 1 2024-06-27T04:29:05.087244630Z [2024-06-27T04:29:05.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:28:00+00:00, map_index=-1, run_start_date=2024-06-27 04:29:02.052650+00:00, run_end_date=2024-06-27 04:29:03.777015+00:00, run_duration=1.724365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:29:00.231863+00:00, queued_by_job_id=2, pid=7933 2024-06-27T04:30:00.703063953Z [2024-06-27T04:30:00.702+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:31:00+00:00 2024-06-27T04:30:00.713880959Z [2024-06-27T04:30:00.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:35:00+00:00 2024-06-27T04:30:00.719721880Z [2024-06-27T04:30:00.719+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:30:00.725328201Z [2024-06-27T04:30:00.725+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:30:00.736005933Z [2024-06-27T04:30:00.735+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:31:00+00:00 2024-06-27T04:30:00.844303322Z [2024-06-27T04:30:00.843+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T04:30:00.844326446Z 2024-06-27T04:30:00.844331251Z 2024-06-27T04:30:00.844335679Z 2024-06-27T04:30:00.844339454Z 2024-06-27T04:30:00.844343436Z 2024-06-27T04:30:00.844353619Z [2024-06-27T04:30:00.844+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:30:00.844416187Z [2024-06-27T04:30:00.844+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:30:00.844481165Z [2024-06-27T04:30:00.844+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:30:00.844567180Z [2024-06-27T04:30:00.844+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:30:00.844641492Z [2024-06-27T04:30:00.844+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:30:00.845313031Z [2024-06-27T04:30:00.845+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:30:00.845341747Z 2024-06-27T04:30:00.845345976Z 2024-06-27T04:30:00.845349383Z 2024-06-27T04:30:00.845352432Z 2024-06-27T04:30:00.845355619Z 2024-06-27T04:30:00.849280244Z [2024-06-27T04:30:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:30:00.849308026Z [2024-06-27T04:30:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:30:00.849514743Z [2024-06-27T04:30:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:30:00.849606340Z [2024-06-27T04:30:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:30:00.849773644Z [2024-06-27T04:30:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:30:00.849840124Z [2024-06-27T04:30:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:30:00.849983347Z [2024-06-27T04:30:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:30:00.850048349Z [2024-06-27T04:30:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:30:00.850202728Z [2024-06-27T04:30:00.850+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:30:00.850263946Z [2024-06-27T04:30:00.850+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:30:01.474788687Z [2024-06-27T04:30:01.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:01.474887546Z [2024-06-27T04:30:01.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:28:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:01.474893419Z [2024-06-27T04:30:01.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:29:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:01.474946722Z [2024-06-27T04:30:01.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:29:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:01.474994610Z [2024-06-27T04:30:01.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:29:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:01.491064594Z [2024-06-27T04:30:01.490+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b12cf28-861a-4b53-b253-3f2801791cb8 2024-06-27T04:30:01.491188788Z [2024-06-27T04:30:01.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1db79013-6d11-4c30-a1fc-2fa79c1a824d 2024-06-27T04:30:01.491274253Z [2024-06-27T04:30:01.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to 736a590b-3401-4435-9c08-f872a0d116e5 2024-06-27T04:30:01.491373717Z [2024-06-27T04:30:01.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to d269b83e-35cb-4b9e-b2e3-d86ef6d2b4e4 2024-06-27T04:30:01.491454730Z [2024-06-27T04:30:01.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to db3e21cf-5d92-407b-89f8-5079bc724b5d 2024-06-27T04:30:02.830445031Z [2024-06-27T04:30:02.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:30:02.830685007Z [2024-06-27T04:30:02.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:28:00+00:00, run_id=scheduled__2024-06-27T04:28:00+00:00, run_start_date=2024-06-27 04:30:00.746531+00:00, run_end_date=2024-06-27 04:30:02.830382+00:00, run_duration=2.083851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:28:00+00:00, data_interval_end=2024-06-27 04:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:30:02.850092219Z [2024-06-27T04:30:02.849+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:32:00+00:00 2024-06-27T04:30:02.929949298Z [2024-06-27T04:30:02.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:28:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:02.941341057Z [2024-06-27T04:30:02.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:28:00+00:00, map_index=-1, run_start_date=2024-06-27 04:30:02.043984+00:00, run_end_date=2024-06-27 04:30:02.478797+00:00, run_duration=0.434813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:00.846241+00:00, queued_by_job_id=2, pid=7980 2024-06-27T04:30:04.014694880Z [2024-06-27T04:30:04.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:30:04.015672147Z [2024-06-27T04:30:04.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:29:00+00:00, run_id=scheduled__2024-06-27T04:29:00+00:00, run_start_date=2024-06-27 04:30:00.747487+00:00, run_end_date=2024-06-27 04:30:04.014811+00:00, run_duration=3.267324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:29:00+00:00, data_interval_end=2024-06-27 04:30:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:30:04.041810300Z [2024-06-27T04:30:04.041+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:31:00+00:00 2024-06-27T04:30:04.105691946Z [2024-06-27T04:30:04.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:29:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:04.112392929Z [2024-06-27T04:30:04.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:29:00+00:00, map_index=-1, run_start_date=2024-06-27 04:30:02.173110+00:00, run_end_date=2024-06-27 04:30:02.656092+00:00, run_duration=0.482982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:00.846241+00:00, queued_by_job_id=2, pid=7981 2024-06-27T04:30:05.006187946Z [2024-06-27T04:30:05.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:30:05.006342483Z [2024-06-27T04:30:05.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:29:00+00:00, run_id=scheduled__2024-06-27T04:29:00+00:00, run_start_date=2024-06-27 04:30:00.749569+00:00, run_end_date=2024-06-27 04:30:05.006092+00:00, run_duration=4.256523, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:29:00+00:00, data_interval_end=2024-06-27 04:30:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:30:05.017450958Z [2024-06-27T04:30:05.017+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:31:00+00:00 2024-06-27T04:30:05.026878964Z [2024-06-27T04:30:05.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:30:05.027148291Z [2024-06-27T04:30:05.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:29:00+00:00, run_id=scheduled__2024-06-27T04:29:00+00:00, run_start_date=2024-06-27 04:30:00.748493+00:00, run_end_date=2024-06-27 04:30:05.026785+00:00, run_duration=4.278292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:29:00+00:00, data_interval_end=2024-06-27 04:30:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:30:05.039433959Z [2024-06-27T04:30:05.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:31:00+00:00 2024-06-27T04:30:05.069497922Z [2024-06-27T04:30:05.068+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:30:05.069533951Z 2024-06-27T04:30:05.069750004Z [2024-06-27T04:30:05.069+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:30:05.071285651Z [2024-06-27T04:30:05.070+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:30:05.071298014Z 2024-06-27T04:30:05.075408622Z [2024-06-27T04:30:05.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:30:05.075692860Z [2024-06-27T04:30:05.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:30:05.144366205Z [2024-06-27T04:30:05.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:05.144681227Z [2024-06-27T04:30:05.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:05.144977594Z [2024-06-27T04:30:05.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:29:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:05.145196914Z [2024-06-27T04:30:05.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:29:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:05.162676351Z [2024-06-27T04:30:05.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:25:00+00:00, map_index=-1, run_start_date=2024-06-27 04:30:03.769461+00:00, run_end_date=2024-06-27 04:30:04.239223+00:00, run_duration=0.469762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:00.846241+00:00, queued_by_job_id=2, pid=8050 2024-06-27T04:30:05.162785672Z [2024-06-27T04:30:05.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:29:00+00:00, map_index=-1, run_start_date=2024-06-27 04:30:03.473772+00:00, run_end_date=2024-06-27 04:30:04.815899+00:00, run_duration=1.342127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:00.846241+00:00, queued_by_job_id=2, pid=8022 2024-06-27T04:30:05.163117983Z [2024-06-27T04:30:05.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:29:00+00:00, map_index=-1, run_start_date=2024-06-27 04:30:03.262006+00:00, run_end_date=2024-06-27 04:30:04.914382+00:00, run_duration=1.652376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:00.846241+00:00, queued_by_job_id=2, pid=8021 2024-06-27T04:30:05.163301991Z [2024-06-27T04:30:05.163+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4010b31a-8754-4ba6-b82e-41db9d694cb1 2024-06-27T04:30:05.975612193Z [2024-06-27T04:30:05.974+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T04:30:08.151511189Z [2024-06-27T04:30:08.151+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:30:08.151539230Z 2024-06-27T04:30:08.152262084Z [2024-06-27T04:30:08.152+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:30:08.153747891Z [2024-06-27T04:30:08.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:30:08.153762203Z 2024-06-27T04:30:08.156729657Z [2024-06-27T04:30:08.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:30:08.156744879Z [2024-06-27T04:30:08.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:30:08.242435320Z [2024-06-27T04:30:08.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:08.242745326Z [2024-06-27T04:30:08.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:08.251957892Z [2024-06-27T04:30:08.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccee545f-50fe-4691-9077-b6b29304c494 2024-06-27T04:30:08.252315867Z [2024-06-27T04:30:08.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T04:25:00+00:00, map_index=-1, run_start_date=2024-06-27 04:30:06.786167+00:00, run_end_date=2024-06-27 04:30:07.217903+00:00, run_duration=0.431736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:05.071799+00:00, queued_by_job_id=2, pid=8071 2024-06-27T04:30:11.315485518Z [2024-06-27T04:30:11.314+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:30:11.315536294Z 2024-06-27T04:30:11.315562040Z [2024-06-27T04:30:11.315+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:30:11.316728975Z [2024-06-27T04:30:11.316+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:30:11.316787274Z 2024-06-27T04:30:11.320728182Z [2024-06-27T04:30:11.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:30:11.321079838Z [2024-06-27T04:30:11.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:30:11.383911184Z [2024-06-27T04:30:11.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:11.383977253Z [2024-06-27T04:30:11.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:11.391066483Z [2024-06-27T04:30:11.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24158208-e04d-4222-899e-98ab65e3bdb5 2024-06-27T04:30:11.391124613Z [2024-06-27T04:30:11.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:25:00+00:00, map_index=0, run_start_date=2024-06-27 04:30:10.204856+00:00, run_end_date=2024-06-27 04:30:10.539194+00:00, run_duration=0.334338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:08.154251+00:00, queued_by_job_id=2, pid=8083 2024-06-27T04:30:13.676217276Z [2024-06-27T04:30:13.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:30:13.676701445Z [2024-06-27T04:30:13.676+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:25:00+00:00, run_id=scheduled__2024-06-27T04:25:00+00:00, run_start_date=2024-06-27 04:30:00.745352+00:00, run_end_date=2024-06-27 04:30:13.676135+00:00, run_duration=12.930783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:25:00+00:00, data_interval_end=2024-06-27 04:30:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T04:30:13.682663451Z [2024-06-27T04:30:13.682+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:35:00+00:00 2024-06-27T04:30:13.719353229Z [2024-06-27T04:30:13.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:13.725422319Z [2024-06-27T04:30:13.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:25:00+00:00, map_index=-1, run_start_date=2024-06-27 04:30:13.030453+00:00, run_end_date=2024-06-27 04:30:13.444748+00:00, run_duration=0.414295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:11.317344+00:00, queued_by_job_id=2, pid=8095 2024-06-27T04:30:21.568641799Z [2024-06-27T04:30:21.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_80e4845a-be16-441c-a1a3-14390b87249c to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:31:00+00:00 2024-06-27T04:30:21.607543507Z [2024-06-27T04:30:21.607+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:30:21.607572423Z 2024-06-27T04:30:21.607576469Z [2024-06-27T04:30:21.607+0000] {scheduler_job.py:425} INFO - DAG vim_status_80e4845a-be16-441c-a1a3-14390b87249c has 0/16 running and queued tasks 2024-06-27T04:30:21.608157308Z [2024-06-27T04:30:21.607+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:30:21.608166064Z 2024-06-27T04:30:21.610599681Z [2024-06-27T04:30:21.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_80e4845a-be16-441c-a1a3-14390b87249c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:30:21.610613567Z [2024-06-27T04:30:21.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_80e4845a-be16-441c-a1a3-14390b87249c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:30:21.655494318Z [2024-06-27T04:30:21.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_80e4845a-be16-441c-a1a3-14390b87249c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:29:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:21.660096283Z [2024-06-27T04:30:21.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84335e16-8d44-4548-8fd4-d1352b955b58 2024-06-27T04:30:25.043486032Z [2024-06-27T04:30:25.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:30:25.043934655Z [2024-06-27T04:30:25.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_80e4845a-be16-441c-a1a3-14390b87249c, execution_date=2024-06-27 04:29:00+00:00, run_id=scheduled__2024-06-27T04:29:00+00:00, run_start_date=2024-06-27 04:30:21.578796+00:00, run_end_date=2024-06-27 04:30:25.043298+00:00, run_duration=3.464502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:29:00+00:00, data_interval_end=2024-06-27 04:30:00+00:00, dag_hash=1483f1321d95c0a4e3eb02b4bd7c77d5 2024-06-27T04:30:25.058683945Z [2024-06-27T04:30:25.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_80e4845a-be16-441c-a1a3-14390b87249c to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:31:00+00:00 2024-06-27T04:30:25.131940884Z [2024-06-27T04:30:25.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_80e4845a-be16-441c-a1a3-14390b87249c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:29:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:25.140290709Z [2024-06-27T04:30:25.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_80e4845a-be16-441c-a1a3-14390b87249c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:29:00+00:00, map_index=-1, run_start_date=2024-06-27 04:30:23.412505+00:00, run_end_date=2024-06-27 04:30:24.675092+00:00, run_duration=1.262587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:21.608666+00:00, queued_by_job_id=2, pid=8107 2024-06-27T04:30:28.131327716Z [2024-06-27T04:30:28.122+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:30:28.219253411Z [2024-06-27T04:30:28.213+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:30:28.219276233Z 2024-06-27T04:30:28.219279865Z [2024-06-27T04:30:28.213+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c has 0/16 running and queued tasks 2024-06-27T04:30:28.219283721Z [2024-06-27T04:30:28.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:30:28.219286909Z 2024-06-27T04:30:28.219293959Z [2024-06-27T04:30:28.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:30:28.219297836Z [2024-06-27T04:30:28.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:30:28.328236337Z [2024-06-27T04:30:28.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:29:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:28.338155282Z [2024-06-27T04:30:28.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to aaefa12a-6976-4083-8b59-131eac3bf6e7 2024-06-27T04:30:30.687075167Z [2024-06-27T04:30:30.686+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:35:00+00:00 2024-06-27T04:30:30.867062352Z [2024-06-27T04:30:30.866+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:30:30.867094883Z 2024-06-27T04:30:30.867202918Z [2024-06-27T04:30:30.867+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c has 0/16 running and queued tasks 2024-06-27T04:30:30.867781798Z [2024-06-27T04:30:30.867+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:30:30.867792175Z 2024-06-27T04:30:30.870245438Z [2024-06-27T04:30:30.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:30:30.870437799Z [2024-06-27T04:30:30.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:30:30.926344200Z [2024-06-27T04:30:30.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:30.932038286Z [2024-06-27T04:30:30.931+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12c551dc-0507-4d67-9913-c267c5b400d3 2024-06-27T04:30:32.759080257Z [2024-06-27T04:30:32.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:30:32.759122234Z [2024-06-27T04:30:32.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c, execution_date=2024-06-27 04:29:00+00:00, run_id=scheduled__2024-06-27T04:29:00+00:00, run_start_date=2024-06-27 04:30:28.136628+00:00, run_end_date=2024-06-27 04:30:32.757920+00:00, run_duration=4.621292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:29:00+00:00, data_interval_end=2024-06-27 04:30:00+00:00, dag_hash=a9067f5083e7be07ccfac6b279fb9d0e 2024-06-27T04:30:32.781699282Z [2024-06-27T04:30:32.781+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:31:00+00:00 2024-06-27T04:30:32.905649651Z [2024-06-27T04:30:32.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:29:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:32.911452710Z [2024-06-27T04:30:32.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:29:00+00:00, map_index=-1, run_start_date=2024-06-27 04:30:30.505378+00:00, run_end_date=2024-06-27 04:30:32.343229+00:00, run_duration=1.837851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:28.214672+00:00, queued_by_job_id=2, pid=8128 2024-06-27T04:30:34.023645770Z [2024-06-27T04:30:34.023+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:30:34.023679485Z 2024-06-27T04:30:34.023982500Z [2024-06-27T04:30:34.023+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c has 0/16 running and queued tasks 2024-06-27T04:30:34.024842531Z [2024-06-27T04:30:34.024+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:30:34.024859392Z 2024-06-27T04:30:34.027543226Z [2024-06-27T04:30:34.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c', task_id='split_metrics', run_id='scheduled__2024-06-27T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:30:34.027840769Z [2024-06-27T04:30:34.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c', 'split_metrics', 'scheduled__2024-06-27T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:30:34.083984445Z [2024-06-27T04:30:34.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c.split_metrics run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:34.084270803Z [2024-06-27T04:30:34.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:34.093207585Z [2024-06-27T04:30:34.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:25:00+00:00, map_index=-1, run_start_date=2024-06-27 04:30:32.706828+00:00, run_end_date=2024-06-27 04:30:33.210093+00:00, run_duration=0.503265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:30.868132+00:00, queued_by_job_id=2, pid=8149 2024-06-27T04:30:34.093612962Z [2024-06-27T04:30:34.093+0000] {scheduler_job.py:635} INFO - Setting external_id for to 539edd56-8dbd-4fab-a096-94f85ccd9e41 2024-06-27T04:30:37.152281588Z [2024-06-27T04:30:37.151+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:30:37.152350951Z 2024-06-27T04:30:37.152456527Z [2024-06-27T04:30:37.152+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c has 0/16 running and queued tasks 2024-06-27T04:30:37.153568682Z [2024-06-27T04:30:37.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:30:37.153593707Z 2024-06-27T04:30:37.157338178Z [2024-06-27T04:30:37.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:30:37.157594088Z [2024-06-27T04:30:37.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c', 'collect_metrics', 'scheduled__2024-06-27T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:30:37.224342310Z [2024-06-27T04:30:37.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c.collect_metrics run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:37.224603213Z [2024-06-27T04:30:37.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c.split_metrics run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:37.242769979Z [2024-06-27T04:30:37.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb07c81d-9700-4f13-a434-bb20f06d18c9 2024-06-27T04:30:37.242989352Z [2024-06-27T04:30:37.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c, task_id=split_metrics, run_id=scheduled__2024-06-27T04:25:00+00:00, map_index=-1, run_start_date=2024-06-27 04:30:35.721398+00:00, run_end_date=2024-06-27 04:30:36.066457+00:00, run_duration=0.345059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:34.025341+00:00, queued_by_job_id=2, pid=8183 2024-06-27T04:30:39.553049682Z [2024-06-27T04:30:39.552+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:30:39.553088845Z 2024-06-27T04:30:39.553192211Z [2024-06-27T04:30:39.552+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c has 0/16 running and queued tasks 2024-06-27T04:30:39.553882888Z [2024-06-27T04:30:39.553+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:30:39.553899065Z 2024-06-27T04:30:39.556007411Z [2024-06-27T04:30:39.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:30:39.556034530Z [2024-06-27T04:30:39.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c', 'send_prometheus', 'scheduled__2024-06-27T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:30:39.606807062Z [2024-06-27T04:30:39.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c.send_prometheus run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status queued for try_number 1 2024-06-27T04:30:39.606873787Z [2024-06-27T04:30:39.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c.collect_metrics run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:39.611808676Z [2024-06-27T04:30:39.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:25:00+00:00, map_index=0, run_start_date=2024-06-27 04:30:38.817091+00:00, run_end_date=2024-06-27 04:30:39.249152+00:00, run_duration=0.432061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:37.154140+00:00, queued_by_job_id=2, pid=8195 2024-06-27T04:30:39.611888795Z [2024-06-27T04:30:39.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d7b142b-3fc9-4819-a061-51c554c683ca 2024-06-27T04:30:42.243605487Z [2024-06-27T04:30:42.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:30:42.244231600Z [2024-06-27T04:30:42.243+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c, execution_date=2024-06-27 04:25:00+00:00, run_id=scheduled__2024-06-27T04:25:00+00:00, run_start_date=2024-06-27 04:30:30.729612+00:00, run_end_date=2024-06-27 04:30:42.243410+00:00, run_duration=11.513798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:25:00+00:00, data_interval_end=2024-06-27 04:30:00+00:00, dag_hash=4f3300252fba473aa4badf63a425a1b0 2024-06-27T04:30:42.254825966Z [2024-06-27T04:30:42.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c to 2024-06-27T04:30:00+00:00, run_after=2024-06-27T04:35:00+00:00 2024-06-27T04:30:42.304201924Z [2024-06-27T04:30:42.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c.send_prometheus run_id=scheduled__2024-06-27T04:25:00+00:00 exited with status success for try_number 1 2024-06-27T04:30:42.319131665Z [2024-06-27T04:30:42.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_80e4845a-be16-441c-a1a3-14390b87249c, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:25:00+00:00, map_index=-1, run_start_date=2024-06-27 04:30:41.201786+00:00, run_end_date=2024-06-27 04:30:41.510893+00:00, run_duration=0.309107, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:30:39.554249+00:00, queued_by_job_id=2, pid=8207 2024-06-27T04:31:00.671610448Z [2024-06-27T04:31:00.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_80e4845a-be16-441c-a1a3-14390b87249c to 2024-06-27T04:31:00+00:00, run_after=2024-06-27T04:32:00+00:00 2024-06-27T04:31:00.683167276Z [2024-06-27T04:31:00.682+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:31:00.693277043Z [2024-06-27T04:31:00.692+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:31:00.708174573Z [2024-06-27T04:31:00.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:31:00+00:00, run_after=2024-06-27T04:32:00+00:00 2024-06-27T04:31:00.723642467Z [2024-06-27T04:31:00.723+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:31:00+00:00, run_after=2024-06-27T04:32:00+00:00 2024-06-27T04:31:00.854748241Z [2024-06-27T04:31:00.854+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T04:31:00.854805209Z 2024-06-27T04:31:00.854826245Z 2024-06-27T04:31:00.854832782Z 2024-06-27T04:31:00.854858068Z 2024-06-27T04:31:00.854864061Z 2024-06-27T04:31:00.854869755Z [2024-06-27T04:31:00.854+0000] {scheduler_job.py:425} INFO - DAG vim_status_80e4845a-be16-441c-a1a3-14390b87249c has 0/16 running and queued tasks 2024-06-27T04:31:00.854886078Z [2024-06-27T04:31:00.854+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:31:00.855102739Z [2024-06-27T04:31:00.854+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c has 0/16 running and queued tasks 2024-06-27T04:31:00.855319790Z [2024-06-27T04:31:00.855+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:31:00.855540941Z [2024-06-27T04:31:00.855+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:31:00.856804798Z [2024-06-27T04:31:00.856+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:31:00.856830378Z 2024-06-27T04:31:00.856838101Z 2024-06-27T04:31:00.856845317Z 2024-06-27T04:31:00.856852176Z 2024-06-27T04:31:00.856858692Z 2024-06-27T04:31:00.864524338Z [2024-06-27T04:31:00.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_80e4845a-be16-441c-a1a3-14390b87249c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:31:00.865347483Z [2024-06-27T04:31:00.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_80e4845a-be16-441c-a1a3-14390b87249c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:31:00.865903526Z [2024-06-27T04:31:00.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:31:00.866288409Z [2024-06-27T04:31:00.865+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:31:00.866776076Z [2024-06-27T04:31:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:31:00.867115934Z [2024-06-27T04:31:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:31:00.867669422Z [2024-06-27T04:31:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:31:00.868987465Z [2024-06-27T04:31:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:31:00.869478039Z [2024-06-27T04:31:00.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:31:00.869849509Z [2024-06-27T04:31:00.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:31:01.414383758Z [2024-06-27T04:31:01.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_80e4845a-be16-441c-a1a3-14390b87249c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status queued for try_number 1 2024-06-27T04:31:01.414501541Z [2024-06-27T04:31:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status queued for try_number 1 2024-06-27T04:31:01.414617397Z [2024-06-27T04:31:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status queued for try_number 1 2024-06-27T04:31:01.414752561Z [2024-06-27T04:31:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status queued for try_number 1 2024-06-27T04:31:01.414900047Z [2024-06-27T04:31:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status queued for try_number 1 2024-06-27T04:31:01.445885342Z [2024-06-27T04:31:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to feb1de1d-bef6-47d1-85fd-736d9ba92ded 2024-06-27T04:31:01.445981577Z [2024-06-27T04:31:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37e5d9a0-108f-4875-b4cd-46fe15936d71 2024-06-27T04:31:01.446027113Z [2024-06-27T04:31:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to e38d86e1-0fa9-4b24-bddd-ac7fab757afc 2024-06-27T04:31:01.446127557Z [2024-06-27T04:31:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8024824e-ae94-4524-ba52-ffca13ac0a44 2024-06-27T04:31:01.453148690Z [2024-06-27T04:31:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to efdfbd97-11d9-4a73-90c8-2b5d181fa83a 2024-06-27T04:31:04.093264249Z [2024-06-27T04:31:04.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:31:04.093654662Z [2024-06-27T04:31:04.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:30:00+00:00, run_id=scheduled__2024-06-27T04:30:00+00:00, run_start_date=2024-06-27 04:31:00.737341+00:00, run_end_date=2024-06-27 04:31:04.093277+00:00, run_duration=3.355936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:30:00+00:00, data_interval_end=2024-06-27 04:31:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:31:04.103016840Z [2024-06-27T04:31:04.102+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:31:00+00:00, run_after=2024-06-27T04:32:00+00:00 2024-06-27T04:31:04.189573399Z [2024-06-27T04:31:04.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status success for try_number 1 2024-06-27T04:31:04.196167871Z [2024-06-27T04:31:04.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:30:00+00:00, map_index=-1, run_start_date=2024-06-27 04:31:02.230655+00:00, run_end_date=2024-06-27 04:31:03.034185+00:00, run_duration=0.80353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:31:00.859078+00:00, queued_by_job_id=2, pid=8222 2024-06-27T04:31:06.274292469Z [2024-06-27T04:31:06.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:31:06.274976927Z [2024-06-27T04:31:06.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c, execution_date=2024-06-27 04:30:00+00:00, run_id=scheduled__2024-06-27T04:30:00+00:00, run_start_date=2024-06-27 04:31:00.741084+00:00, run_end_date=2024-06-27 04:31:06.274032+00:00, run_duration=5.532948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:30:00+00:00, data_interval_end=2024-06-27 04:31:00+00:00, dag_hash=a9067f5083e7be07ccfac6b279fb9d0e 2024-06-27T04:31:06.290987869Z [2024-06-27T04:31:06.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c to 2024-06-27T04:31:00+00:00, run_after=2024-06-27T04:32:00+00:00 2024-06-27T04:31:06.300446038Z [2024-06-27T04:31:06.300+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:31:06.300919210Z [2024-06-27T04:31:06.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:30:00+00:00, run_id=scheduled__2024-06-27T04:30:00+00:00, run_start_date=2024-06-27 04:31:00.739916+00:00, run_end_date=2024-06-27 04:31:06.300309+00:00, run_duration=5.560393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:30:00+00:00, data_interval_end=2024-06-27 04:31:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:31:06.311446911Z [2024-06-27T04:31:06.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:31:00+00:00, run_after=2024-06-27T04:32:00+00:00 2024-06-27T04:31:06.398145828Z [2024-06-27T04:31:06.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status success for try_number 1 2024-06-27T04:31:06.398185364Z [2024-06-27T04:31:06.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status success for try_number 1 2024-06-27T04:31:06.398196226Z [2024-06-27T04:31:06.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:30:00+00:00, map_index=-1, run_start_date=2024-06-27 04:31:03.372134+00:00, run_end_date=2024-06-27 04:31:05.260617+00:00, run_duration=1.888483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:31:00.859078+00:00, queued_by_job_id=2, pid=8245 2024-06-27T04:31:06.398204199Z [2024-06-27T04:31:06.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:30:00+00:00, map_index=-1, run_start_date=2024-06-27 04:31:04.224444+00:00, run_end_date=2024-06-27 04:31:05.544748+00:00, run_duration=1.320304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:31:00.859078+00:00, queued_by_job_id=2, pid=8283 2024-06-27T04:31:07.691147288Z [2024-06-27T04:31:07.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:31:07.691486398Z [2024-06-27T04:31:07.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_80e4845a-be16-441c-a1a3-14390b87249c, execution_date=2024-06-27 04:30:00+00:00, run_id=scheduled__2024-06-27T04:30:00+00:00, run_start_date=2024-06-27 04:31:00.738716+00:00, run_end_date=2024-06-27 04:31:07.690919+00:00, run_duration=6.952203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:30:00+00:00, data_interval_end=2024-06-27 04:31:00+00:00, dag_hash=1483f1321d95c0a4e3eb02b4bd7c77d5 2024-06-27T04:31:07.701914080Z [2024-06-27T04:31:07.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_80e4845a-be16-441c-a1a3-14390b87249c to 2024-06-27T04:31:00+00:00, run_after=2024-06-27T04:32:00+00:00 2024-06-27T04:31:07.719443594Z [2024-06-27T04:31:07.718+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:31:07.719909822Z [2024-06-27T04:31:07.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:30:00+00:00, run_id=scheduled__2024-06-27T04:30:00+00:00, run_start_date=2024-06-27 04:31:00.742197+00:00, run_end_date=2024-06-27 04:31:07.719240+00:00, run_duration=6.977043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:30:00+00:00, data_interval_end=2024-06-27 04:31:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:31:07.735348475Z [2024-06-27T04:31:07.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:31:00+00:00, run_after=2024-06-27T04:32:00+00:00 2024-06-27T04:31:07.777525459Z [2024-06-27T04:31:07.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_80e4845a-be16-441c-a1a3-14390b87249c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status success for try_number 1 2024-06-27T04:31:07.777962721Z [2024-06-27T04:31:07.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status success for try_number 1 2024-06-27T04:31:07.788515126Z [2024-06-27T04:31:07.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_80e4845a-be16-441c-a1a3-14390b87249c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:30:00+00:00, map_index=-1, run_start_date=2024-06-27 04:31:04.148554+00:00, run_end_date=2024-06-27 04:31:07.125913+00:00, run_duration=2.977359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:31:00.859078+00:00, queued_by_job_id=2, pid=8282 2024-06-27T04:31:07.789349187Z [2024-06-27T04:31:07.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:30:00+00:00, map_index=-1, run_start_date=2024-06-27 04:31:04.294465+00:00, run_end_date=2024-06-27 04:31:07.501726+00:00, run_duration=3.207261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:31:00.859078+00:00, queued_by_job_id=2, pid=8284 2024-06-27T04:32:00.591562626Z [2024-06-27T04:32:00.590+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:32:00+00:00, run_after=2024-06-27T04:33:00+00:00 2024-06-27T04:32:00.602017017Z [2024-06-27T04:32:00.601+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:32:00.616219646Z [2024-06-27T04:32:00.615+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_80e4845a-be16-441c-a1a3-14390b87249c to 2024-06-27T04:32:00+00:00, run_after=2024-06-27T04:33:00+00:00 2024-06-27T04:32:00.640487483Z [2024-06-27T04:32:00.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:32:00+00:00, run_after=2024-06-27T04:33:00+00:00 2024-06-27T04:32:00.660590233Z [2024-06-27T04:32:00.660+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:32:00.670641784Z [2024-06-27T04:32:00.669+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:32:00.819607933Z [2024-06-27T04:32:00.819+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-06-27T04:32:00.819643640Z 2024-06-27T04:32:00.819650833Z 2024-06-27T04:32:00.819656685Z 2024-06-27T04:32:00.819662505Z 2024-06-27T04:32:00.819668074Z 2024-06-27T04:32:00.819673709Z 2024-06-27T04:32:00.819780516Z [2024-06-27T04:32:00.819+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:32:00.820001112Z [2024-06-27T04:32:00.819+0000] {scheduler_job.py:425} INFO - DAG vim_status_80e4845a-be16-441c-a1a3-14390b87249c has 0/16 running and queued tasks 2024-06-27T04:32:00.820286220Z [2024-06-27T04:32:00.820+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c has 0/16 running and queued tasks 2024-06-27T04:32:00.820525681Z [2024-06-27T04:32:00.820+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:32:00.820875164Z [2024-06-27T04:32:00.820+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:32:00.821133173Z [2024-06-27T04:32:00.820+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:32:00.822396154Z [2024-06-27T04:32:00.822+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:32:00.822413879Z 2024-06-27T04:32:00.822430248Z 2024-06-27T04:32:00.822450808Z 2024-06-27T04:32:00.822455298Z 2024-06-27T04:32:00.822460330Z 2024-06-27T04:32:00.822464708Z 2024-06-27T04:32:00.830570942Z [2024-06-27T04:32:00.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:32:00.830887897Z [2024-06-27T04:32:00.830+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:32:00.831332712Z [2024-06-27T04:32:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_80e4845a-be16-441c-a1a3-14390b87249c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:32:00.831551803Z [2024-06-27T04:32:00.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_80e4845a-be16-441c-a1a3-14390b87249c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:32:00.831994533Z [2024-06-27T04:32:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:32:00.832265373Z [2024-06-27T04:32:00.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:32:00.832660847Z [2024-06-27T04:32:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:32:00.832918172Z [2024-06-27T04:32:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:32:00.833388242Z [2024-06-27T04:32:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:32:00.833684399Z [2024-06-27T04:32:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:32:00.834103770Z [2024-06-27T04:32:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:32:00.834352953Z [2024-06-27T04:32:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:32:01.625525015Z [2024-06-27T04:32:01.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status queued for try_number 1 2024-06-27T04:32:01.625678867Z [2024-06-27T04:32:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_80e4845a-be16-441c-a1a3-14390b87249c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status queued for try_number 1 2024-06-27T04:32:01.625812579Z [2024-06-27T04:32:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status queued for try_number 1 2024-06-27T04:32:01.625923848Z [2024-06-27T04:32:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status queued for try_number 1 2024-06-27T04:32:01.626026869Z [2024-06-27T04:32:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status queued for try_number 1 2024-06-27T04:32:01.626240293Z [2024-06-27T04:32:01.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status queued for try_number 1 2024-06-27T04:32:01.654130858Z [2024-06-27T04:32:01.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to c854fe5e-8abb-46b3-a23c-78fe1a50a276 2024-06-27T04:32:01.654278623Z [2024-06-27T04:32:01.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2decde6f-2894-42ec-b414-5acade5a5cae 2024-06-27T04:32:01.654411965Z [2024-06-27T04:32:01.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06556fd6-27b8-40e7-aab8-ca3226db4cc8 2024-06-27T04:32:01.654558244Z [2024-06-27T04:32:01.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6529125-c888-4328-bbb6-e45024382a6b 2024-06-27T04:32:01.654703111Z [2024-06-27T04:32:01.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to 246c43ff-7128-4cc0-b5b5-922a375f8ce4 2024-06-27T04:32:01.654824996Z [2024-06-27T04:32:01.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to b61e228a-899e-4eef-aa1b-08d17dff8635 2024-06-27T04:32:03.980172847Z [2024-06-27T04:32:03.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:32:03.980591722Z [2024-06-27T04:32:03.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:30:00+00:00, run_id=scheduled__2024-06-27T04:30:00+00:00, run_start_date=2024-06-27 04:32:00.685870+00:00, run_end_date=2024-06-27 04:32:03.980101+00:00, run_duration=3.294231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:30:00+00:00, data_interval_end=2024-06-27 04:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:32:03.992058600Z [2024-06-27T04:32:03.991+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:32:00+00:00, run_after=2024-06-27T04:34:00+00:00 2024-06-27T04:32:04.019468197Z [2024-06-27T04:32:04.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:32:04.020154637Z [2024-06-27T04:32:04.019+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:31:00+00:00, run_id=scheduled__2024-06-27T04:31:00+00:00, run_start_date=2024-06-27 04:32:00.688261+00:00, run_end_date=2024-06-27 04:32:04.019385+00:00, run_duration=3.331124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:31:00+00:00, data_interval_end=2024-06-27 04:32:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:32:04.071537563Z [2024-06-27T04:32:04.071+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:32:00+00:00, run_after=2024-06-27T04:33:00+00:00 2024-06-27T04:32:04.247680996Z [2024-06-27T04:32:04.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status success for try_number 1 2024-06-27T04:32:04.247890975Z [2024-06-27T04:32:04.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status success for try_number 1 2024-06-27T04:32:04.269963740Z [2024-06-27T04:32:04.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:30:00+00:00, map_index=-1, run_start_date=2024-06-27 04:32:02.600530+00:00, run_end_date=2024-06-27 04:32:03.713703+00:00, run_duration=1.113173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:32:00.825169+00:00, queued_by_job_id=2, pid=8341 2024-06-27T04:32:04.270438537Z [2024-06-27T04:32:04.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:31:00+00:00, map_index=-1, run_start_date=2024-06-27 04:32:02.570752+00:00, run_end_date=2024-06-27 04:32:03.307982+00:00, run_duration=0.73723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:32:00.825169+00:00, queued_by_job_id=2, pid=8340 2024-06-27T04:32:05.402289760Z [2024-06-27T04:32:05.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_80e4845a-be16-441c-a1a3-14390b87249c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status failed for try_number 1 2024-06-27T04:32:05.402858128Z [2024-06-27T04:32:05.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status failed for try_number 1 2024-06-27T04:32:05.409719311Z [2024-06-27T04:32:05.409+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_80e4845a-be16-441c-a1a3-14390b87249c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:31:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:32:00.825169+00:00, queued_by_job_id=2, pid=None 2024-06-27T04:32:05.410261112Z [2024-06-27T04:32:05.410+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T04:32:05.412577863Z [2024-06-27T04:32:05.412+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T04:32:05.426781033Z [2024-06-27T04:32:05.426+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_80e4845a-be16-441c-a1a3-14390b87249c, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240627T043100, start_date=, end_date=20240627T043205 2024-06-27T04:32:05.441009499Z [2024-06-27T04:32:05.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:31:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:32:00.825169+00:00, queued_by_job_id=2, pid=None 2024-06-27T04:32:05.441526744Z [2024-06-27T04:32:05.441+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T04:32:05.443985072Z [2024-06-27T04:32:05.443+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T04:32:05.456234577Z [2024-06-27T04:32:05.455+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240627T043100, start_date=, end_date=20240627T043205 2024-06-27T04:32:06.513553046Z [2024-06-27T04:32:06.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:32:06.513952324Z [2024-06-27T04:32:06.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:31:00+00:00, run_id=scheduled__2024-06-27T04:31:00+00:00, run_start_date=2024-06-27 04:32:00.692508+00:00, run_end_date=2024-06-27 04:32:06.513520+00:00, run_duration=5.821012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:31:00+00:00, data_interval_end=2024-06-27 04:32:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:32:06.527756647Z [2024-06-27T04:32:06.527+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:32:00+00:00, run_after=2024-06-27T04:33:00+00:00 2024-06-27T04:32:06.550236719Z [2024-06-27T04:32:06.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:32:06.550826494Z [2024-06-27T04:32:06.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:31:00+00:00, run_id=scheduled__2024-06-27T04:31:00+00:00, run_start_date=2024-06-27 04:32:00.695230+00:00, run_end_date=2024-06-27 04:32:06.550140+00:00, run_duration=5.85491, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:31:00+00:00, data_interval_end=2024-06-27 04:32:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:32:06.566893685Z [2024-06-27T04:32:06.566+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:32:00+00:00, run_after=2024-06-27T04:33:00+00:00 2024-06-27T04:32:06.634761367Z [2024-06-27T04:32:06.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status success for try_number 1 2024-06-27T04:32:06.634806719Z [2024-06-27T04:32:06.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status success for try_number 1 2024-06-27T04:32:06.644141503Z [2024-06-27T04:32:06.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:31:00+00:00, map_index=-1, run_start_date=2024-06-27 04:32:04.550838+00:00, run_end_date=2024-06-27 04:32:06.010205+00:00, run_duration=1.459367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:32:00.825169+00:00, queued_by_job_id=2, pid=8399 2024-06-27T04:32:06.644287052Z [2024-06-27T04:32:06.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:31:00+00:00, map_index=-1, run_start_date=2024-06-27 04:32:04.659209+00:00, run_end_date=2024-06-27 04:32:06.354114+00:00, run_duration=1.694905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:32:00.825169+00:00, queued_by_job_id=2, pid=8400 2024-06-27T04:32:16.376890678Z [2024-06-27T04:32:16.374+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-06-27T04:32:16.376919397Z 2024-06-27T04:32:16.376922960Z 2024-06-27T04:32:16.376926124Z [2024-06-27T04:32:16.374+0000] {scheduler_job.py:425} INFO - DAG vim_status_80e4845a-be16-441c-a1a3-14390b87249c has 0/16 running and queued tasks 2024-06-27T04:32:16.376929207Z [2024-06-27T04:32:16.374+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c has 0/16 running and queued tasks 2024-06-27T04:32:16.376932717Z [2024-06-27T04:32:16.375+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:32:16.376935991Z 2024-06-27T04:32:16.376939068Z 2024-06-27T04:32:16.389887235Z [2024-06-27T04:32:16.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_80e4845a-be16-441c-a1a3-14390b87249c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:31:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:32:16.389914785Z [2024-06-27T04:32:16.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_80e4845a-be16-441c-a1a3-14390b87249c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:32:16.389918244Z [2024-06-27T04:32:16.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:31:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:32:16.389921477Z [2024-06-27T04:32:16.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:32:16.594477966Z [2024-06-27T04:32:16.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_80e4845a-be16-441c-a1a3-14390b87249c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status queued for try_number 2 2024-06-27T04:32:16.594512863Z [2024-06-27T04:32:16.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status queued for try_number 2 2024-06-27T04:32:16.610014606Z [2024-06-27T04:32:16.609+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9eae634e-5b5a-4e56-b93f-f912196bb09b 2024-06-27T04:32:16.610071914Z [2024-06-27T04:32:16.609+0000] {scheduler_job.py:635} INFO - Setting external_id for to 142371aa-cdc2-4e0b-96f0-bd115cd340f6 2024-06-27T04:32:19.369526567Z [2024-06-27T04:32:19.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_80e4845a-be16-441c-a1a3-14390b87249c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status failed for try_number 2 2024-06-27T04:32:19.369573398Z [2024-06-27T04:32:19.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:31:00+00:00 exited with status failed for try_number 2 2024-06-27T04:32:19.376608811Z [2024-06-27T04:32:19.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_80e4845a-be16-441c-a1a3-14390b87249c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:31:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 04:32:05.415444+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:32:16.376671+00:00, queued_by_job_id=2, pid=None 2024-06-27T04:32:19.377195433Z [2024-06-27T04:32:19.376+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T04:32:19.379328394Z [2024-06-27T04:32:19.379+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T04:32:19.393435577Z [2024-06-27T04:32:19.393+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_80e4845a-be16-441c-a1a3-14390b87249c, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240627T043100, start_date=, end_date=20240627T043219 2024-06-27T04:32:19.400916594Z [2024-06-27T04:32:19.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:31:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 04:32:05.446835+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:32:16.376671+00:00, queued_by_job_id=2, pid=None 2024-06-27T04:32:19.403353454Z [2024-06-27T04:32:19.403+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T04:32:19.406243340Z [2024-06-27T04:32:19.405+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T04:32:19.424270501Z [2024-06-27T04:32:19.423+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240627T043100, start_date=, end_date=20240627T043219 2024-06-27T04:32:20.476360849Z [2024-06-27T04:32:20.475+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T04:32:20.476554603Z [2024-06-27T04:32:20.476+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_80e4845a-be16-441c-a1a3-14390b87249c, execution_date=2024-06-27 04:31:00+00:00, run_id=scheduled__2024-06-27T04:31:00+00:00, run_start_date=2024-06-27 04:32:00.691147+00:00, run_end_date=2024-06-27 04:32:20.476239+00:00, run_duration=19.785092, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:31:00+00:00, data_interval_end=2024-06-27 04:32:00+00:00, dag_hash=1483f1321d95c0a4e3eb02b4bd7c77d5 2024-06-27T04:32:20.485161365Z [2024-06-27T04:32:20.484+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_80e4845a-be16-441c-a1a3-14390b87249c to 2024-06-27T04:32:00+00:00, run_after=2024-06-27T04:33:00+00:00 2024-06-27T04:32:20.493692905Z [2024-06-27T04:32:20.493+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T04:32:20.493909831Z [2024-06-27T04:32:20.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c, execution_date=2024-06-27 04:31:00+00:00, run_id=scheduled__2024-06-27T04:31:00+00:00, run_start_date=2024-06-27 04:32:00.693861+00:00, run_end_date=2024-06-27 04:32:20.493551+00:00, run_duration=19.79969, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:31:00+00:00, data_interval_end=2024-06-27 04:32:00+00:00, dag_hash=a9067f5083e7be07ccfac6b279fb9d0e 2024-06-27T04:32:20.503214858Z [2024-06-27T04:32:20.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_80e4845a-be16-441c-a1a3-14390b87249c to 2024-06-27T04:32:00+00:00, run_after=2024-06-27T04:33:00+00:00 2024-06-27T04:32:54.926919794Z [2024-06-27T04:32:54.926+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:32:54.926959295Z 2024-06-27T04:32:54.927318533Z [2024-06-27T04:32:54.927+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-06-27T04:32:54.928310105Z [2024-06-27T04:32:54.927+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:32:54.928327451Z 2024-06-27T04:32:54.932291520Z [2024-06-27T04:32:54.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240627043253_255289', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:32:54.932733953Z [2024-06-27T04:32:54.932+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240627043253_255289', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-06-27T04:32:55.015338010Z [2024-06-27T04:32:55.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240627043253_255289 exited with status queued for try_number 1 2024-06-27T04:32:55.025697885Z [2024-06-27T04:32:55.025+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4109d98-878c-4339-a6e3-283028b9585d 2024-06-27T04:32:56.169166303Z [2024-06-27T04:32:56.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:32:56.169610150Z [2024-06-27T04:32:56.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-06-27 04:32:53.903319+00:00, run_id=vdu_down_20240627043253_255289, run_start_date=2024-06-27 04:32:54.875905+00:00, run_end_date=2024-06-27 04:32:56.169267+00:00, run_duration=1.293362, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-27 04:32:53.903319+00:00, data_interval_end=2024-06-27 04:32:53.903319+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-06-27T04:32:56.172471818Z [2024-06-27T04:32:56.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-06-27T04:32:56.209867249Z [2024-06-27T04:32:56.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240627043253_255289 exited with status success for try_number 1 2024-06-27T04:32:56.216290232Z [2024-06-27T04:32:56.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240627043253_255289, map_index=-1, run_start_date=2024-06-27 04:32:55.639215+00:00, run_end_date=2024-06-27 04:32:56.016868+00:00, run_duration=0.377653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:32:54.929067+00:00, queued_by_job_id=2, pid=8490 2024-06-27T04:33:01.014818218Z [2024-06-27T04:33:01.014+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:33:00+00:00, run_after=2024-06-27T04:34:00+00:00 2024-06-27T04:33:01.031905641Z [2024-06-27T04:33:01.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:33:00+00:00, run_after=2024-06-27T04:34:00+00:00 2024-06-27T04:33:01.039253705Z [2024-06-27T04:33:01.038+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:33:01.163066306Z [2024-06-27T04:33:01.162+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:33:01.163098899Z 2024-06-27T04:33:01.163105814Z 2024-06-27T04:33:01.163111053Z 2024-06-27T04:33:01.163223464Z [2024-06-27T04:33:01.162+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:33:01.163415395Z [2024-06-27T04:33:01.163+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:33:01.163596170Z [2024-06-27T04:33:01.163+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:33:01.164241429Z [2024-06-27T04:33:01.164+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:33:01.164265512Z 2024-06-27T04:33:01.164269033Z 2024-06-27T04:33:01.164272232Z 2024-06-27T04:33:01.167321651Z [2024-06-27T04:33:01.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:33:01.167530623Z [2024-06-27T04:33:01.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:33:01.167851383Z [2024-06-27T04:33:01.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:33:01.168169478Z [2024-06-27T04:33:01.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:33:01.168508787Z [2024-06-27T04:33:01.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:33:01.168708757Z [2024-06-27T04:33:01.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:33:01.410503592Z [2024-06-27T04:33:01.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:32:00+00:00 exited with status queued for try_number 1 2024-06-27T04:33:01.410889143Z [2024-06-27T04:33:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:32:00+00:00 exited with status queued for try_number 1 2024-06-27T04:33:01.411059806Z [2024-06-27T04:33:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:32:00+00:00 exited with status queued for try_number 1 2024-06-27T04:33:01.419474578Z [2024-06-27T04:33:01.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24e5b8c4-7bb1-49c5-8e69-e92068b39763 2024-06-27T04:33:01.419776411Z [2024-06-27T04:33:01.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb0a5b0e-04fe-4bec-ab6e-47a22f8c4957 2024-06-27T04:33:01.419995043Z [2024-06-27T04:33:01.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4110849-e7de-4805-a0e5-f3222273f141 2024-06-27T04:33:02.641725226Z [2024-06-27T04:33:02.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:33:02.645393456Z [2024-06-27T04:33:02.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:32:00+00:00, run_id=scheduled__2024-06-27T04:32:00+00:00, run_start_date=2024-06-27 04:33:01.050990+00:00, run_end_date=2024-06-27 04:33:02.644876+00:00, run_duration=1.593886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:32:00+00:00, data_interval_end=2024-06-27 04:33:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:33:02.673135005Z [2024-06-27T04:33:02.668+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:33:00+00:00, run_after=2024-06-27T04:34:00+00:00 2024-06-27T04:33:02.798870621Z [2024-06-27T04:33:02.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:32:00+00:00 exited with status success for try_number 1 2024-06-27T04:33:02.820302698Z [2024-06-27T04:33:02.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:32:00+00:00, map_index=-1, run_start_date=2024-06-27 04:33:02.043372+00:00, run_end_date=2024-06-27 04:33:02.436910+00:00, run_duration=0.393538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:33:01.165033+00:00, queued_by_job_id=2, pid=8512 2024-06-27T04:33:06.143542655Z [2024-06-27T04:33:06.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:33:06.143981848Z [2024-06-27T04:33:06.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:32:00+00:00, run_id=scheduled__2024-06-27T04:32:00+00:00, run_start_date=2024-06-27 04:33:01.052360+00:00, run_end_date=2024-06-27 04:33:06.143402+00:00, run_duration=5.091042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:32:00+00:00, data_interval_end=2024-06-27 04:33:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:33:06.162628561Z [2024-06-27T04:33:06.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:33:00+00:00, run_after=2024-06-27T04:34:00+00:00 2024-06-27T04:33:06.173061492Z [2024-06-27T04:33:06.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:33:06.173250650Z [2024-06-27T04:33:06.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:32:00+00:00, run_id=scheduled__2024-06-27T04:32:00+00:00, run_start_date=2024-06-27 04:33:01.053507+00:00, run_end_date=2024-06-27 04:33:06.172872+00:00, run_duration=5.119365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:32:00+00:00, data_interval_end=2024-06-27 04:33:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:33:06.182680197Z [2024-06-27T04:33:06.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:33:00+00:00, run_after=2024-06-27T04:34:00+00:00 2024-06-27T04:33:06.229013682Z [2024-06-27T04:33:06.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:32:00+00:00 exited with status success for try_number 1 2024-06-27T04:33:06.229067526Z [2024-06-27T04:33:06.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:32:00+00:00 exited with status success for try_number 1 2024-06-27T04:33:06.240461082Z [2024-06-27T04:33:06.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:32:00+00:00, map_index=-1, run_start_date=2024-06-27 04:33:03.453517+00:00, run_end_date=2024-06-27 04:33:05.427889+00:00, run_duration=1.974372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:33:01.165033+00:00, queued_by_job_id=2, pid=8543 2024-06-27T04:33:06.240649986Z [2024-06-27T04:33:06.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:32:00+00:00, map_index=-1, run_start_date=2024-06-27 04:33:03.252042+00:00, run_end_date=2024-06-27 04:33:05.628804+00:00, run_duration=2.376762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:33:01.165033+00:00, queued_by_job_id=2, pid=8542 2024-06-27T04:34:00.954701940Z [2024-06-27T04:34:00.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:34:00+00:00, run_after=2024-06-27T04:35:00+00:00 2024-06-27T04:34:00.965644008Z [2024-06-27T04:34:00.965+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:34:00.982209127Z [2024-06-27T04:34:00.981+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:34:00+00:00, run_after=2024-06-27T04:35:00+00:00 2024-06-27T04:34:00.992479017Z [2024-06-27T04:34:00.992+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:34:01.148133414Z [2024-06-27T04:34:01.147+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:34:01.148153302Z 2024-06-27T04:34:01.148157673Z 2024-06-27T04:34:01.148161018Z 2024-06-27T04:34:01.148175340Z 2024-06-27T04:34:01.148277956Z [2024-06-27T04:34:01.148+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:34:01.148408768Z [2024-06-27T04:34:01.148+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:34:01.148537778Z [2024-06-27T04:34:01.148+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:34:01.148664205Z [2024-06-27T04:34:01.148+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:34:01.149624217Z [2024-06-27T04:34:01.149+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:34:01.149637188Z 2024-06-27T04:34:01.149640976Z 2024-06-27T04:34:01.149644080Z 2024-06-27T04:34:01.149647294Z 2024-06-27T04:34:01.160849771Z [2024-06-27T04:34:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:34:01.160988698Z [2024-06-27T04:34:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:34:01.161344742Z [2024-06-27T04:34:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:34:01.161514654Z [2024-06-27T04:34:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:34:01.161789820Z [2024-06-27T04:34:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:34:01.161952446Z [2024-06-27T04:34:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:34:01.162153917Z [2024-06-27T04:34:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:34:01.162308738Z [2024-06-27T04:34:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:34:01.514164910Z [2024-06-27T04:34:01.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:32:00+00:00 exited with status queued for try_number 1 2024-06-27T04:34:01.514461882Z [2024-06-27T04:34:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:33:00+00:00 exited with status queued for try_number 1 2024-06-27T04:34:01.514604262Z [2024-06-27T04:34:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:33:00+00:00 exited with status queued for try_number 1 2024-06-27T04:34:01.514742628Z [2024-06-27T04:34:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:33:00+00:00 exited with status queued for try_number 1 2024-06-27T04:34:01.532896827Z [2024-06-27T04:34:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 744eed8e-83af-48cd-b0a9-541b5c9cb5ce 2024-06-27T04:34:01.533086011Z [2024-06-27T04:34:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38b576d0-9ce4-4e63-b852-f6328191c84c 2024-06-27T04:34:01.533332675Z [2024-06-27T04:34:01.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c19df35-8616-407e-912a-9f7f5bbf3165 2024-06-27T04:34:01.533490304Z [2024-06-27T04:34:01.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed7439e0-4f0e-4c24-a4bd-b482274eb8ba 2024-06-27T04:34:02.813234162Z [2024-06-27T04:34:02.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:34:02.813648233Z [2024-06-27T04:34:02.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:32:00+00:00, run_id=scheduled__2024-06-27T04:32:00+00:00, run_start_date=2024-06-27 04:34:01.011713+00:00, run_end_date=2024-06-27 04:34:02.813168+00:00, run_duration=1.801455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:32:00+00:00, data_interval_end=2024-06-27 04:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:34:02.837793034Z [2024-06-27T04:34:02.837+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:34:00+00:00, run_after=2024-06-27T04:36:00+00:00 2024-06-27T04:34:02.967010596Z [2024-06-27T04:34:02.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:32:00+00:00 exited with status success for try_number 1 2024-06-27T04:34:02.972090729Z [2024-06-27T04:34:02.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:32:00+00:00, map_index=-1, run_start_date=2024-06-27 04:34:01.972167+00:00, run_end_date=2024-06-27 04:34:02.527607+00:00, run_duration=0.55544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:34:01.152146+00:00, queued_by_job_id=2, pid=8588 2024-06-27T04:34:03.118524522Z [2024-06-27T04:34:03.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:34:03.118916704Z [2024-06-27T04:34:03.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:33:00+00:00, run_id=scheduled__2024-06-27T04:33:00+00:00, run_start_date=2024-06-27 04:34:01.015840+00:00, run_end_date=2024-06-27 04:34:03.118625+00:00, run_duration=2.102785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:33:00+00:00, data_interval_end=2024-06-27 04:34:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:34:03.135616307Z [2024-06-27T04:34:03.135+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:34:00+00:00, run_after=2024-06-27T04:35:00+00:00 2024-06-27T04:34:03.200213672Z [2024-06-27T04:34:03.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:33:00+00:00 exited with status success for try_number 1 2024-06-27T04:34:03.209322293Z [2024-06-27T04:34:03.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:33:00+00:00, map_index=-1, run_start_date=2024-06-27 04:34:02.172996+00:00, run_end_date=2024-06-27 04:34:02.951750+00:00, run_duration=0.778754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:34:01.152146+00:00, queued_by_job_id=2, pid=8589 2024-06-27T04:34:06.099513708Z [2024-06-27T04:34:06.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:34:06.100153509Z [2024-06-27T04:34:06.099+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:33:00+00:00, run_id=scheduled__2024-06-27T04:33:00+00:00, run_start_date=2024-06-27 04:34:01.019413+00:00, run_end_date=2024-06-27 04:34:06.099769+00:00, run_duration=5.080356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:33:00+00:00, data_interval_end=2024-06-27 04:34:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:34:06.110891506Z [2024-06-27T04:34:06.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:34:00+00:00, run_after=2024-06-27T04:35:00+00:00 2024-06-27T04:34:06.120241379Z [2024-06-27T04:34:06.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:34:06.121467254Z [2024-06-27T04:34:06.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:33:00+00:00, run_id=scheduled__2024-06-27T04:33:00+00:00, run_start_date=2024-06-27 04:34:01.021828+00:00, run_end_date=2024-06-27 04:34:06.120929+00:00, run_duration=5.099101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:33:00+00:00, data_interval_end=2024-06-27 04:34:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:34:06.150675470Z [2024-06-27T04:34:06.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:34:00+00:00, run_after=2024-06-27T04:35:00+00:00 2024-06-27T04:34:06.194658183Z [2024-06-27T04:34:06.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:33:00+00:00 exited with status success for try_number 1 2024-06-27T04:34:06.195076203Z [2024-06-27T04:34:06.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:33:00+00:00 exited with status success for try_number 1 2024-06-27T04:34:06.204497602Z [2024-06-27T04:34:06.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:33:00+00:00, map_index=-1, run_start_date=2024-06-27 04:34:03.993335+00:00, run_end_date=2024-06-27 04:34:05.525656+00:00, run_duration=1.532321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:34:01.152146+00:00, queued_by_job_id=2, pid=8629 2024-06-27T04:34:06.205252312Z [2024-06-27T04:34:06.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:33:00+00:00, map_index=-1, run_start_date=2024-06-27 04:34:03.661932+00:00, run_end_date=2024-06-27 04:34:05.660338+00:00, run_duration=1.998406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:34:01.152146+00:00, queued_by_job_id=2, pid=8624 2024-06-27T04:35:00.174915615Z [2024-06-27T04:35:00.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:35:00+00:00, run_after=2024-06-27T04:36:00+00:00 2024-06-27T04:35:00.195386895Z [2024-06-27T04:35:00.194+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:35:00+00:00, run_after=2024-06-27T04:36:00+00:00 2024-06-27T04:35:00.220003512Z [2024-06-27T04:35:00.219+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:35:00+00:00, run_after=2024-06-27T04:40:00+00:00 2024-06-27T04:35:00.231258713Z [2024-06-27T04:35:00.230+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:35:00.368676547Z [2024-06-27T04:35:00.368+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:35:00.368713456Z 2024-06-27T04:35:00.368720122Z 2024-06-27T04:35:00.368741449Z 2024-06-27T04:35:00.368746565Z 2024-06-27T04:35:00.368815600Z [2024-06-27T04:35:00.368+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:35:00.368858240Z [2024-06-27T04:35:00.368+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:35:00.369210489Z [2024-06-27T04:35:00.368+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:35:00.369244202Z [2024-06-27T04:35:00.369+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:35:00.369931392Z [2024-06-27T04:35:00.369+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:35:00.369947623Z 2024-06-27T04:35:00.369956775Z 2024-06-27T04:35:00.369965297Z 2024-06-27T04:35:00.369974438Z 2024-06-27T04:35:00.374400636Z [2024-06-27T04:35:00.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:35:00.374441422Z [2024-06-27T04:35:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:35:00.374929662Z [2024-06-27T04:35:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:35:00.375437120Z [2024-06-27T04:35:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:35:00.375739819Z [2024-06-27T04:35:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:35:00.375948937Z [2024-06-27T04:35:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:35:00.376190452Z [2024-06-27T04:35:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:35:00.376292426Z [2024-06-27T04:35:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:35:00.824186693Z [2024-06-27T04:35:00.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status queued for try_number 1 2024-06-27T04:35:00.824284098Z [2024-06-27T04:35:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:34:00+00:00 exited with status queued for try_number 1 2024-06-27T04:35:00.824466201Z [2024-06-27T04:35:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:34:00+00:00 exited with status queued for try_number 1 2024-06-27T04:35:00.824605845Z [2024-06-27T04:35:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:34:00+00:00 exited with status queued for try_number 1 2024-06-27T04:35:00.835571535Z [2024-06-27T04:35:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c651574-ee40-4dde-94c2-765d69d17b22 2024-06-27T04:35:00.835821399Z [2024-06-27T04:35:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79110989-7c2a-42ba-aa62-ba16a371dbf0 2024-06-27T04:35:00.836175881Z [2024-06-27T04:35:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to f18d94ba-873f-47aa-a89d-b7927d2a0f9b 2024-06-27T04:35:00.836327806Z [2024-06-27T04:35:00.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to e591ce59-6a23-4d0d-8f25-d87adba35e69 2024-06-27T04:35:02.066300818Z [2024-06-27T04:35:02.065+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:35:02.066716895Z [2024-06-27T04:35:02.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:34:00+00:00, run_id=scheduled__2024-06-27T04:34:00+00:00, run_start_date=2024-06-27 04:35:00.243394+00:00, run_end_date=2024-06-27 04:35:02.066204+00:00, run_duration=1.82281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:34:00+00:00, data_interval_end=2024-06-27 04:35:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:35:02.078256588Z [2024-06-27T04:35:02.077+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:35:00+00:00, run_after=2024-06-27T04:36:00+00:00 2024-06-27T04:35:02.131445541Z [2024-06-27T04:35:02.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:34:00+00:00 exited with status success for try_number 1 2024-06-27T04:35:02.139488031Z [2024-06-27T04:35:02.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:34:00+00:00, map_index=-1, run_start_date=2024-06-27 04:35:01.297559+00:00, run_end_date=2024-06-27 04:35:01.748895+00:00, run_duration=0.451336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:35:00.370845+00:00, queued_by_job_id=2, pid=8674 2024-06-27T04:35:03.249738751Z [2024-06-27T04:35:03.249+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:35:03.249766192Z 2024-06-27T04:35:03.249770512Z [2024-06-27T04:35:03.249+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:35:03.251849139Z [2024-06-27T04:35:03.251+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:35:03.251920441Z 2024-06-27T04:35:03.255843831Z [2024-06-27T04:35:03.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:35:03.256569523Z [2024-06-27T04:35:03.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:35:03.341230823Z [2024-06-27T04:35:03.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status queued for try_number 1 2024-06-27T04:35:03.341777552Z [2024-06-27T04:35:03.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status success for try_number 1 2024-06-27T04:35:03.362643657Z [2024-06-27T04:35:03.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1b5af72-4611-4bb1-8045-9224a93edd5c 2024-06-27T04:35:03.362998695Z [2024-06-27T04:35:03.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:30:00+00:00, map_index=-1, run_start_date=2024-06-27 04:35:02.539465+00:00, run_end_date=2024-06-27 04:35:03.096401+00:00, run_duration=0.556936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:35:00.370845+00:00, queued_by_job_id=2, pid=8715 2024-06-27T04:35:04.544597629Z [2024-06-27T04:35:04.544+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:35:04.545097453Z [2024-06-27T04:35:04.544+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:34:00+00:00, run_id=scheduled__2024-06-27T04:34:00+00:00, run_start_date=2024-06-27 04:35:00.244819+00:00, run_end_date=2024-06-27 04:35:04.544459+00:00, run_duration=4.29964, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:34:00+00:00, data_interval_end=2024-06-27 04:35:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:35:04.554356716Z [2024-06-27T04:35:04.554+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:35:00+00:00, run_after=2024-06-27T04:36:00+00:00 2024-06-27T04:35:04.561648400Z [2024-06-27T04:35:04.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:35:04.562107644Z [2024-06-27T04:35:04.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:34:00+00:00, run_id=scheduled__2024-06-27T04:34:00+00:00, run_start_date=2024-06-27 04:35:00.246526+00:00, run_end_date=2024-06-27 04:35:04.561544+00:00, run_duration=4.315018, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:34:00+00:00, data_interval_end=2024-06-27 04:35:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:35:04.571603423Z [2024-06-27T04:35:04.571+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:35:00+00:00, run_after=2024-06-27T04:36:00+00:00 2024-06-27T04:35:04.639894687Z [2024-06-27T04:35:04.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:34:00+00:00 exited with status success for try_number 1 2024-06-27T04:35:04.642056487Z [2024-06-27T04:35:04.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:34:00+00:00 exited with status success for try_number 1 2024-06-27T04:35:04.660121575Z [2024-06-27T04:35:04.659+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:34:00+00:00, map_index=-1, run_start_date=2024-06-27 04:35:02.526031+00:00, run_end_date=2024-06-27 04:35:03.848044+00:00, run_duration=1.322013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:35:00.370845+00:00, queued_by_job_id=2, pid=8714 2024-06-27T04:35:04.660738768Z [2024-06-27T04:35:04.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:34:00+00:00, map_index=-1, run_start_date=2024-06-27 04:35:02.556540+00:00, run_end_date=2024-06-27 04:35:04.262876+00:00, run_duration=1.706336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:35:00.370845+00:00, queued_by_job_id=2, pid=8716 2024-06-27T04:35:05.746812308Z [2024-06-27T04:35:05.746+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:35:05.746861070Z 2024-06-27T04:35:05.747053007Z [2024-06-27T04:35:05.746+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:35:05.747837749Z [2024-06-27T04:35:05.747+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:35:05.747859019Z 2024-06-27T04:35:05.751076137Z [2024-06-27T04:35:05.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:35:05.751322821Z [2024-06-27T04:35:05.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:35:05.819795248Z [2024-06-27T04:35:05.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status queued for try_number 1 2024-06-27T04:35:05.820048819Z [2024-06-27T04:35:05.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status success for try_number 1 2024-06-27T04:35:05.825873836Z [2024-06-27T04:35:05.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c38a27d-2323-4b4a-b697-79abb7abdc9e 2024-06-27T04:35:05.826198636Z [2024-06-27T04:35:05.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T04:30:00+00:00, map_index=-1, run_start_date=2024-06-27 04:35:05.093424+00:00, run_end_date=2024-06-27 04:35:05.433497+00:00, run_duration=0.340073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:35:03.252746+00:00, queued_by_job_id=2, pid=8755 2024-06-27T04:35:06.129518183Z [2024-06-27T04:35:06.129+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T04:35:08.143713685Z [2024-06-27T04:35:08.143+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:35:08.143739383Z 2024-06-27T04:35:08.144087060Z [2024-06-27T04:35:08.143+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:35:08.148216058Z [2024-06-27T04:35:08.145+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:35:08.148253604Z 2024-06-27T04:35:08.148273286Z [2024-06-27T04:35:08.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:35:08.148278774Z [2024-06-27T04:35:08.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:35:08.314505318Z [2024-06-27T04:35:08.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status queued for try_number 1 2024-06-27T04:35:08.318562679Z [2024-06-27T04:35:08.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status success for try_number 1 2024-06-27T04:35:08.348462058Z [2024-06-27T04:35:08.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46757a66-ea30-4776-a919-0bc1e4543259 2024-06-27T04:35:08.351702950Z [2024-06-27T04:35:08.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:30:00+00:00, map_index=0, run_start_date=2024-06-27 04:35:07.423724+00:00, run_end_date=2024-06-27 04:35:07.770785+00:00, run_duration=0.347061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:35:05.748272+00:00, queued_by_job_id=2, pid=8767 2024-06-27T04:35:10.681587967Z [2024-06-27T04:35:10.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:35:10.682192366Z [2024-06-27T04:35:10.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:30:00+00:00, run_id=scheduled__2024-06-27T04:30:00+00:00, run_start_date=2024-06-27 04:35:00.242169+00:00, run_end_date=2024-06-27 04:35:10.681457+00:00, run_duration=10.439288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:30:00+00:00, data_interval_end=2024-06-27 04:35:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T04:35:10.689123839Z [2024-06-27T04:35:10.688+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:35:00+00:00, run_after=2024-06-27T04:40:00+00:00 2024-06-27T04:35:11.201671682Z [2024-06-27T04:35:11.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:30:00+00:00 exited with status success for try_number 1 2024-06-27T04:35:11.211325673Z [2024-06-27T04:35:11.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:30:00+00:00, map_index=-1, run_start_date=2024-06-27 04:35:10.215015+00:00, run_end_date=2024-06-27 04:35:10.606899+00:00, run_duration=0.391884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:35:08.145818+00:00, queued_by_job_id=2, pid=8779 2024-06-27T04:36:00.782716613Z [2024-06-27T04:36:00.780+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:36:00.795653175Z [2024-06-27T04:36:00.795+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:36:00.811680193Z [2024-06-27T04:36:00.811+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:36:00+00:00, run_after=2024-06-27T04:37:00+00:00 2024-06-27T04:36:00.823574663Z [2024-06-27T04:36:00.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:36:00+00:00, run_after=2024-06-27T04:37:00+00:00 2024-06-27T04:36:00.919862252Z [2024-06-27T04:36:00.919+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:36:00.919889781Z 2024-06-27T04:36:00.919896590Z 2024-06-27T04:36:00.919902245Z 2024-06-27T04:36:00.919908297Z 2024-06-27T04:36:00.920283143Z [2024-06-27T04:36:00.919+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:36:00.920604669Z [2024-06-27T04:36:00.920+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:36:00.920923589Z [2024-06-27T04:36:00.920+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:36:00.921186436Z [2024-06-27T04:36:00.920+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:36:00.922312492Z [2024-06-27T04:36:00.921+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:36:00.922332378Z 2024-06-27T04:36:00.922338931Z 2024-06-27T04:36:00.922344518Z 2024-06-27T04:36:00.922350031Z 2024-06-27T04:36:00.932319005Z [2024-06-27T04:36:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:36:00.932897584Z [2024-06-27T04:36:00.932+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:36:00.933737970Z [2024-06-27T04:36:00.933+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:36:00.934604271Z [2024-06-27T04:36:00.933+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:36:00.935473408Z [2024-06-27T04:36:00.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:36:00.935944963Z [2024-06-27T04:36:00.935+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:36:00.936641367Z [2024-06-27T04:36:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:36:00.938216610Z [2024-06-27T04:36:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:36:01.471663565Z [2024-06-27T04:36:01.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:34:00+00:00 exited with status queued for try_number 1 2024-06-27T04:36:01.471948157Z [2024-06-27T04:36:01.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status queued for try_number 1 2024-06-27T04:36:01.474147915Z [2024-06-27T04:36:01.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status queued for try_number 1 2024-06-27T04:36:01.474365532Z [2024-06-27T04:36:01.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status queued for try_number 1 2024-06-27T04:36:01.495063884Z [2024-06-27T04:36:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc54af98-116e-4122-9486-593e4536cdca 2024-06-27T04:36:01.495484621Z [2024-06-27T04:36:01.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cf74315-acfe-42e9-a149-52e332df8db1 2024-06-27T04:36:01.495763744Z [2024-06-27T04:36:01.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11ed1eb0-d80e-46c1-8ca3-c2dc66828007 2024-06-27T04:36:01.496032433Z [2024-06-27T04:36:01.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e167033-6961-459d-b37c-438f0f1e3b5c 2024-06-27T04:36:03.212003195Z [2024-06-27T04:36:03.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:36:03.214025143Z [2024-06-27T04:36:03.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:34:00+00:00, run_id=scheduled__2024-06-27T04:34:00+00:00, run_start_date=2024-06-27 04:36:00.835113+00:00, run_end_date=2024-06-27 04:36:03.211904+00:00, run_duration=2.376791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:34:00+00:00, data_interval_end=2024-06-27 04:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:36:03.227301062Z [2024-06-27T04:36:03.226+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:36:00+00:00, run_after=2024-06-27T04:38:00+00:00 2024-06-27T04:36:03.246905958Z [2024-06-27T04:36:03.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:36:03.247674369Z [2024-06-27T04:36:03.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:35:00+00:00, run_id=scheduled__2024-06-27T04:35:00+00:00, run_start_date=2024-06-27 04:36:00.836608+00:00, run_end_date=2024-06-27 04:36:03.246817+00:00, run_duration=2.410209, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:35:00+00:00, data_interval_end=2024-06-27 04:36:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:36:03.267702798Z [2024-06-27T04:36:03.267+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:36:00+00:00, run_after=2024-06-27T04:37:00+00:00 2024-06-27T04:36:03.326716695Z [2024-06-27T04:36:03.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:34:00+00:00 exited with status success for try_number 1 2024-06-27T04:36:03.326745386Z [2024-06-27T04:36:03.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status success for try_number 1 2024-06-27T04:36:03.337889684Z [2024-06-27T04:36:03.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:34:00+00:00, map_index=-1, run_start_date=2024-06-27 04:36:01.750816+00:00, run_end_date=2024-06-27 04:36:02.148342+00:00, run_duration=0.397526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:36:00.923778+00:00, queued_by_job_id=2, pid=8805 2024-06-27T04:36:03.338011350Z [2024-06-27T04:36:03.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:35:00+00:00, map_index=-1, run_start_date=2024-06-27 04:36:01.945159+00:00, run_end_date=2024-06-27 04:36:02.389723+00:00, run_duration=0.444564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:36:00.923778+00:00, queued_by_job_id=2, pid=8806 2024-06-27T04:36:04.834027919Z [2024-06-27T04:36:04.833+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:36:04.834549466Z [2024-06-27T04:36:04.834+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:35:00+00:00, run_id=scheduled__2024-06-27T04:35:00+00:00, run_start_date=2024-06-27 04:36:00.837770+00:00, run_end_date=2024-06-27 04:36:04.833864+00:00, run_duration=3.996094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:35:00+00:00, data_interval_end=2024-06-27 04:36:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:36:04.848261050Z [2024-06-27T04:36:04.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:36:00+00:00, run_after=2024-06-27T04:37:00+00:00 2024-06-27T04:36:04.909157519Z [2024-06-27T04:36:04.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status success for try_number 1 2024-06-27T04:36:04.920536117Z [2024-06-27T04:36:04.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:35:00+00:00, map_index=-1, run_start_date=2024-06-27 04:36:02.957423+00:00, run_end_date=2024-06-27 04:36:04.452870+00:00, run_duration=1.495447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:36:00.923778+00:00, queued_by_job_id=2, pid=8845 2024-06-27T04:36:05.958799229Z [2024-06-27T04:36:05.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:36:05.959034219Z [2024-06-27T04:36:05.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:35:00+00:00, run_id=scheduled__2024-06-27T04:35:00+00:00, run_start_date=2024-06-27 04:36:00.838864+00:00, run_end_date=2024-06-27 04:36:05.958612+00:00, run_duration=5.119748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:35:00+00:00, data_interval_end=2024-06-27 04:36:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:36:05.967543335Z [2024-06-27T04:36:05.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:36:00+00:00, run_after=2024-06-27T04:37:00+00:00 2024-06-27T04:36:06.007656358Z [2024-06-27T04:36:06.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status success for try_number 1 2024-06-27T04:36:06.018281615Z [2024-06-27T04:36:06.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:35:00+00:00, map_index=-1, run_start_date=2024-06-27 04:36:03.138889+00:00, run_end_date=2024-06-27 04:36:05.363351+00:00, run_duration=2.224462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:36:00.923778+00:00, queued_by_job_id=2, pid=8846 2024-06-27T04:37:00.058816704Z [2024-06-27T04:37:00.058+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:37:00.076447600Z [2024-06-27T04:37:00.076+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:37:00+00:00, run_after=2024-06-27T04:38:00+00:00 2024-06-27T04:37:00.108256966Z [2024-06-27T04:37:00.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:37:00+00:00, run_after=2024-06-27T04:38:00+00:00 2024-06-27T04:37:00.199962226Z [2024-06-27T04:37:00.199+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:37:00.199995516Z 2024-06-27T04:37:00.200013555Z 2024-06-27T04:37:00.200019216Z 2024-06-27T04:37:00.200263869Z [2024-06-27T04:37:00.199+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:37:00.200461086Z [2024-06-27T04:37:00.200+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:37:00.200664536Z [2024-06-27T04:37:00.200+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:37:00.201568048Z [2024-06-27T04:37:00.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:37:00.201580190Z 2024-06-27T04:37:00.201585735Z 2024-06-27T04:37:00.201590795Z 2024-06-27T04:37:00.206684908Z [2024-06-27T04:37:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:37:00.206720386Z [2024-06-27T04:37:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:37:00.207131067Z [2024-06-27T04:37:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:37:00.207224710Z [2024-06-27T04:37:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:37:00.207557060Z [2024-06-27T04:37:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:37:00.207662705Z [2024-06-27T04:37:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:37:00.459370377Z [2024-06-27T04:37:00.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:36:00+00:00 exited with status queued for try_number 1 2024-06-27T04:37:00.459459758Z [2024-06-27T04:37:00.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:36:00+00:00 exited with status queued for try_number 1 2024-06-27T04:37:00.459705066Z [2024-06-27T04:37:00.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:36:00+00:00 exited with status queued for try_number 1 2024-06-27T04:37:00.470155552Z [2024-06-27T04:37:00.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31431348-d95d-481e-a16e-2ddd6d66b606 2024-06-27T04:37:00.470229631Z [2024-06-27T04:37:00.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87e88769-6e35-4d71-9d73-3b6ae1d069cc 2024-06-27T04:37:00.470375167Z [2024-06-27T04:37:00.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to 349ad08c-a328-42a0-8015-cf6e3a7325d5 2024-06-27T04:37:01.651955352Z [2024-06-27T04:37:01.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:36:00+00:00 exited with status success for try_number 1 2024-06-27T04:37:01.657396897Z [2024-06-27T04:37:01.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:36:00+00:00, map_index=-1, run_start_date=2024-06-27 04:37:01.032603+00:00, run_end_date=2024-06-27 04:37:01.508062+00:00, run_duration=0.475459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:37:00.203310+00:00, queued_by_job_id=2, pid=8890 2024-06-27T04:37:02.725051654Z [2024-06-27T04:37:02.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:37:02.725141324Z [2024-06-27T04:37:02.724+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:36:00+00:00, run_id=scheduled__2024-06-27T04:36:00+00:00, run_start_date=2024-06-27 04:37:00.121023+00:00, run_end_date=2024-06-27 04:37:02.724383+00:00, run_duration=2.60336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:36:00+00:00, data_interval_end=2024-06-27 04:37:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:37:02.743436625Z [2024-06-27T04:37:02.742+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:37:00+00:00, run_after=2024-06-27T04:38:00+00:00 2024-06-27T04:37:03.984339843Z [2024-06-27T04:37:03.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:37:03.984877125Z [2024-06-27T04:37:03.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:36:00+00:00, run_id=scheduled__2024-06-27T04:36:00+00:00, run_start_date=2024-06-27 04:37:00.125744+00:00, run_end_date=2024-06-27 04:37:03.984513+00:00, run_duration=3.858769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:36:00+00:00, data_interval_end=2024-06-27 04:37:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:37:03.996490231Z [2024-06-27T04:37:03.996+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:37:00+00:00, run_after=2024-06-27T04:38:00+00:00 2024-06-27T04:37:04.008264878Z [2024-06-27T04:37:04.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:37:04.009422190Z [2024-06-27T04:37:04.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:36:00+00:00, run_id=scheduled__2024-06-27T04:36:00+00:00, run_start_date=2024-06-27 04:37:00.123297+00:00, run_end_date=2024-06-27 04:37:04.008964+00:00, run_duration=3.885667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:36:00+00:00, data_interval_end=2024-06-27 04:37:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:37:04.020574921Z [2024-06-27T04:37:04.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:37:00+00:00, run_after=2024-06-27T04:38:00+00:00 2024-06-27T04:37:04.064089191Z [2024-06-27T04:37:04.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:36:00+00:00 exited with status success for try_number 1 2024-06-27T04:37:04.074292800Z [2024-06-27T04:37:04.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:36:00+00:00, map_index=-1, run_start_date=2024-06-27 04:37:02.173027+00:00, run_end_date=2024-06-27 04:37:03.458578+00:00, run_duration=1.285551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:37:00.203310+00:00, queued_by_job_id=2, pid=8920 2024-06-27T04:37:05.183086841Z [2024-06-27T04:37:05.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:36:00+00:00 exited with status success for try_number 1 2024-06-27T04:37:05.192945230Z [2024-06-27T04:37:05.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:36:00+00:00, map_index=-1, run_start_date=2024-06-27 04:37:02.232179+00:00, run_end_date=2024-06-27 04:37:03.961694+00:00, run_duration=1.729515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:37:00.203310+00:00, queued_by_job_id=2, pid=8921 2024-06-27T04:38:00.557570625Z [2024-06-27T04:38:00.556+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:38:00.586417980Z [2024-06-27T04:38:00.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:38:00+00:00, run_after=2024-06-27T04:39:00+00:00 2024-06-27T04:38:00.595487916Z [2024-06-27T04:38:00.595+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:38:00.609556776Z [2024-06-27T04:38:00.609+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:38:00+00:00, run_after=2024-06-27T04:39:00+00:00 2024-06-27T04:38:00.703106597Z [2024-06-27T04:38:00.702+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:38:00.703135453Z 2024-06-27T04:38:00.703141635Z 2024-06-27T04:38:00.703146164Z 2024-06-27T04:38:00.703150618Z 2024-06-27T04:38:00.703276507Z [2024-06-27T04:38:00.702+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:38:00.703527105Z [2024-06-27T04:38:00.703+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:38:00.703734712Z [2024-06-27T04:38:00.703+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:38:00.703945689Z [2024-06-27T04:38:00.703+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:38:00.705088204Z [2024-06-27T04:38:00.704+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:38:00.705102632Z 2024-06-27T04:38:00.705107590Z 2024-06-27T04:38:00.705112173Z 2024-06-27T04:38:00.705116278Z 2024-06-27T04:38:00.711179186Z [2024-06-27T04:38:00.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:38:00.711363723Z [2024-06-27T04:38:00.710+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:38:00.711704530Z [2024-06-27T04:38:00.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:38:00.711809655Z [2024-06-27T04:38:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:38:00.712351038Z [2024-06-27T04:38:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:38:00.712456460Z [2024-06-27T04:38:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:38:00.712869228Z [2024-06-27T04:38:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:38:00.713038721Z [2024-06-27T04:38:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:38:01.041583812Z [2024-06-27T04:38:01.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:36:00+00:00 exited with status queued for try_number 1 2024-06-27T04:38:01.041782887Z [2024-06-27T04:38:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:37:00+00:00 exited with status queued for try_number 1 2024-06-27T04:38:01.041942091Z [2024-06-27T04:38:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:37:00+00:00 exited with status queued for try_number 1 2024-06-27T04:38:01.042103085Z [2024-06-27T04:38:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:37:00+00:00 exited with status queued for try_number 1 2024-06-27T04:38:01.050983134Z [2024-06-27T04:38:01.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2943fea3-86bc-4517-a5b2-0e8f8fbee52a 2024-06-27T04:38:01.051213243Z [2024-06-27T04:38:01.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec593f4f-53d2-4d63-8dd3-b17e795a91f6 2024-06-27T04:38:01.051482994Z [2024-06-27T04:38:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ce06f5c-6e5b-4ea2-b922-38b88caa36f0 2024-06-27T04:38:01.051638305Z [2024-06-27T04:38:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e50e5e2-ab90-44f4-a6c9-d3b7e467eae4 2024-06-27T04:38:02.218541705Z [2024-06-27T04:38:02.218+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:38:02.218924939Z [2024-06-27T04:38:02.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:36:00+00:00, run_id=scheduled__2024-06-27T04:36:00+00:00, run_start_date=2024-06-27 04:38:00.623515+00:00, run_end_date=2024-06-27 04:38:02.218448+00:00, run_duration=1.594933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:36:00+00:00, data_interval_end=2024-06-27 04:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:38:02.234440561Z [2024-06-27T04:38:02.232+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:38:00+00:00, run_after=2024-06-27T04:40:00+00:00 2024-06-27T04:38:02.257248993Z [2024-06-27T04:38:02.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:38:02.257525137Z [2024-06-27T04:38:02.257+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:37:00+00:00, run_id=scheduled__2024-06-27T04:37:00+00:00, run_start_date=2024-06-27 04:38:00.624967+00:00, run_end_date=2024-06-27 04:38:02.257173+00:00, run_duration=1.632206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:37:00+00:00, data_interval_end=2024-06-27 04:38:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:38:02.268019973Z [2024-06-27T04:38:02.267+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:38:00+00:00, run_after=2024-06-27T04:39:00+00:00 2024-06-27T04:38:02.299063704Z [2024-06-27T04:38:02.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:36:00+00:00 exited with status success for try_number 1 2024-06-27T04:38:02.299087349Z [2024-06-27T04:38:02.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:37:00+00:00 exited with status success for try_number 1 2024-06-27T04:38:02.305659001Z [2024-06-27T04:38:02.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:37:00+00:00, map_index=-1, run_start_date=2024-06-27 04:38:01.552532+00:00, run_end_date=2024-06-27 04:38:02.037082+00:00, run_duration=0.48455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:38:00.707117+00:00, queued_by_job_id=2, pid=8965 2024-06-27T04:38:02.305696384Z [2024-06-27T04:38:02.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:36:00+00:00, map_index=-1, run_start_date=2024-06-27 04:38:01.727881+00:00, run_end_date=2024-06-27 04:38:02.081197+00:00, run_duration=0.353316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:38:00.707117+00:00, queued_by_job_id=2, pid=8966 2024-06-27T04:38:04.146393345Z [2024-06-27T04:38:04.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:38:04.147268543Z [2024-06-27T04:38:04.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:37:00+00:00, run_id=scheduled__2024-06-27T04:37:00+00:00, run_start_date=2024-06-27 04:38:00.626325+00:00, run_end_date=2024-06-27 04:38:04.146907+00:00, run_duration=3.520582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:37:00+00:00, data_interval_end=2024-06-27 04:38:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:38:04.156880959Z [2024-06-27T04:38:04.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:38:00+00:00, run_after=2024-06-27T04:39:00+00:00 2024-06-27T04:38:04.418271819Z [2024-06-27T04:38:04.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:37:00+00:00 exited with status success for try_number 1 2024-06-27T04:38:04.429453812Z [2024-06-27T04:38:04.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:37:00+00:00, map_index=-1, run_start_date=2024-06-27 04:38:02.763597+00:00, run_end_date=2024-06-27 04:38:04.077032+00:00, run_duration=1.313435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:38:00.707117+00:00, queued_by_job_id=2, pid=9006 2024-06-27T04:38:05.486803997Z [2024-06-27T04:38:05.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:38:05.486933266Z [2024-06-27T04:38:05.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:37:00+00:00, run_id=scheduled__2024-06-27T04:37:00+00:00, run_start_date=2024-06-27 04:38:00.627606+00:00, run_end_date=2024-06-27 04:38:05.486624+00:00, run_duration=4.859018, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:37:00+00:00, data_interval_end=2024-06-27 04:38:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:38:05.496624436Z [2024-06-27T04:38:05.496+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:38:00+00:00, run_after=2024-06-27T04:39:00+00:00 2024-06-27T04:38:05.532390348Z [2024-06-27T04:38:05.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:37:00+00:00 exited with status success for try_number 1 2024-06-27T04:38:05.539069047Z [2024-06-27T04:38:05.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:37:00+00:00, map_index=-1, run_start_date=2024-06-27 04:38:02.687886+00:00, run_end_date=2024-06-27 04:38:04.384960+00:00, run_duration=1.697074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:38:00.707117+00:00, queued_by_job_id=2, pid=9005 2024-06-27T04:39:00.068874785Z [2024-06-27T04:39:00.068+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:39:00.080941280Z [2024-06-27T04:39:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:39:00+00:00, run_after=2024-06-27T04:40:00+00:00 2024-06-27T04:39:00.092007826Z [2024-06-27T04:39:00.091+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:39:00+00:00, run_after=2024-06-27T04:40:00+00:00 2024-06-27T04:39:00.177215021Z [2024-06-27T04:39:00.176+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:39:00.177240479Z 2024-06-27T04:39:00.177243990Z 2024-06-27T04:39:00.177246955Z 2024-06-27T04:39:00.177401494Z [2024-06-27T04:39:00.177+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:39:00.177603552Z [2024-06-27T04:39:00.177+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:39:00.177786025Z [2024-06-27T04:39:00.177+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:39:00.178582428Z [2024-06-27T04:39:00.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:39:00.178598057Z 2024-06-27T04:39:00.178601442Z 2024-06-27T04:39:00.178604696Z 2024-06-27T04:39:00.187022119Z [2024-06-27T04:39:00.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:39:00.187266931Z [2024-06-27T04:39:00.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:39:00.187569834Z [2024-06-27T04:39:00.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:39:00.187690917Z [2024-06-27T04:39:00.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:39:00.187925325Z [2024-06-27T04:39:00.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:39:00.188068798Z [2024-06-27T04:39:00.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:39:00.723825349Z [2024-06-27T04:39:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:38:00+00:00 exited with status queued for try_number 1 2024-06-27T04:39:00.723922505Z [2024-06-27T04:39:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:38:00+00:00 exited with status queued for try_number 1 2024-06-27T04:39:00.724084467Z [2024-06-27T04:39:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:38:00+00:00 exited with status queued for try_number 1 2024-06-27T04:39:00.733454401Z [2024-06-27T04:39:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to be72ef42-dcba-46ff-bcf7-5c9472cc1f65 2024-06-27T04:39:00.733586081Z [2024-06-27T04:39:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cf37c7d-418e-471d-9b8a-cb766973ad9b 2024-06-27T04:39:00.733754302Z [2024-06-27T04:39:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31e5a4a7-afa9-457a-86e1-8c743a674242 2024-06-27T04:39:03.075993587Z [2024-06-27T04:39:03.075+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:39:03.076499223Z [2024-06-27T04:39:03.076+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:38:00+00:00, run_id=scheduled__2024-06-27T04:38:00+00:00, run_start_date=2024-06-27 04:39:00.103201+00:00, run_end_date=2024-06-27 04:39:03.075981+00:00, run_duration=2.97278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:38:00+00:00, data_interval_end=2024-06-27 04:39:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:39:03.099717067Z [2024-06-27T04:39:03.099+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:39:00+00:00, run_after=2024-06-27T04:40:00+00:00 2024-06-27T04:39:03.175360944Z [2024-06-27T04:39:03.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:38:00+00:00 exited with status success for try_number 1 2024-06-27T04:39:03.183861735Z [2024-06-27T04:39:03.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:38:00+00:00, map_index=-1, run_start_date=2024-06-27 04:39:01.573142+00:00, run_end_date=2024-06-27 04:39:02.104287+00:00, run_duration=0.531145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:39:00.179525+00:00, queued_by_job_id=2, pid=9050 2024-06-27T04:39:05.807525944Z [2024-06-27T04:39:05.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:39:05.808129087Z [2024-06-27T04:39:05.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:38:00+00:00, run_id=scheduled__2024-06-27T04:38:00+00:00, run_start_date=2024-06-27 04:39:00.105815+00:00, run_end_date=2024-06-27 04:39:05.807321+00:00, run_duration=5.701506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:38:00+00:00, data_interval_end=2024-06-27 04:39:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:39:05.818362311Z [2024-06-27T04:39:05.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:39:00+00:00, run_after=2024-06-27T04:40:00+00:00 2024-06-27T04:39:05.826285614Z [2024-06-27T04:39:05.825+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:39:05.826663774Z [2024-06-27T04:39:05.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:38:00+00:00, run_id=scheduled__2024-06-27T04:38:00+00:00, run_start_date=2024-06-27 04:39:00.104681+00:00, run_end_date=2024-06-27 04:39:05.826175+00:00, run_duration=5.721494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:38:00+00:00, data_interval_end=2024-06-27 04:39:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:39:05.839978674Z [2024-06-27T04:39:05.839+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:39:00+00:00, run_after=2024-06-27T04:40:00+00:00 2024-06-27T04:39:05.881770024Z [2024-06-27T04:39:05.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:38:00+00:00 exited with status success for try_number 1 2024-06-27T04:39:05.881809831Z [2024-06-27T04:39:05.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:38:00+00:00 exited with status success for try_number 1 2024-06-27T04:39:05.889696823Z [2024-06-27T04:39:05.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:38:00+00:00, map_index=-1, run_start_date=2024-06-27 04:39:02.409226+00:00, run_end_date=2024-06-27 04:39:04.954697+00:00, run_duration=2.545471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:39:00.179525+00:00, queued_by_job_id=2, pid=9071 2024-06-27T04:39:05.889964436Z [2024-06-27T04:39:05.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:38:00+00:00, map_index=-1, run_start_date=2024-06-27 04:39:02.746374+00:00, run_end_date=2024-06-27 04:39:04.880222+00:00, run_duration=2.133848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:39:00.179525+00:00, queued_by_job_id=2, pid=9088 2024-06-27T04:40:00.293243238Z [2024-06-27T04:40:00.292+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:40:00.307416458Z [2024-06-27T04:40:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:40:00+00:00, run_after=2024-06-27T04:45:00+00:00 2024-06-27T04:40:00.321417257Z [2024-06-27T04:40:00.319+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:40:00+00:00, run_after=2024-06-27T04:41:00+00:00 2024-06-27T04:40:00.332456555Z [2024-06-27T04:40:00.331+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:40:00.356220399Z [2024-06-27T04:40:00.355+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:40:00+00:00, run_after=2024-06-27T04:41:00+00:00 2024-06-27T04:40:00.503533651Z [2024-06-27T04:40:00.503+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T04:40:00.503573184Z 2024-06-27T04:40:00.503580812Z 2024-06-27T04:40:00.503588034Z 2024-06-27T04:40:00.503594603Z 2024-06-27T04:40:00.503601131Z 2024-06-27T04:40:00.503619628Z [2024-06-27T04:40:00.503+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:40:00.503803061Z [2024-06-27T04:40:00.503+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:40:00.503985838Z [2024-06-27T04:40:00.503+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:40:00.504136631Z [2024-06-27T04:40:00.503+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:40:00.504292038Z [2024-06-27T04:40:00.504+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:40:00.505262242Z [2024-06-27T04:40:00.504+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:40:00.505301180Z 2024-06-27T04:40:00.505310110Z 2024-06-27T04:40:00.505317255Z 2024-06-27T04:40:00.505323617Z 2024-06-27T04:40:00.505329956Z 2024-06-27T04:40:00.510660298Z [2024-06-27T04:40:00.510+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:40:00.510685474Z [2024-06-27T04:40:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:40:00.510961511Z [2024-06-27T04:40:00.510+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:40:00.511108581Z [2024-06-27T04:40:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:40:00.511439027Z [2024-06-27T04:40:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:40:00.511590675Z [2024-06-27T04:40:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:40:00.511940510Z [2024-06-27T04:40:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:40:00.512114408Z [2024-06-27T04:40:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:40:00.512430059Z [2024-06-27T04:40:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:40:00.512594719Z [2024-06-27T04:40:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:40:01.185239043Z [2024-06-27T04:40:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status queued for try_number 1 2024-06-27T04:40:01.185322387Z [2024-06-27T04:40:01.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:38:00+00:00 exited with status queued for try_number 1 2024-06-27T04:40:01.185353132Z [2024-06-27T04:40:01.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:39:00+00:00 exited with status queued for try_number 1 2024-06-27T04:40:01.185425506Z [2024-06-27T04:40:01.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:39:00+00:00 exited with status queued for try_number 1 2024-06-27T04:40:01.185483694Z [2024-06-27T04:40:01.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:39:00+00:00 exited with status queued for try_number 1 2024-06-27T04:40:01.206168995Z [2024-06-27T04:40:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e7a01d1-84fd-4c26-9320-523601412994 2024-06-27T04:40:01.206235678Z [2024-06-27T04:40:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to c41857ef-cff1-45bb-9593-9d4bb414dd2c 2024-06-27T04:40:01.206332686Z [2024-06-27T04:40:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99f4d981-994b-4bf1-a283-3fb19a9fc458 2024-06-27T04:40:01.206452653Z [2024-06-27T04:40:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 199475ae-88f5-41aa-b103-e29a455cf54e 2024-06-27T04:40:01.206529370Z [2024-06-27T04:40:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a1e54dd-a212-4010-922c-60c2011cde4a 2024-06-27T04:40:03.042899707Z [2024-06-27T04:40:03.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:40:03.044134438Z [2024-06-27T04:40:03.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:38:00+00:00, run_id=scheduled__2024-06-27T04:38:00+00:00, run_start_date=2024-06-27 04:40:00.375429+00:00, run_end_date=2024-06-27 04:40:03.042852+00:00, run_duration=2.667423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:38:00+00:00, data_interval_end=2024-06-27 04:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:40:03.057281616Z [2024-06-27T04:40:03.057+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:40:00+00:00, run_after=2024-06-27T04:42:00+00:00 2024-06-27T04:40:03.073252247Z [2024-06-27T04:40:03.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:40:03.073486042Z [2024-06-27T04:40:03.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:39:00+00:00, run_id=scheduled__2024-06-27T04:39:00+00:00, run_start_date=2024-06-27 04:40:00.377093+00:00, run_end_date=2024-06-27 04:40:03.073184+00:00, run_duration=2.696091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:39:00+00:00, data_interval_end=2024-06-27 04:40:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:40:03.094559700Z [2024-06-27T04:40:03.094+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:40:00+00:00, run_after=2024-06-27T04:41:00+00:00 2024-06-27T04:40:03.271012806Z [2024-06-27T04:40:03.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:38:00+00:00 exited with status success for try_number 1 2024-06-27T04:40:03.271045982Z [2024-06-27T04:40:03.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:39:00+00:00 exited with status success for try_number 1 2024-06-27T04:40:03.293946108Z [2024-06-27T04:40:03.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:38:00+00:00, map_index=-1, run_start_date=2024-06-27 04:40:01.536115+00:00, run_end_date=2024-06-27 04:40:02.055436+00:00, run_duration=0.519321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:40:00.506435+00:00, queued_by_job_id=2, pid=9127 2024-06-27T04:40:03.295029116Z [2024-06-27T04:40:03.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:39:00+00:00, map_index=-1, run_start_date=2024-06-27 04:40:01.743755+00:00, run_end_date=2024-06-27 04:40:02.244981+00:00, run_duration=0.501226, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:40:00.506435+00:00, queued_by_job_id=2, pid=9128 2024-06-27T04:40:04.399794787Z [2024-06-27T04:40:04.399+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:40:04.399836872Z 2024-06-27T04:40:04.400031472Z [2024-06-27T04:40:04.399+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:40:04.400856095Z [2024-06-27T04:40:04.400+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:40:04.400869617Z 2024-06-27T04:40:04.403904847Z [2024-06-27T04:40:04.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T04:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:40:04.404028565Z [2024-06-27T04:40:04.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:40:04.470120426Z [2024-06-27T04:40:04.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status queued for try_number 1 2024-06-27T04:40:04.470470084Z [2024-06-27T04:40:04.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status success for try_number 1 2024-06-27T04:40:04.480730753Z [2024-06-27T04:40:04.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd5d4634-36a7-4ecb-9412-ecd05321457f 2024-06-27T04:40:04.481231844Z [2024-06-27T04:40:04.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:35:00+00:00, map_index=-1, run_start_date=2024-06-27 04:40:03.108929+00:00, run_end_date=2024-06-27 04:40:03.705406+00:00, run_duration=0.596477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:40:00.506435+00:00, queued_by_job_id=2, pid=9178 2024-06-27T04:40:04.982467831Z [2024-06-27T04:40:04.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:40:04.982883549Z [2024-06-27T04:40:04.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:39:00+00:00, run_id=scheduled__2024-06-27T04:39:00+00:00, run_start_date=2024-06-27 04:40:00.380948+00:00, run_end_date=2024-06-27 04:40:04.982362+00:00, run_duration=4.601414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:39:00+00:00, data_interval_end=2024-06-27 04:40:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:40:04.998083737Z [2024-06-27T04:40:04.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:40:00+00:00, run_after=2024-06-27T04:41:00+00:00 2024-06-27T04:40:05.027290401Z [2024-06-27T04:40:05.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:40:05.027810392Z [2024-06-27T04:40:05.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:39:00+00:00, run_id=scheduled__2024-06-27T04:39:00+00:00, run_start_date=2024-06-27 04:40:00.378704+00:00, run_end_date=2024-06-27 04:40:05.027197+00:00, run_duration=4.648493, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:39:00+00:00, data_interval_end=2024-06-27 04:40:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:40:05.041954748Z [2024-06-27T04:40:05.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:40:00+00:00, run_after=2024-06-27T04:41:00+00:00 2024-06-27T04:40:05.098423279Z [2024-06-27T04:40:05.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:39:00+00:00 exited with status success for try_number 1 2024-06-27T04:40:05.098864743Z [2024-06-27T04:40:05.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:39:00+00:00 exited with status success for try_number 1 2024-06-27T04:40:05.113049128Z [2024-06-27T04:40:05.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:39:00+00:00, map_index=-1, run_start_date=2024-06-27 04:40:03.417259+00:00, run_end_date=2024-06-27 04:40:04.846950+00:00, run_duration=1.429691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:40:00.506435+00:00, queued_by_job_id=2, pid=9179 2024-06-27T04:40:05.114308032Z [2024-06-27T04:40:05.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:39:00+00:00, map_index=-1, run_start_date=2024-06-27 04:40:02.968282+00:00, run_end_date=2024-06-27 04:40:04.811880+00:00, run_duration=1.843598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:40:00.506435+00:00, queued_by_job_id=2, pid=9168 2024-06-27T04:40:06.233543140Z [2024-06-27T04:40:06.232+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T04:40:07.066529662Z [2024-06-27T04:40:07.066+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:40:07.066590030Z 2024-06-27T04:40:07.066714158Z [2024-06-27T04:40:07.066+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:40:07.067387325Z [2024-06-27T04:40:07.067+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:40:07.067402201Z 2024-06-27T04:40:07.070231036Z [2024-06-27T04:40:07.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:40:07.070433564Z [2024-06-27T04:40:07.070+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:40:07.145706507Z [2024-06-27T04:40:07.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status queued for try_number 1 2024-06-27T04:40:07.146169461Z [2024-06-27T04:40:07.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status success for try_number 1 2024-06-27T04:40:07.156457255Z [2024-06-27T04:40:07.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to b463419e-2a68-4518-8ea6-7642135c5508 2024-06-27T04:40:07.156885176Z [2024-06-27T04:40:07.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T04:35:00+00:00, map_index=-1, run_start_date=2024-06-27 04:40:06.127062+00:00, run_end_date=2024-06-27 04:40:06.516224+00:00, run_duration=0.389162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:40:04.401479+00:00, queued_by_job_id=2, pid=9218 2024-06-27T04:40:09.421031520Z [2024-06-27T04:40:09.420+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:40:09.421060972Z 2024-06-27T04:40:09.421138875Z [2024-06-27T04:40:09.420+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:40:09.421586857Z [2024-06-27T04:40:09.421+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:40:09.421600223Z 2024-06-27T04:40:09.427997974Z [2024-06-27T04:40:09.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:40:09.428151643Z [2024-06-27T04:40:09.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:40:09.504598429Z [2024-06-27T04:40:09.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status queued for try_number 1 2024-06-27T04:40:09.504636437Z [2024-06-27T04:40:09.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status success for try_number 1 2024-06-27T04:40:09.514110164Z [2024-06-27T04:40:09.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa7a22e1-850d-41d8-8a46-4dedd7b6a1c2 2024-06-27T04:40:09.514198226Z [2024-06-27T04:40:09.514+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:35:00+00:00, map_index=0, run_start_date=2024-06-27 04:40:08.799284+00:00, run_end_date=2024-06-27 04:40:09.241268+00:00, run_duration=0.441984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:40:07.067799+00:00, queued_by_job_id=2, pid=9230 2024-06-27T04:40:12.096422336Z [2024-06-27T04:40:12.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:40:12.097479700Z [2024-06-27T04:40:12.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:35:00+00:00, run_id=scheduled__2024-06-27T04:35:00+00:00, run_start_date=2024-06-27 04:40:00.373103+00:00, run_end_date=2024-06-27 04:40:12.096282+00:00, run_duration=11.723179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:35:00+00:00, data_interval_end=2024-06-27 04:40:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T04:40:12.115924015Z [2024-06-27T04:40:12.115+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:40:00+00:00, run_after=2024-06-27T04:45:00+00:00 2024-06-27T04:40:12.164378344Z [2024-06-27T04:40:12.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:35:00+00:00 exited with status success for try_number 1 2024-06-27T04:40:12.170138565Z [2024-06-27T04:40:12.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:35:00+00:00, map_index=-1, run_start_date=2024-06-27 04:40:11.103881+00:00, run_end_date=2024-06-27 04:40:11.504577+00:00, run_duration=0.400696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:40:09.421926+00:00, queued_by_job_id=2, pid=9242 2024-06-27T04:41:01.097501029Z [2024-06-27T04:41:01.096+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:41:00+00:00, run_after=2024-06-27T04:42:00+00:00 2024-06-27T04:41:01.107069571Z [2024-06-27T04:41:01.106+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:41:01.149247115Z [2024-06-27T04:41:01.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:41:00+00:00, run_after=2024-06-27T04:42:00+00:00 2024-06-27T04:41:01.223678298Z [2024-06-27T04:41:01.223+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:41:01.223728530Z 2024-06-27T04:41:01.223739884Z 2024-06-27T04:41:01.223749140Z 2024-06-27T04:41:01.223758869Z [2024-06-27T04:41:01.223+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:41:01.224024747Z [2024-06-27T04:41:01.223+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:41:01.224209026Z [2024-06-27T04:41:01.223+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:41:01.225020646Z [2024-06-27T04:41:01.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:41:01.225038767Z 2024-06-27T04:41:01.225044013Z 2024-06-27T04:41:01.225048685Z 2024-06-27T04:41:01.228947452Z [2024-06-27T04:41:01.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:41:01.228965794Z [2024-06-27T04:41:01.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:41:01.229446884Z [2024-06-27T04:41:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:41:01.229666332Z [2024-06-27T04:41:01.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:41:01.230066616Z [2024-06-27T04:41:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:41:01.230279263Z [2024-06-27T04:41:01.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:41:01.457908953Z [2024-06-27T04:41:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status queued for try_number 1 2024-06-27T04:41:01.458177311Z [2024-06-27T04:41:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status queued for try_number 1 2024-06-27T04:41:01.458348569Z [2024-06-27T04:41:01.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status queued for try_number 1 2024-06-27T04:41:01.468475755Z [2024-06-27T04:41:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad2a6f42-1334-4000-8f4c-5cf4ce5cdd55 2024-06-27T04:41:01.468951016Z [2024-06-27T04:41:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4382a2f5-14e4-4d6b-b9b7-aacf200021b3 2024-06-27T04:41:01.469354884Z [2024-06-27T04:41:01.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62a55ed4-ca5e-4fa8-b1b6-3b277dd0a74f 2024-06-27T04:41:02.798117070Z [2024-06-27T04:41:02.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:41:02.798601176Z [2024-06-27T04:41:02.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:40:00+00:00, run_id=scheduled__2024-06-27T04:40:00+00:00, run_start_date=2024-06-27 04:41:01.162811+00:00, run_end_date=2024-06-27 04:41:02.798263+00:00, run_duration=1.635452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:40:00+00:00, data_interval_end=2024-06-27 04:41:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:41:02.811367617Z [2024-06-27T04:41:02.810+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:41:00+00:00, run_after=2024-06-27T04:42:00+00:00 2024-06-27T04:41:02.925909740Z [2024-06-27T04:41:02.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status success for try_number 1 2024-06-27T04:41:02.931116330Z [2024-06-27T04:41:02.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:40:00+00:00, map_index=-1, run_start_date=2024-06-27 04:41:02.017833+00:00, run_end_date=2024-06-27 04:41:02.376170+00:00, run_duration=0.358337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:41:01.225970+00:00, queued_by_job_id=2, pid=9268 2024-06-27T04:41:05.134046139Z [2024-06-27T04:41:05.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:41:05.134638608Z [2024-06-27T04:41:05.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:40:00+00:00, run_id=scheduled__2024-06-27T04:40:00+00:00, run_start_date=2024-06-27 04:41:01.164203+00:00, run_end_date=2024-06-27 04:41:05.133927+00:00, run_duration=3.969724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:40:00+00:00, data_interval_end=2024-06-27 04:41:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:41:05.148678319Z [2024-06-27T04:41:05.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:41:00+00:00, run_after=2024-06-27T04:42:00+00:00 2024-06-27T04:41:05.200861351Z [2024-06-27T04:41:05.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status success for try_number 1 2024-06-27T04:41:05.207855602Z [2024-06-27T04:41:05.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:40:00+00:00, map_index=-1, run_start_date=2024-06-27 04:41:03.179332+00:00, run_end_date=2024-06-27 04:41:04.633330+00:00, run_duration=1.453998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:41:01.225970+00:00, queued_by_job_id=2, pid=9298 2024-06-27T04:41:05.323494450Z [2024-06-27T04:41:05.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:41:05.323518708Z [2024-06-27T04:41:05.322+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:40:00+00:00, run_id=scheduled__2024-06-27T04:40:00+00:00, run_start_date=2024-06-27 04:41:01.165209+00:00, run_end_date=2024-06-27 04:41:05.322215+00:00, run_duration=4.157006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:40:00+00:00, data_interval_end=2024-06-27 04:41:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:41:05.331082149Z [2024-06-27T04:41:05.330+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:41:00+00:00, run_after=2024-06-27T04:42:00+00:00 2024-06-27T04:41:05.359836379Z [2024-06-27T04:41:05.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status success for try_number 1 2024-06-27T04:41:05.366837821Z [2024-06-27T04:41:05.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:40:00+00:00, map_index=-1, run_start_date=2024-06-27 04:41:03.215132+00:00, run_end_date=2024-06-27 04:41:05.195165+00:00, run_duration=1.980033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:41:01.225970+00:00, queued_by_job_id=2, pid=9299 2024-06-27T04:42:00.993455621Z [2024-06-27T04:42:00.992+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:42:00+00:00, run_after=2024-06-27T04:43:00+00:00 2024-06-27T04:42:01.004061460Z [2024-06-27T04:42:01.003+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:42:01.011528511Z [2024-06-27T04:42:01.011+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:42:01.022902472Z [2024-06-27T04:42:01.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:42:00+00:00, run_after=2024-06-27T04:43:00+00:00 2024-06-27T04:42:01.140874707Z [2024-06-27T04:42:01.136+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:42:01.140923641Z 2024-06-27T04:42:01.140929783Z 2024-06-27T04:42:01.140934781Z 2024-06-27T04:42:01.140939999Z 2024-06-27T04:42:01.140945405Z [2024-06-27T04:42:01.136+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:42:01.140950304Z [2024-06-27T04:42:01.136+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:42:01.140955605Z [2024-06-27T04:42:01.136+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:42:01.140960492Z [2024-06-27T04:42:01.137+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:42:01.140965583Z [2024-06-27T04:42:01.137+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:42:01.140970277Z 2024-06-27T04:42:01.140975177Z 2024-06-27T04:42:01.140980308Z 2024-06-27T04:42:01.140985523Z 2024-06-27T04:42:01.148961043Z [2024-06-27T04:42:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:42:01.148984393Z [2024-06-27T04:42:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:42:01.149000800Z [2024-06-27T04:42:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:42:01.149004470Z [2024-06-27T04:42:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:42:01.149007673Z [2024-06-27T04:42:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:42:01.149010706Z [2024-06-27T04:42:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:42:01.149024224Z [2024-06-27T04:42:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:42:01.149027217Z [2024-06-27T04:42:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:42:01.620573829Z [2024-06-27T04:42:01.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status queued for try_number 1 2024-06-27T04:42:01.620867260Z [2024-06-27T04:42:01.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:41:00+00:00 exited with status queued for try_number 1 2024-06-27T04:42:01.621007574Z [2024-06-27T04:42:01.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:41:00+00:00 exited with status queued for try_number 1 2024-06-27T04:42:01.621134163Z [2024-06-27T04:42:01.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:41:00+00:00 exited with status queued for try_number 1 2024-06-27T04:42:01.654399416Z [2024-06-27T04:42:01.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60db7741-d16b-44b5-b3b5-c44cb13ee28c 2024-06-27T04:42:01.654726980Z [2024-06-27T04:42:01.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0d29eb8-a083-4b1c-a94c-45d5a0911176 2024-06-27T04:42:01.654973578Z [2024-06-27T04:42:01.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71619e31-cfb5-4f23-9bfa-87b3951b219a 2024-06-27T04:42:01.659351006Z [2024-06-27T04:42:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to e64a5c8d-de84-4e29-bcff-5829ece0b8a5 2024-06-27T04:42:03.442482900Z [2024-06-27T04:42:03.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:42:03.443176591Z [2024-06-27T04:42:03.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:40:00+00:00, run_id=scheduled__2024-06-27T04:40:00+00:00, run_start_date=2024-06-27 04:42:01.033929+00:00, run_end_date=2024-06-27 04:42:03.442374+00:00, run_duration=2.408445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:40:00+00:00, data_interval_end=2024-06-27 04:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:42:03.451882820Z [2024-06-27T04:42:03.451+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:42:00+00:00, run_after=2024-06-27T04:44:00+00:00 2024-06-27T04:42:03.469749294Z [2024-06-27T04:42:03.469+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:42:03.470723823Z [2024-06-27T04:42:03.469+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:41:00+00:00, run_id=scheduled__2024-06-27T04:41:00+00:00, run_start_date=2024-06-27 04:42:01.035626+00:00, run_end_date=2024-06-27 04:42:03.469656+00:00, run_duration=2.43403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:41:00+00:00, data_interval_end=2024-06-27 04:42:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:42:03.485492838Z [2024-06-27T04:42:03.484+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:42:00+00:00, run_after=2024-06-27T04:43:00+00:00 2024-06-27T04:42:03.546983585Z [2024-06-27T04:42:03.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status success for try_number 1 2024-06-27T04:42:03.549038615Z [2024-06-27T04:42:03.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:41:00+00:00 exited with status success for try_number 1 2024-06-27T04:42:03.558830055Z [2024-06-27T04:42:03.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:40:00+00:00, map_index=-1, run_start_date=2024-06-27 04:42:02.050496+00:00, run_end_date=2024-06-27 04:42:02.481377+00:00, run_duration=0.430881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:42:01.138648+00:00, queued_by_job_id=2, pid=9335 2024-06-27T04:42:03.559392119Z [2024-06-27T04:42:03.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:41:00+00:00, map_index=-1, run_start_date=2024-06-27 04:42:02.472004+00:00, run_end_date=2024-06-27 04:42:02.941497+00:00, run_duration=0.469493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:42:01.138648+00:00, queued_by_job_id=2, pid=9354 2024-06-27T04:42:05.604630865Z [2024-06-27T04:42:05.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:42:05.604951393Z [2024-06-27T04:42:05.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:41:00+00:00, run_id=scheduled__2024-06-27T04:41:00+00:00, run_start_date=2024-06-27 04:42:01.037645+00:00, run_end_date=2024-06-27 04:42:05.604591+00:00, run_duration=4.566946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:41:00+00:00, data_interval_end=2024-06-27 04:42:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:42:05.613296191Z [2024-06-27T04:42:05.612+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:42:00+00:00, run_after=2024-06-27T04:43:00+00:00 2024-06-27T04:42:05.619947597Z [2024-06-27T04:42:05.619+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:42:05.620213008Z [2024-06-27T04:42:05.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:41:00+00:00, run_id=scheduled__2024-06-27T04:41:00+00:00, run_start_date=2024-06-27 04:42:01.036599+00:00, run_end_date=2024-06-27 04:42:05.619946+00:00, run_duration=4.583347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:41:00+00:00, data_interval_end=2024-06-27 04:42:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:42:05.630847739Z [2024-06-27T04:42:05.630+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:42:00+00:00, run_after=2024-06-27T04:43:00+00:00 2024-06-27T04:42:05.674692434Z [2024-06-27T04:42:05.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:41:00+00:00 exited with status success for try_number 1 2024-06-27T04:42:05.674740389Z [2024-06-27T04:42:05.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:41:00+00:00 exited with status success for try_number 1 2024-06-27T04:42:05.682032861Z [2024-06-27T04:42:05.681+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:41:00+00:00, map_index=-1, run_start_date=2024-06-27 04:42:03.572648+00:00, run_end_date=2024-06-27 04:42:05.413630+00:00, run_duration=1.840982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:42:01.138648+00:00, queued_by_job_id=2, pid=9375 2024-06-27T04:42:05.682314080Z [2024-06-27T04:42:05.681+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:41:00+00:00, map_index=-1, run_start_date=2024-06-27 04:42:03.859661+00:00, run_end_date=2024-06-27 04:42:05.272456+00:00, run_duration=1.412795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:42:01.138648+00:00, queued_by_job_id=2, pid=9385 2024-06-27T04:43:00.881776873Z [2024-06-27T04:43:00.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:43:00+00:00, run_after=2024-06-27T04:44:00+00:00 2024-06-27T04:43:00.897678248Z [2024-06-27T04:43:00.897+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:43:00.920841718Z [2024-06-27T04:43:00.920+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:43:00+00:00, run_after=2024-06-27T04:44:00+00:00 2024-06-27T04:43:00.992975913Z [2024-06-27T04:43:00.992+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:43:00.993021955Z 2024-06-27T04:43:00.993061914Z 2024-06-27T04:43:00.993072729Z 2024-06-27T04:43:00.993081813Z [2024-06-27T04:43:00.992+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:43:00.993120956Z [2024-06-27T04:43:00.992+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:43:00.993391451Z [2024-06-27T04:43:00.993+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:43:00.994234411Z [2024-06-27T04:43:00.993+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:43:00.994256996Z 2024-06-27T04:43:00.994266422Z 2024-06-27T04:43:00.994276193Z 2024-06-27T04:43:00.998063479Z [2024-06-27T04:43:00.997+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:43:00.998313862Z [2024-06-27T04:43:00.997+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:43:00.998645409Z [2024-06-27T04:43:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:43:00.998854886Z [2024-06-27T04:43:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:43:00.999187171Z [2024-06-27T04:43:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:43:00.999443518Z [2024-06-27T04:43:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:43:01.321965469Z [2024-06-27T04:43:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:42:00+00:00 exited with status queued for try_number 1 2024-06-27T04:43:01.322336447Z [2024-06-27T04:43:01.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:42:00+00:00 exited with status queued for try_number 1 2024-06-27T04:43:01.322568445Z [2024-06-27T04:43:01.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:42:00+00:00 exited with status queued for try_number 1 2024-06-27T04:43:01.336538946Z [2024-06-27T04:43:01.336+0000] {scheduler_job.py:635} INFO - Setting external_id for to adb98d58-cdc2-43d5-8ea6-76c89405e1ad 2024-06-27T04:43:01.337812827Z [2024-06-27T04:43:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec1e59b7-4c3d-4773-958a-a3b2e398cc63 2024-06-27T04:43:01.338205647Z [2024-06-27T04:43:01.338+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6632c7d7-324c-42de-91e8-524bf6c19ad5 2024-06-27T04:43:02.503089919Z [2024-06-27T04:43:02.502+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:43:02.503247916Z [2024-06-27T04:43:02.503+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:42:00+00:00, run_id=scheduled__2024-06-27T04:42:00+00:00, run_start_date=2024-06-27 04:43:00.931907+00:00, run_end_date=2024-06-27 04:43:02.502920+00:00, run_duration=1.571013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:42:00+00:00, data_interval_end=2024-06-27 04:43:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:43:02.514723900Z [2024-06-27T04:43:02.514+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:43:00+00:00, run_after=2024-06-27T04:44:00+00:00 2024-06-27T04:43:02.545875523Z [2024-06-27T04:43:02.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:42:00+00:00 exited with status success for try_number 1 2024-06-27T04:43:02.551570129Z [2024-06-27T04:43:02.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:42:00+00:00, map_index=-1, run_start_date=2024-06-27 04:43:01.921898+00:00, run_end_date=2024-06-27 04:43:02.313227+00:00, run_duration=0.391329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:43:00.994969+00:00, queued_by_job_id=2, pid=9429 2024-06-27T04:43:04.895164873Z [2024-06-27T04:43:04.894+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:43:04.897190822Z [2024-06-27T04:43:04.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:42:00+00:00, run_id=scheduled__2024-06-27T04:42:00+00:00, run_start_date=2024-06-27 04:43:00.933094+00:00, run_end_date=2024-06-27 04:43:04.895003+00:00, run_duration=3.961909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:42:00+00:00, data_interval_end=2024-06-27 04:43:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:43:04.910758695Z [2024-06-27T04:43:04.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:43:00+00:00, run_after=2024-06-27T04:44:00+00:00 2024-06-27T04:43:04.968938406Z [2024-06-27T04:43:04.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:42:00+00:00 exited with status success for try_number 1 2024-06-27T04:43:04.976951735Z [2024-06-27T04:43:04.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:42:00+00:00, map_index=-1, run_start_date=2024-06-27 04:43:03.143105+00:00, run_end_date=2024-06-27 04:43:04.466562+00:00, run_duration=1.323457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:43:00.994969+00:00, queued_by_job_id=2, pid=9460 2024-06-27T04:43:07.052094065Z [2024-06-27T04:43:07.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:43:07.052313877Z [2024-06-27T04:43:07.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:42:00+00:00, run_id=scheduled__2024-06-27T04:42:00+00:00, run_start_date=2024-06-27 04:43:00.934107+00:00, run_end_date=2024-06-27 04:43:07.051804+00:00, run_duration=6.117697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:42:00+00:00, data_interval_end=2024-06-27 04:43:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:43:07.061227494Z [2024-06-27T04:43:07.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:43:00+00:00, run_after=2024-06-27T04:44:00+00:00 2024-06-27T04:43:07.091087801Z [2024-06-27T04:43:07.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:42:00+00:00 exited with status success for try_number 1 2024-06-27T04:43:07.096360306Z [2024-06-27T04:43:07.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:42:00+00:00, map_index=-1, run_start_date=2024-06-27 04:43:02.995212+00:00, run_end_date=2024-06-27 04:43:06.274856+00:00, run_duration=3.279644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:43:00.994969+00:00, queued_by_job_id=2, pid=9459 2024-06-27T04:44:00.130346948Z [2024-06-27T04:44:00.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:44:00+00:00, run_after=2024-06-27T04:45:00+00:00 2024-06-27T04:44:00.141483762Z [2024-06-27T04:44:00.141+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:44:00.161576065Z [2024-06-27T04:44:00.161+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:44:00+00:00, run_after=2024-06-27T04:45:00+00:00 2024-06-27T04:44:00.171874339Z [2024-06-27T04:44:00.171+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:44:00.270755678Z [2024-06-27T04:44:00.270+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:44:00.270785337Z 2024-06-27T04:44:00.270791857Z 2024-06-27T04:44:00.270812669Z 2024-06-27T04:44:00.270817577Z 2024-06-27T04:44:00.270906002Z [2024-06-27T04:44:00.270+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:44:00.271052509Z [2024-06-27T04:44:00.270+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:44:00.271229378Z [2024-06-27T04:44:00.271+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:44:00.271375911Z [2024-06-27T04:44:00.271+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:44:00.272038803Z [2024-06-27T04:44:00.271+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:44:00.272054195Z 2024-06-27T04:44:00.272059442Z 2024-06-27T04:44:00.272063842Z 2024-06-27T04:44:00.272068362Z 2024-06-27T04:44:00.275944049Z [2024-06-27T04:44:00.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:44:00.276160548Z [2024-06-27T04:44:00.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:44:00.276460431Z [2024-06-27T04:44:00.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:44:00.276578264Z [2024-06-27T04:44:00.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:44:00.276859587Z [2024-06-27T04:44:00.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:44:00.276980994Z [2024-06-27T04:44:00.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:44:00.277202562Z [2024-06-27T04:44:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:44:00.277362646Z [2024-06-27T04:44:00.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:44:00.678097624Z [2024-06-27T04:44:00.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:42:00+00:00 exited with status queued for try_number 1 2024-06-27T04:44:00.678302761Z [2024-06-27T04:44:00.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:43:00+00:00 exited with status queued for try_number 1 2024-06-27T04:44:00.678568957Z [2024-06-27T04:44:00.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:43:00+00:00 exited with status queued for try_number 1 2024-06-27T04:44:00.678825173Z [2024-06-27T04:44:00.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:43:00+00:00 exited with status queued for try_number 1 2024-06-27T04:44:00.691164605Z [2024-06-27T04:44:00.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfb274cc-33bf-480d-862b-49fea65cb257 2024-06-27T04:44:00.691536224Z [2024-06-27T04:44:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2d2ed57-84f4-4b39-b301-ce434b148ae0 2024-06-27T04:44:00.691831956Z [2024-06-27T04:44:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38e9fc26-95bc-4b81-9863-61c39b2956f8 2024-06-27T04:44:00.692093605Z [2024-06-27T04:44:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 396fa6eb-7c71-437b-9fff-d4ada5219cf2 2024-06-27T04:44:01.925480337Z [2024-06-27T04:44:01.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:44:01.925798809Z [2024-06-27T04:44:01.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:42:00+00:00, run_id=scheduled__2024-06-27T04:42:00+00:00, run_start_date=2024-06-27 04:44:00.194643+00:00, run_end_date=2024-06-27 04:44:01.925398+00:00, run_duration=1.730755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:42:00+00:00, data_interval_end=2024-06-27 04:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:44:01.934550119Z [2024-06-27T04:44:01.934+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:44:00+00:00, run_after=2024-06-27T04:46:00+00:00 2024-06-27T04:44:01.957639934Z [2024-06-27T04:44:01.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:44:01.957835634Z [2024-06-27T04:44:01.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:43:00+00:00, run_id=scheduled__2024-06-27T04:43:00+00:00, run_start_date=2024-06-27 04:44:00.196675+00:00, run_end_date=2024-06-27 04:44:01.957558+00:00, run_duration=1.760883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:43:00+00:00, data_interval_end=2024-06-27 04:44:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:44:01.972417791Z [2024-06-27T04:44:01.971+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:44:00+00:00, run_after=2024-06-27T04:45:00+00:00 2024-06-27T04:44:02.016388171Z [2024-06-27T04:44:02.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:42:00+00:00 exited with status success for try_number 1 2024-06-27T04:44:02.016471025Z [2024-06-27T04:44:02.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:43:00+00:00 exited with status success for try_number 1 2024-06-27T04:44:02.025210068Z [2024-06-27T04:44:02.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:42:00+00:00, map_index=-1, run_start_date=2024-06-27 04:44:01.389299+00:00, run_end_date=2024-06-27 04:44:01.810965+00:00, run_duration=0.421666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:44:00.272985+00:00, queued_by_job_id=2, pid=9506 2024-06-27T04:44:02.025728959Z [2024-06-27T04:44:02.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:43:00+00:00, map_index=-1, run_start_date=2024-06-27 04:44:01.317446+00:00, run_end_date=2024-06-27 04:44:01.740022+00:00, run_duration=0.422576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:44:00.272985+00:00, queued_by_job_id=2, pid=9505 2024-06-27T04:44:04.493445560Z [2024-06-27T04:44:04.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:44:04.494225513Z [2024-06-27T04:44:04.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:43:00+00:00, run_id=scheduled__2024-06-27T04:43:00+00:00, run_start_date=2024-06-27 04:44:00.200119+00:00, run_end_date=2024-06-27 04:44:04.493661+00:00, run_duration=4.293542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:43:00+00:00, data_interval_end=2024-06-27 04:44:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:44:04.513978561Z [2024-06-27T04:44:04.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:44:00+00:00, run_after=2024-06-27T04:45:00+00:00 2024-06-27T04:44:04.521789368Z [2024-06-27T04:44:04.521+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:44:04.521968035Z [2024-06-27T04:44:04.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:43:00+00:00, run_id=scheduled__2024-06-27T04:43:00+00:00, run_start_date=2024-06-27 04:44:00.201690+00:00, run_end_date=2024-06-27 04:44:04.521714+00:00, run_duration=4.320024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:43:00+00:00, data_interval_end=2024-06-27 04:44:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:44:04.531206657Z [2024-06-27T04:44:04.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:44:00+00:00, run_after=2024-06-27T04:45:00+00:00 2024-06-27T04:44:04.573512421Z [2024-06-27T04:44:04.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:43:00+00:00 exited with status success for try_number 1 2024-06-27T04:44:04.574042407Z [2024-06-27T04:44:04.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:43:00+00:00 exited with status success for try_number 1 2024-06-27T04:44:04.584347587Z [2024-06-27T04:44:04.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:43:00+00:00, map_index=-1, run_start_date=2024-06-27 04:44:02.397731+00:00, run_end_date=2024-06-27 04:44:03.877558+00:00, run_duration=1.479827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:44:00.272985+00:00, queued_by_job_id=2, pid=9545 2024-06-27T04:44:04.584813497Z [2024-06-27T04:44:04.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:43:00+00:00, map_index=-1, run_start_date=2024-06-27 04:44:02.502287+00:00, run_end_date=2024-06-27 04:44:04.370919+00:00, run_duration=1.868632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:44:00.272985+00:00, queued_by_job_id=2, pid=9546 2024-06-27T04:45:01.020255441Z [2024-06-27T04:45:01.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:45:00+00:00, run_after=2024-06-27T04:50:00+00:00 2024-06-27T04:45:01.032974128Z [2024-06-27T04:45:01.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:45:00+00:00, run_after=2024-06-27T04:46:00+00:00 2024-06-27T04:45:01.042797470Z [2024-06-27T04:45:01.042+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:45:01.068139784Z [2024-06-27T04:45:01.067+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:45:00+00:00, run_after=2024-06-27T04:46:00+00:00 2024-06-27T04:45:01.188241188Z [2024-06-27T04:45:01.187+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:45:01.188280771Z 2024-06-27T04:45:01.188286415Z 2024-06-27T04:45:01.188290607Z 2024-06-27T04:45:01.188294752Z 2024-06-27T04:45:01.188637592Z [2024-06-27T04:45:01.188+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:45:01.188991866Z [2024-06-27T04:45:01.188+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:45:01.189372545Z [2024-06-27T04:45:01.189+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:45:01.189651408Z [2024-06-27T04:45:01.189+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:45:01.190496804Z [2024-06-27T04:45:01.190+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:45:01.190511663Z 2024-06-27T04:45:01.190516464Z 2024-06-27T04:45:01.190520936Z 2024-06-27T04:45:01.190525054Z 2024-06-27T04:45:01.195084121Z [2024-06-27T04:45:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:45:01.195461943Z [2024-06-27T04:45:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:45:01.195914588Z [2024-06-27T04:45:01.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:45:01.196237528Z [2024-06-27T04:45:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:45:01.196679421Z [2024-06-27T04:45:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:45:01.196935631Z [2024-06-27T04:45:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:45:01.197270222Z [2024-06-27T04:45:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:45:01.197776127Z [2024-06-27T04:45:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:45:01.558116572Z [2024-06-27T04:45:01.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status queued for try_number 1 2024-06-27T04:45:01.558258308Z [2024-06-27T04:45:01.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:44:00+00:00 exited with status queued for try_number 1 2024-06-27T04:45:01.558400261Z [2024-06-27T04:45:01.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:44:00+00:00 exited with status queued for try_number 1 2024-06-27T04:45:01.558511056Z [2024-06-27T04:45:01.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:44:00+00:00 exited with status queued for try_number 1 2024-06-27T04:45:01.568398009Z [2024-06-27T04:45:01.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to fca29b34-64f6-4b74-8922-3beafbbd0252 2024-06-27T04:45:01.568588342Z [2024-06-27T04:45:01.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3944490-8374-4f46-b2cf-ffbbf25a900a 2024-06-27T04:45:01.568777298Z [2024-06-27T04:45:01.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93de5635-fcf6-426c-a6c2-9ccd802f0d01 2024-06-27T04:45:01.568956847Z [2024-06-27T04:45:01.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecd7d85d-a01c-4b59-80a9-7535ea54ad16 2024-06-27T04:45:02.995851780Z [2024-06-27T04:45:02.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:45:02.995912345Z [2024-06-27T04:45:02.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:44:00+00:00, run_id=scheduled__2024-06-27T04:44:00+00:00, run_start_date=2024-06-27 04:45:01.092623+00:00, run_end_date=2024-06-27 04:45:02.995667+00:00, run_duration=1.903044, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:44:00+00:00, data_interval_end=2024-06-27 04:45:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:45:03.011429048Z [2024-06-27T04:45:03.011+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:45:00+00:00, run_after=2024-06-27T04:46:00+00:00 2024-06-27T04:45:03.042697772Z [2024-06-27T04:45:03.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:44:00+00:00 exited with status success for try_number 1 2024-06-27T04:45:03.049101661Z [2024-06-27T04:45:03.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:44:00+00:00, map_index=-1, run_start_date=2024-06-27 04:45:02.074743+00:00, run_end_date=2024-06-27 04:45:02.489927+00:00, run_duration=0.415184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:45:01.191702+00:00, queued_by_job_id=2, pid=9591 2024-06-27T04:45:03.931063941Z [2024-06-27T04:45:03.930+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:45:03.931097298Z 2024-06-27T04:45:03.931104061Z [2024-06-27T04:45:03.930+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:45:03.932020334Z [2024-06-27T04:45:03.931+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:45:03.932031940Z 2024-06-27T04:45:03.934949350Z [2024-06-27T04:45:03.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:45:03.935090347Z [2024-06-27T04:45:03.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:45:03.996246007Z [2024-06-27T04:45:03.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status queued for try_number 1 2024-06-27T04:45:03.996623409Z [2024-06-27T04:45:03.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status success for try_number 1 2024-06-27T04:45:04.005502522Z [2024-06-27T04:45:04.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83051999-b806-4434-8403-da8744762ded 2024-06-27T04:45:04.005991386Z [2024-06-27T04:45:04.005+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:40:00+00:00, map_index=-1, run_start_date=2024-06-27 04:45:03.214846+00:00, run_end_date=2024-06-27 04:45:03.648405+00:00, run_duration=0.433559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:45:01.191702+00:00, queued_by_job_id=2, pid=9631 2024-06-27T04:45:05.173014088Z [2024-06-27T04:45:05.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:45:05.173492046Z [2024-06-27T04:45:05.173+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:44:00+00:00, run_id=scheduled__2024-06-27T04:44:00+00:00, run_start_date=2024-06-27 04:45:01.093883+00:00, run_end_date=2024-06-27 04:45:05.172931+00:00, run_duration=4.079048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:44:00+00:00, data_interval_end=2024-06-27 04:45:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:45:05.189738740Z [2024-06-27T04:45:05.188+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:45:00+00:00, run_after=2024-06-27T04:46:00+00:00 2024-06-27T04:45:05.207221253Z [2024-06-27T04:45:05.199+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:45:05.207239498Z [2024-06-27T04:45:05.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:44:00+00:00, run_id=scheduled__2024-06-27T04:44:00+00:00, run_start_date=2024-06-27 04:45:01.094870+00:00, run_end_date=2024-06-27 04:45:05.199679+00:00, run_duration=4.104809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:44:00+00:00, data_interval_end=2024-06-27 04:45:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:45:05.218851405Z [2024-06-27T04:45:05.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:45:00+00:00, run_after=2024-06-27T04:46:00+00:00 2024-06-27T04:45:05.276319168Z [2024-06-27T04:45:05.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:44:00+00:00 exited with status success for try_number 1 2024-06-27T04:45:05.276376936Z [2024-06-27T04:45:05.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:44:00+00:00 exited with status success for try_number 1 2024-06-27T04:45:05.291402914Z [2024-06-27T04:45:05.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:44:00+00:00, map_index=-1, run_start_date=2024-06-27 04:45:03.411124+00:00, run_end_date=2024-06-27 04:45:04.634310+00:00, run_duration=1.223186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:45:01.191702+00:00, queued_by_job_id=2, pid=9633 2024-06-27T04:45:05.291947296Z [2024-06-27T04:45:05.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:44:00+00:00, map_index=-1, run_start_date=2024-06-27 04:45:03.365529+00:00, run_end_date=2024-06-27 04:45:04.893300+00:00, run_duration=1.527771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:45:01.191702+00:00, queued_by_job_id=2, pid=9632 2024-06-27T04:45:06.308952134Z [2024-06-27T04:45:06.308+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:45:06.309000124Z 2024-06-27T04:45:06.309155569Z [2024-06-27T04:45:06.308+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:45:06.309906449Z [2024-06-27T04:45:06.309+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:45:06.309920874Z 2024-06-27T04:45:06.312641236Z [2024-06-27T04:45:06.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:45:06.312825765Z [2024-06-27T04:45:06.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:45:06.388989301Z [2024-06-27T04:45:06.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status queued for try_number 1 2024-06-27T04:45:06.389012150Z [2024-06-27T04:45:06.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status success for try_number 1 2024-06-27T04:45:06.397414779Z [2024-06-27T04:45:06.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77415f98-f306-4290-82f3-8549766f8982 2024-06-27T04:45:06.397445822Z [2024-06-27T04:45:06.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T04:40:00+00:00, map_index=-1, run_start_date=2024-06-27 04:45:05.663156+00:00, run_end_date=2024-06-27 04:45:06.040486+00:00, run_duration=0.37733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:45:03.932409+00:00, queued_by_job_id=2, pid=9672 2024-06-27T04:45:06.428925586Z [2024-06-27T04:45:06.427+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T04:45:10.403808201Z [2024-06-27T04:45:10.403+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:45:10.403884795Z 2024-06-27T04:45:10.404368536Z [2024-06-27T04:45:10.404+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:45:10.406503105Z [2024-06-27T04:45:10.405+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:45:10.406529634Z 2024-06-27T04:45:10.411721717Z [2024-06-27T04:45:10.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:45:10.411887057Z [2024-06-27T04:45:10.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:45:10.479930136Z [2024-06-27T04:45:10.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status queued for try_number 1 2024-06-27T04:45:10.480823661Z [2024-06-27T04:45:10.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status success for try_number 1 2024-06-27T04:45:10.488377313Z [2024-06-27T04:45:10.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48133028-44b5-4aea-a4cc-ba1edfaf47b4 2024-06-27T04:45:10.488501908Z [2024-06-27T04:45:10.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:40:00+00:00, map_index=0, run_start_date=2024-06-27 04:45:08.026878+00:00, run_end_date=2024-06-27 04:45:09.466742+00:00, run_duration=1.439864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:45:06.310384+00:00, queued_by_job_id=2, pid=9684 2024-06-27T04:45:12.532359048Z [2024-06-27T04:45:12.531+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:45:12.533165939Z [2024-06-27T04:45:12.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:40:00+00:00, run_id=scheduled__2024-06-27T04:40:00+00:00, run_start_date=2024-06-27 04:45:01.091211+00:00, run_end_date=2024-06-27 04:45:12.532442+00:00, run_duration=11.441231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:40:00+00:00, data_interval_end=2024-06-27 04:45:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T04:45:12.544081489Z [2024-06-27T04:45:12.543+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:45:00+00:00, run_after=2024-06-27T04:50:00+00:00 2024-06-27T04:45:13.701456992Z [2024-06-27T04:45:13.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:40:00+00:00 exited with status success for try_number 1 2024-06-27T04:45:13.708624612Z [2024-06-27T04:45:13.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:40:00+00:00, map_index=-1, run_start_date=2024-06-27 04:45:12.064953+00:00, run_end_date=2024-06-27 04:45:12.488579+00:00, run_duration=0.423626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:45:10.406932+00:00, queued_by_job_id=2, pid=9705 2024-06-27T04:46:01.064894834Z [2024-06-27T04:46:01.064+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:46:01.096060397Z [2024-06-27T04:46:01.078+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:46:00+00:00, run_after=2024-06-27T04:47:00+00:00 2024-06-27T04:46:01.096084198Z [2024-06-27T04:46:01.086+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:46:01.109132468Z [2024-06-27T04:46:01.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:46:00+00:00, run_after=2024-06-27T04:47:00+00:00 2024-06-27T04:46:01.213317332Z [2024-06-27T04:46:01.212+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:46:01.213352087Z 2024-06-27T04:46:01.213362720Z 2024-06-27T04:46:01.213368934Z 2024-06-27T04:46:01.213374893Z 2024-06-27T04:46:01.213855237Z [2024-06-27T04:46:01.213+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:46:01.214251270Z [2024-06-27T04:46:01.214+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:46:01.214639131Z [2024-06-27T04:46:01.214+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:46:01.214996148Z [2024-06-27T04:46:01.214+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:46:01.216160601Z [2024-06-27T04:46:01.215+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:46:01.216250160Z 2024-06-27T04:46:01.216286289Z 2024-06-27T04:46:01.216292590Z 2024-06-27T04:46:01.216298536Z 2024-06-27T04:46:01.221991865Z [2024-06-27T04:46:01.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:46:01.222454960Z [2024-06-27T04:46:01.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:46:01.222899906Z [2024-06-27T04:46:01.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:46:01.223173797Z [2024-06-27T04:46:01.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:46:01.223564132Z [2024-06-27T04:46:01.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:46:01.223821514Z [2024-06-27T04:46:01.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:46:01.224208675Z [2024-06-27T04:46:01.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:46:01.224466594Z [2024-06-27T04:46:01.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:46:01.659342916Z [2024-06-27T04:46:01.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:44:00+00:00 exited with status queued for try_number 1 2024-06-27T04:46:01.659391950Z [2024-06-27T04:46:01.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status queued for try_number 1 2024-06-27T04:46:01.659397066Z [2024-06-27T04:46:01.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status queued for try_number 1 2024-06-27T04:46:01.659415278Z [2024-06-27T04:46:01.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status queued for try_number 1 2024-06-27T04:46:01.671200447Z [2024-06-27T04:46:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7971c70-ff10-4d83-8e7c-8a65558cdabb 2024-06-27T04:46:01.671265021Z [2024-06-27T04:46:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3283611d-d263-470f-bb14-7b52969dea31 2024-06-27T04:46:01.671359332Z [2024-06-27T04:46:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to bca6094c-9477-427f-8bc0-8c699c61a7c6 2024-06-27T04:46:01.671534112Z [2024-06-27T04:46:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd0b147e-fb8a-4ce2-83bd-9fd54db5b8eb 2024-06-27T04:46:02.946994496Z [2024-06-27T04:46:02.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:46:02.947292324Z [2024-06-27T04:46:02.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:44:00+00:00, run_id=scheduled__2024-06-27T04:44:00+00:00, run_start_date=2024-06-27 04:46:01.122160+00:00, run_end_date=2024-06-27 04:46:02.946843+00:00, run_duration=1.824683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:44:00+00:00, data_interval_end=2024-06-27 04:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:46:02.957454794Z [2024-06-27T04:46:02.957+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:46:00+00:00, run_after=2024-06-27T04:48:00+00:00 2024-06-27T04:46:02.971001341Z [2024-06-27T04:46:02.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:46:02.971162735Z [2024-06-27T04:46:02.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:45:00+00:00, run_id=scheduled__2024-06-27T04:45:00+00:00, run_start_date=2024-06-27 04:46:01.123653+00:00, run_end_date=2024-06-27 04:46:02.970902+00:00, run_duration=1.847249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:45:00+00:00, data_interval_end=2024-06-27 04:46:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:46:02.980395703Z [2024-06-27T04:46:02.980+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:46:00+00:00, run_after=2024-06-27T04:47:00+00:00 2024-06-27T04:46:03.017959929Z [2024-06-27T04:46:03.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:44:00+00:00 exited with status success for try_number 1 2024-06-27T04:46:03.018166595Z [2024-06-27T04:46:03.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status success for try_number 1 2024-06-27T04:46:03.025705643Z [2024-06-27T04:46:03.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:44:00+00:00, map_index=-1, run_start_date=2024-06-27 04:46:02.116799+00:00, run_end_date=2024-06-27 04:46:02.481080+00:00, run_duration=0.364281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:46:01.218170+00:00, queued_by_job_id=2, pid=9731 2024-06-27T04:46:03.025940147Z [2024-06-27T04:46:03.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:45:00+00:00, map_index=-1, run_start_date=2024-06-27 04:46:02.116634+00:00, run_end_date=2024-06-27 04:46:02.550516+00:00, run_duration=0.433882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:46:01.218170+00:00, queued_by_job_id=2, pid=9732 2024-06-27T04:46:05.551448816Z [2024-06-27T04:46:05.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:46:05.551985624Z [2024-06-27T04:46:05.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:45:00+00:00, run_id=scheduled__2024-06-27T04:45:00+00:00, run_start_date=2024-06-27 04:46:01.126305+00:00, run_end_date=2024-06-27 04:46:05.551364+00:00, run_duration=4.425059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:45:00+00:00, data_interval_end=2024-06-27 04:46:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:46:05.562541961Z [2024-06-27T04:46:05.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:46:00+00:00, run_after=2024-06-27T04:47:00+00:00 2024-06-27T04:46:05.572652449Z [2024-06-27T04:46:05.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:46:05.572695553Z [2024-06-27T04:46:05.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:45:00+00:00, run_id=scheduled__2024-06-27T04:45:00+00:00, run_start_date=2024-06-27 04:46:01.125136+00:00, run_end_date=2024-06-27 04:46:05.572468+00:00, run_duration=4.447332, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:45:00+00:00, data_interval_end=2024-06-27 04:46:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:46:05.583450754Z [2024-06-27T04:46:05.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:46:00+00:00, run_after=2024-06-27T04:47:00+00:00 2024-06-27T04:46:05.630609788Z [2024-06-27T04:46:05.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status success for try_number 1 2024-06-27T04:46:05.630941673Z [2024-06-27T04:46:05.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status success for try_number 1 2024-06-27T04:46:05.642534012Z [2024-06-27T04:46:05.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:45:00+00:00, map_index=-1, run_start_date=2024-06-27 04:46:03.294237+00:00, run_end_date=2024-06-27 04:46:05.225546+00:00, run_duration=1.931309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:46:01.218170+00:00, queued_by_job_id=2, pid=9771 2024-06-27T04:46:05.642588362Z [2024-06-27T04:46:05.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:45:00+00:00, map_index=-1, run_start_date=2024-06-27 04:46:03.443110+00:00, run_end_date=2024-06-27 04:46:05.160359+00:00, run_duration=1.717249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:46:01.218170+00:00, queued_by_job_id=2, pid=9772 2024-06-27T04:47:00.995024739Z [2024-06-27T04:47:00.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:47:00+00:00, run_after=2024-06-27T04:48:00+00:00 2024-06-27T04:47:01.005461281Z [2024-06-27T04:47:01.005+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:47:01.018410547Z [2024-06-27T04:47:01.016+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:47:00+00:00, run_after=2024-06-27T04:48:00+00:00 2024-06-27T04:47:01.132198124Z [2024-06-27T04:47:01.129+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:47:01.132238889Z 2024-06-27T04:47:01.132243013Z 2024-06-27T04:47:01.132246264Z 2024-06-27T04:47:01.132249862Z [2024-06-27T04:47:01.129+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:47:01.132252909Z [2024-06-27T04:47:01.129+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:47:01.132256170Z [2024-06-27T04:47:01.129+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:47:01.134750332Z [2024-06-27T04:47:01.130+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:47:01.135209490Z 2024-06-27T04:47:01.135219228Z 2024-06-27T04:47:01.135222791Z 2024-06-27T04:47:01.135243422Z [2024-06-27T04:47:01.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:47:01.135246987Z [2024-06-27T04:47:01.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:47:01.135250049Z [2024-06-27T04:47:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:47:01.135252987Z [2024-06-27T04:47:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:47:01.135255900Z [2024-06-27T04:47:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:47:01.135258793Z [2024-06-27T04:47:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:47:01.338654775Z [2024-06-27T04:47:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:46:00+00:00 exited with status queued for try_number 1 2024-06-27T04:47:01.338679635Z [2024-06-27T04:47:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:46:00+00:00 exited with status queued for try_number 1 2024-06-27T04:47:01.338683431Z [2024-06-27T04:47:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:46:00+00:00 exited with status queued for try_number 1 2024-06-27T04:47:01.346681234Z [2024-06-27T04:47:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6944b1f9-99f8-4240-8243-b92e40a6a1fd 2024-06-27T04:47:01.346762100Z [2024-06-27T04:47:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebc7a4cb-af94-4bb9-b4bd-915a0926b960 2024-06-27T04:47:01.346851951Z [2024-06-27T04:47:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19d1b4ac-1233-42de-8ba9-f93b1469e041 2024-06-27T04:47:02.501484998Z [2024-06-27T04:47:02.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:47:02.501845943Z [2024-06-27T04:47:02.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:46:00+00:00, run_id=scheduled__2024-06-27T04:46:00+00:00, run_start_date=2024-06-27 04:47:01.031835+00:00, run_end_date=2024-06-27 04:47:02.501477+00:00, run_duration=1.469642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:46:00+00:00, data_interval_end=2024-06-27 04:47:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:47:02.516684971Z [2024-06-27T04:47:02.516+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:47:00+00:00, run_after=2024-06-27T04:48:00+00:00 2024-06-27T04:47:02.573288325Z [2024-06-27T04:47:02.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:46:00+00:00 exited with status success for try_number 1 2024-06-27T04:47:02.581816196Z [2024-06-27T04:47:02.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:46:00+00:00, map_index=-1, run_start_date=2024-06-27 04:47:01.873157+00:00, run_end_date=2024-06-27 04:47:02.321085+00:00, run_duration=0.447928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:47:01.130978+00:00, queued_by_job_id=2, pid=9816 2024-06-27T04:47:06.052615670Z [2024-06-27T04:47:06.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:47:06.053230008Z [2024-06-27T04:47:06.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:46:00+00:00, run_id=scheduled__2024-06-27T04:46:00+00:00, run_start_date=2024-06-27 04:47:01.033273+00:00, run_end_date=2024-06-27 04:47:06.052460+00:00, run_duration=5.019187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:46:00+00:00, data_interval_end=2024-06-27 04:47:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:47:06.067469516Z [2024-06-27T04:47:06.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:47:00+00:00, run_after=2024-06-27T04:48:00+00:00 2024-06-27T04:47:06.080432468Z [2024-06-27T04:47:06.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:47:06.081514984Z [2024-06-27T04:47:06.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:46:00+00:00, run_id=scheduled__2024-06-27T04:46:00+00:00, run_start_date=2024-06-27 04:47:01.034330+00:00, run_end_date=2024-06-27 04:47:06.080287+00:00, run_duration=5.045957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:46:00+00:00, data_interval_end=2024-06-27 04:47:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:47:06.093427967Z [2024-06-27T04:47:06.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:47:00+00:00, run_after=2024-06-27T04:48:00+00:00 2024-06-27T04:47:06.132859347Z [2024-06-27T04:47:06.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:46:00+00:00 exited with status success for try_number 1 2024-06-27T04:47:06.132904549Z [2024-06-27T04:47:06.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:46:00+00:00 exited with status success for try_number 1 2024-06-27T04:47:06.142662468Z [2024-06-27T04:47:06.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:46:00+00:00, map_index=-1, run_start_date=2024-06-27 04:47:03.031134+00:00, run_end_date=2024-06-27 04:47:05.037305+00:00, run_duration=2.006171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:47:01.130978+00:00, queued_by_job_id=2, pid=9846 2024-06-27T04:47:06.142899192Z [2024-06-27T04:47:06.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:46:00+00:00, map_index=-1, run_start_date=2024-06-27 04:47:03.038014+00:00, run_end_date=2024-06-27 04:47:05.707265+00:00, run_duration=2.669251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:47:01.130978+00:00, queued_by_job_id=2, pid=9847 2024-06-27T04:48:00.932631880Z [2024-06-27T04:48:00.930+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:48:00+00:00, run_after=2024-06-27T04:49:00+00:00 2024-06-27T04:48:00.944523659Z [2024-06-27T04:48:00.944+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:48:00.953085715Z [2024-06-27T04:48:00.952+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:48:00.966214203Z [2024-06-27T04:48:00.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:48:00+00:00, run_after=2024-06-27T04:49:00+00:00 2024-06-27T04:48:01.080828082Z [2024-06-27T04:48:01.077+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:48:01.080851982Z 2024-06-27T04:48:01.080856662Z 2024-06-27T04:48:01.080859884Z 2024-06-27T04:48:01.080863334Z 2024-06-27T04:48:01.080867830Z [2024-06-27T04:48:01.077+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:48:01.080871078Z [2024-06-27T04:48:01.077+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:48:01.080886881Z [2024-06-27T04:48:01.077+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:48:01.080890033Z [2024-06-27T04:48:01.078+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:48:01.080899558Z [2024-06-27T04:48:01.080+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:48:01.080902842Z 2024-06-27T04:48:01.080905895Z 2024-06-27T04:48:01.080908793Z 2024-06-27T04:48:01.080911704Z 2024-06-27T04:48:01.088501421Z [2024-06-27T04:48:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:48:01.102740820Z [2024-06-27T04:48:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:48:01.102760185Z [2024-06-27T04:48:01.094+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:48:01.102763646Z [2024-06-27T04:48:01.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:48:01.102766861Z [2024-06-27T04:48:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:48:01.102770045Z [2024-06-27T04:48:01.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:48:01.102773028Z [2024-06-27T04:48:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:48:01.102776141Z [2024-06-27T04:48:01.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:48:01.501042285Z [2024-06-27T04:48:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:46:00+00:00 exited with status queued for try_number 1 2024-06-27T04:48:01.501188191Z [2024-06-27T04:48:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:47:00+00:00 exited with status queued for try_number 1 2024-06-27T04:48:01.501329335Z [2024-06-27T04:48:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:47:00+00:00 exited with status queued for try_number 1 2024-06-27T04:48:01.501429590Z [2024-06-27T04:48:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:47:00+00:00 exited with status queued for try_number 1 2024-06-27T04:48:01.519626140Z [2024-06-27T04:48:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30e0d883-818c-47b1-94b4-e022a4aa013b 2024-06-27T04:48:01.519845636Z [2024-06-27T04:48:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to e69707c0-60c4-47db-a417-95af3f39d3db 2024-06-27T04:48:01.521040589Z [2024-06-27T04:48:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fe1435d-0a5e-410b-94a0-65d8e081caaa 2024-06-27T04:48:01.521234889Z [2024-06-27T04:48:01.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8d9dbfd-70dc-4169-aade-7384cfe7fa4f 2024-06-27T04:48:02.890482290Z [2024-06-27T04:48:02.889+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:48:02.892800760Z [2024-06-27T04:48:02.890+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:47:00+00:00, run_id=scheduled__2024-06-27T04:47:00+00:00, run_start_date=2024-06-27 04:48:00.981945+00:00, run_end_date=2024-06-27 04:48:02.890416+00:00, run_duration=1.908471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:47:00+00:00, data_interval_end=2024-06-27 04:48:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:48:02.912521828Z [2024-06-27T04:48:02.912+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:48:00+00:00, run_after=2024-06-27T04:49:00+00:00 2024-06-27T04:48:02.999476209Z [2024-06-27T04:48:02.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:47:00+00:00 exited with status success for try_number 1 2024-06-27T04:48:03.011063080Z [2024-06-27T04:48:03.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:47:00+00:00, map_index=-1, run_start_date=2024-06-27 04:48:02.136690+00:00, run_end_date=2024-06-27 04:48:02.656471+00:00, run_duration=0.519781, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:48:01.083064+00:00, queued_by_job_id=2, pid=9893 2024-06-27T04:48:04.055835051Z [2024-06-27T04:48:04.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:48:04.055970882Z [2024-06-27T04:48:04.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:46:00+00:00, run_id=scheduled__2024-06-27T04:46:00+00:00, run_start_date=2024-06-27 04:48:00.980072+00:00, run_end_date=2024-06-27 04:48:04.055727+00:00, run_duration=3.075655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:46:00+00:00, data_interval_end=2024-06-27 04:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:48:04.063168583Z [2024-06-27T04:48:04.062+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:48:00+00:00, run_after=2024-06-27T04:50:00+00:00 2024-06-27T04:48:04.136648461Z [2024-06-27T04:48:04.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:46:00+00:00 exited with status success for try_number 1 2024-06-27T04:48:04.142767647Z [2024-06-27T04:48:04.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:46:00+00:00, map_index=-1, run_start_date=2024-06-27 04:48:02.301984+00:00, run_end_date=2024-06-27 04:48:02.970780+00:00, run_duration=0.668796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:48:01.083064+00:00, queued_by_job_id=2, pid=9895 2024-06-27T04:48:05.396241597Z [2024-06-27T04:48:05.395+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:48:05.396707496Z [2024-06-27T04:48:05.396+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:47:00+00:00, run_id=scheduled__2024-06-27T04:47:00+00:00, run_start_date=2024-06-27 04:48:00.983141+00:00, run_end_date=2024-06-27 04:48:05.396079+00:00, run_duration=4.412938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:47:00+00:00, data_interval_end=2024-06-27 04:48:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:48:05.413270465Z [2024-06-27T04:48:05.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:48:00+00:00, run_after=2024-06-27T04:49:00+00:00 2024-06-27T04:48:05.492682929Z [2024-06-27T04:48:05.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:47:00+00:00 exited with status success for try_number 1 2024-06-27T04:48:05.499803810Z [2024-06-27T04:48:05.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:47:00+00:00, map_index=-1, run_start_date=2024-06-27 04:48:03.734846+00:00, run_end_date=2024-06-27 04:48:05.175995+00:00, run_duration=1.441149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:48:01.083064+00:00, queued_by_job_id=2, pid=9934 2024-06-27T04:48:06.564402876Z [2024-06-27T04:48:06.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:48:06.564710812Z [2024-06-27T04:48:06.564+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:47:00+00:00, run_id=scheduled__2024-06-27T04:47:00+00:00, run_start_date=2024-06-27 04:48:00.984178+00:00, run_end_date=2024-06-27 04:48:06.564217+00:00, run_duration=5.580039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:47:00+00:00, data_interval_end=2024-06-27 04:48:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:48:06.578634902Z [2024-06-27T04:48:06.578+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:48:00+00:00, run_after=2024-06-27T04:49:00+00:00 2024-06-27T04:48:06.624718733Z [2024-06-27T04:48:06.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:47:00+00:00 exited with status success for try_number 1 2024-06-27T04:48:06.632083040Z [2024-06-27T04:48:06.631+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:47:00+00:00, map_index=-1, run_start_date=2024-06-27 04:48:03.616908+00:00, run_end_date=2024-06-27 04:48:05.509796+00:00, run_duration=1.892888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:48:01.083064+00:00, queued_by_job_id=2, pid=9933 2024-06-27T04:49:00.062756186Z [2024-06-27T04:49:00.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:49:00+00:00, run_after=2024-06-27T04:50:00+00:00 2024-06-27T04:49:00.084944463Z [2024-06-27T04:49:00.084+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:49:00.108240259Z [2024-06-27T04:49:00.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:49:00+00:00, run_after=2024-06-27T04:50:00+00:00 2024-06-27T04:49:00.206907890Z [2024-06-27T04:49:00.206+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:49:00.206930769Z 2024-06-27T04:49:00.206934586Z 2024-06-27T04:49:00.206937833Z 2024-06-27T04:49:00.207801593Z [2024-06-27T04:49:00.206+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:49:00.208457977Z [2024-06-27T04:49:00.207+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:49:00.208555001Z [2024-06-27T04:49:00.208+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:49:00.209153758Z [2024-06-27T04:49:00.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:49:00.209176313Z 2024-06-27T04:49:00.209179983Z 2024-06-27T04:49:00.209183338Z 2024-06-27T04:49:00.212968841Z [2024-06-27T04:49:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:49:00.213058825Z [2024-06-27T04:49:00.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:49:00.213460304Z [2024-06-27T04:49:00.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:49:00.213650642Z [2024-06-27T04:49:00.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:49:00.213970414Z [2024-06-27T04:49:00.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:49:00.214160913Z [2024-06-27T04:49:00.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:49:00.625843574Z [2024-06-27T04:49:00.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:48:00+00:00 exited with status queued for try_number 1 2024-06-27T04:49:00.625907423Z [2024-06-27T04:49:00.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:48:00+00:00 exited with status queued for try_number 1 2024-06-27T04:49:00.626057394Z [2024-06-27T04:49:00.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:48:00+00:00 exited with status queued for try_number 1 2024-06-27T04:49:00.633822744Z [2024-06-27T04:49:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 251433b4-6b83-4a1e-b4e8-5e16057fa834 2024-06-27T04:49:00.633976849Z [2024-06-27T04:49:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a281e0f-f5ac-4420-8c26-685328d1c099 2024-06-27T04:49:00.634128107Z [2024-06-27T04:49:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21011fe9-d51e-4962-92ab-aa5e4da7412f 2024-06-27T04:49:01.960717779Z [2024-06-27T04:49:01.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:49:01.961243057Z [2024-06-27T04:49:01.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:48:00+00:00, run_id=scheduled__2024-06-27T04:48:00+00:00, run_start_date=2024-06-27 04:49:00.130002+00:00, run_end_date=2024-06-27 04:49:01.960647+00:00, run_duration=1.830645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:48:00+00:00, data_interval_end=2024-06-27 04:49:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:49:01.975650143Z [2024-06-27T04:49:01.975+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:49:00+00:00, run_after=2024-06-27T04:50:00+00:00 2024-06-27T04:49:02.015463673Z [2024-06-27T04:49:02.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:48:00+00:00 exited with status success for try_number 1 2024-06-27T04:49:02.021628657Z [2024-06-27T04:49:02.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:48:00+00:00, map_index=-1, run_start_date=2024-06-27 04:49:01.428911+00:00, run_end_date=2024-06-27 04:49:01.849121+00:00, run_duration=0.42021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:49:00.210059+00:00, queued_by_job_id=2, pid=9979 2024-06-27T04:49:04.190295632Z [2024-06-27T04:49:04.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:49:04.190527103Z [2024-06-27T04:49:04.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:48:00+00:00, run_id=scheduled__2024-06-27T04:48:00+00:00, run_start_date=2024-06-27 04:49:00.134866+00:00, run_end_date=2024-06-27 04:49:04.190077+00:00, run_duration=4.055211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:48:00+00:00, data_interval_end=2024-06-27 04:49:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:49:04.204716453Z [2024-06-27T04:49:04.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:49:00+00:00, run_after=2024-06-27T04:50:00+00:00 2024-06-27T04:49:04.214779409Z [2024-06-27T04:49:04.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:49:04.215368360Z [2024-06-27T04:49:04.214+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:48:00+00:00, run_id=scheduled__2024-06-27T04:48:00+00:00, run_start_date=2024-06-27 04:49:00.136059+00:00, run_end_date=2024-06-27 04:49:04.214645+00:00, run_duration=4.078586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:48:00+00:00, data_interval_end=2024-06-27 04:49:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:49:04.229383632Z [2024-06-27T04:49:04.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:49:00+00:00, run_after=2024-06-27T04:50:00+00:00 2024-06-27T04:49:04.275724064Z [2024-06-27T04:49:04.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:48:00+00:00 exited with status success for try_number 1 2024-06-27T04:49:04.275766497Z [2024-06-27T04:49:04.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:48:00+00:00 exited with status success for try_number 1 2024-06-27T04:49:04.284174304Z [2024-06-27T04:49:04.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:48:00+00:00, map_index=-1, run_start_date=2024-06-27 04:49:02.341390+00:00, run_end_date=2024-06-27 04:49:03.713326+00:00, run_duration=1.371936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:49:00.210059+00:00, queued_by_job_id=2, pid=10009 2024-06-27T04:49:04.284230242Z [2024-06-27T04:49:04.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:48:00+00:00, map_index=-1, run_start_date=2024-06-27 04:49:02.237972+00:00, run_end_date=2024-06-27 04:49:03.896034+00:00, run_duration=1.658062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:49:00.210059+00:00, queued_by_job_id=2, pid=10008 2024-06-27T04:50:00.995490527Z [2024-06-27T04:50:00.994+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:50:01.018234575Z [2024-06-27T04:50:01.017+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:50:00+00:00, run_after=2024-06-27T04:55:00+00:00 2024-06-27T04:50:01.032470716Z [2024-06-27T04:50:01.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:50:00+00:00, run_after=2024-06-27T04:51:00+00:00 2024-06-27T04:50:01.041842262Z [2024-06-27T04:50:01.041+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:50:01.066037933Z [2024-06-27T04:50:01.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:50:00+00:00, run_after=2024-06-27T04:51:00+00:00 2024-06-27T04:50:01.215028543Z [2024-06-27T04:50:01.214+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T04:50:01.215060472Z 2024-06-27T04:50:01.215082899Z 2024-06-27T04:50:01.215088259Z 2024-06-27T04:50:01.215092205Z 2024-06-27T04:50:01.215096201Z 2024-06-27T04:50:01.215483185Z [2024-06-27T04:50:01.215+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:50:01.215753310Z [2024-06-27T04:50:01.215+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:50:01.216109940Z [2024-06-27T04:50:01.215+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:50:01.216716695Z [2024-06-27T04:50:01.216+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:50:01.217054045Z [2024-06-27T04:50:01.216+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:50:01.218163267Z [2024-06-27T04:50:01.217+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:50:01.218178027Z 2024-06-27T04:50:01.218183042Z 2024-06-27T04:50:01.218187362Z 2024-06-27T04:50:01.218191457Z 2024-06-27T04:50:01.218195490Z 2024-06-27T04:50:01.224370059Z [2024-06-27T04:50:01.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:50:01.224693556Z [2024-06-27T04:50:01.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:50:01.225311266Z [2024-06-27T04:50:01.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:50:01.225700131Z [2024-06-27T04:50:01.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:50:01.226118484Z [2024-06-27T04:50:01.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:50:01.226413183Z [2024-06-27T04:50:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:50:01.227798012Z [2024-06-27T04:50:01.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:50:01.228014860Z [2024-06-27T04:50:01.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:50:01.228421688Z [2024-06-27T04:50:01.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:50:01.228614833Z [2024-06-27T04:50:01.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:50:01.776312063Z [2024-06-27T04:50:01.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status queued for try_number 1 2024-06-27T04:50:01.776383459Z [2024-06-27T04:50:01.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:48:00+00:00 exited with status queued for try_number 1 2024-06-27T04:50:01.776420210Z [2024-06-27T04:50:01.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:49:00+00:00 exited with status queued for try_number 1 2024-06-27T04:50:01.776433003Z [2024-06-27T04:50:01.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:49:00+00:00 exited with status queued for try_number 1 2024-06-27T04:50:01.776494046Z [2024-06-27T04:50:01.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:49:00+00:00 exited with status queued for try_number 1 2024-06-27T04:50:01.793061541Z [2024-06-27T04:50:01.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1cddfeb-8392-4b53-9826-f5ae091a2c0b 2024-06-27T04:50:01.793123517Z [2024-06-27T04:50:01.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19b2ab3c-6109-407a-b917-a01c726476bc 2024-06-27T04:50:01.793256490Z [2024-06-27T04:50:01.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to d52eead7-f233-48f0-b862-07d612c4d13f 2024-06-27T04:50:01.793358248Z [2024-06-27T04:50:01.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to a111d0e5-2799-4708-9679-6c0ad1fdf803 2024-06-27T04:50:01.793438695Z [2024-06-27T04:50:01.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0aff235-b961-445b-9f05-f1444e5ff21d 2024-06-27T04:50:03.116263588Z [2024-06-27T04:50:03.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:50:03.119202828Z [2024-06-27T04:50:03.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:49:00+00:00, run_id=scheduled__2024-06-27T04:49:00+00:00, run_start_date=2024-06-27 04:50:01.103556+00:00, run_end_date=2024-06-27 04:50:03.116190+00:00, run_duration=2.012634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:49:00+00:00, data_interval_end=2024-06-27 04:50:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:50:03.136006902Z [2024-06-27T04:50:03.135+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:50:00+00:00, run_after=2024-06-27T04:51:00+00:00 2024-06-27T04:50:04.250797231Z [2024-06-27T04:50:04.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:50:04.251504493Z [2024-06-27T04:50:04.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:48:00+00:00, run_id=scheduled__2024-06-27T04:48:00+00:00, run_start_date=2024-06-27 04:50:01.101977+00:00, run_end_date=2024-06-27 04:50:04.250682+00:00, run_duration=3.148705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:48:00+00:00, data_interval_end=2024-06-27 04:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:50:04.262351498Z [2024-06-27T04:50:04.261+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:50:00+00:00, run_after=2024-06-27T04:52:00+00:00 2024-06-27T04:50:04.334576058Z [2024-06-27T04:50:04.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:48:00+00:00 exited with status success for try_number 1 2024-06-27T04:50:04.334850385Z [2024-06-27T04:50:04.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:49:00+00:00 exited with status success for try_number 1 2024-06-27T04:50:04.342545139Z [2024-06-27T04:50:04.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:48:00+00:00, map_index=-1, run_start_date=2024-06-27 04:50:02.572861+00:00, run_end_date=2024-06-27 04:50:03.209789+00:00, run_duration=0.636928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:50:01.220342+00:00, queued_by_job_id=2, pid=10056 2024-06-27T04:50:04.342894154Z [2024-06-27T04:50:04.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:49:00+00:00, map_index=-1, run_start_date=2024-06-27 04:50:02.538098+00:00, run_end_date=2024-06-27 04:50:03.096286+00:00, run_duration=0.558188, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:50:01.220342+00:00, queued_by_job_id=2, pid=10055 2024-06-27T04:50:05.446923460Z [2024-06-27T04:50:05.446+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:50:05.446952197Z 2024-06-27T04:50:05.447173505Z [2024-06-27T04:50:05.446+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:50:05.448575440Z [2024-06-27T04:50:05.448+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:50:05.448595886Z 2024-06-27T04:50:05.451608169Z [2024-06-27T04:50:05.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T04:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:50:05.451720592Z [2024-06-27T04:50:05.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:50:05.544642930Z [2024-06-27T04:50:05.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status queued for try_number 1 2024-06-27T04:50:05.544996566Z [2024-06-27T04:50:05.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status success for try_number 1 2024-06-27T04:50:05.550977019Z [2024-06-27T04:50:05.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09d8d3ef-19d7-4668-bab8-0cee1f53215a 2024-06-27T04:50:05.551371564Z [2024-06-27T04:50:05.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:45:00+00:00, map_index=-1, run_start_date=2024-06-27 04:50:04.382824+00:00, run_end_date=2024-06-27 04:50:04.812717+00:00, run_duration=0.429893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:50:01.220342+00:00, queued_by_job_id=2, pid=10108 2024-06-27T04:50:06.317234821Z [2024-06-27T04:50:06.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:50:06.317763550Z [2024-06-27T04:50:06.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:49:00+00:00, run_id=scheduled__2024-06-27T04:49:00+00:00, run_start_date=2024-06-27 04:50:01.105888+00:00, run_end_date=2024-06-27 04:50:06.317075+00:00, run_duration=5.211187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:49:00+00:00, data_interval_end=2024-06-27 04:50:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:50:06.329819627Z [2024-06-27T04:50:06.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:50:00+00:00, run_after=2024-06-27T04:51:00+00:00 2024-06-27T04:50:06.344120994Z [2024-06-27T04:50:06.343+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:50:06.344426835Z [2024-06-27T04:50:06.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:49:00+00:00, run_id=scheduled__2024-06-27T04:49:00+00:00, run_start_date=2024-06-27 04:50:01.104745+00:00, run_end_date=2024-06-27 04:50:06.344119+00:00, run_duration=5.239374, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:49:00+00:00, data_interval_end=2024-06-27 04:50:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:50:06.355537625Z [2024-06-27T04:50:06.355+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:50:00+00:00, run_after=2024-06-27T04:51:00+00:00 2024-06-27T04:50:06.452154948Z [2024-06-27T04:50:06.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:49:00+00:00 exited with status success for try_number 1 2024-06-27T04:50:06.452416729Z [2024-06-27T04:50:06.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:49:00+00:00 exited with status success for try_number 1 2024-06-27T04:50:06.466755480Z [2024-06-27T04:50:06.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:49:00+00:00, map_index=-1, run_start_date=2024-06-27 04:50:04.075107+00:00, run_end_date=2024-06-27 04:50:05.695916+00:00, run_duration=1.620809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:50:01.220342+00:00, queued_by_job_id=2, pid=10087 2024-06-27T04:50:06.467175215Z [2024-06-27T04:50:06.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:49:00+00:00, map_index=-1, run_start_date=2024-06-27 04:50:04.577779+00:00, run_end_date=2024-06-27 04:50:05.918672+00:00, run_duration=1.340893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:50:01.220342+00:00, queued_by_job_id=2, pid=10116 2024-06-27T04:50:06.485970556Z [2024-06-27T04:50:06.485+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T04:50:08.194584277Z [2024-06-27T04:50:08.186+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:50:08.194618441Z 2024-06-27T04:50:08.194634534Z [2024-06-27T04:50:08.186+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:50:08.194638228Z [2024-06-27T04:50:08.187+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:50:08.194640985Z 2024-06-27T04:50:08.194644947Z [2024-06-27T04:50:08.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:50:08.194647836Z [2024-06-27T04:50:08.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:50:08.279927140Z [2024-06-27T04:50:08.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status queued for try_number 1 2024-06-27T04:50:08.280075645Z [2024-06-27T04:50:08.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status success for try_number 1 2024-06-27T04:50:08.297866008Z [2024-06-27T04:50:08.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2683d65c-4696-46ed-8b9e-9a08175100c9 2024-06-27T04:50:08.298550813Z [2024-06-27T04:50:08.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T04:45:00+00:00, map_index=-1, run_start_date=2024-06-27 04:50:07.234063+00:00, run_end_date=2024-06-27 04:50:07.655894+00:00, run_duration=0.421831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:50:05.448966+00:00, queued_by_job_id=2, pid=10146 2024-06-27T04:50:11.765897136Z [2024-06-27T04:50:11.765+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:50:11.765959496Z 2024-06-27T04:50:11.766299282Z [2024-06-27T04:50:11.765+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:50:11.767222613Z [2024-06-27T04:50:11.766+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:50:11.767246794Z 2024-06-27T04:50:11.770804754Z [2024-06-27T04:50:11.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:50:11.771230001Z [2024-06-27T04:50:11.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:50:11.843411286Z [2024-06-27T04:50:11.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status queued for try_number 1 2024-06-27T04:50:11.843967374Z [2024-06-27T04:50:11.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status success for try_number 1 2024-06-27T04:50:11.852197891Z [2024-06-27T04:50:11.851+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9e00fc0-6071-4686-b7f8-a8e6c1b7e5cd 2024-06-27T04:50:11.852751718Z [2024-06-27T04:50:11.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:45:00+00:00, map_index=0, run_start_date=2024-06-27 04:50:10.155288+00:00, run_end_date=2024-06-27 04:50:11.552346+00:00, run_duration=1.397058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:50:08.187800+00:00, queued_by_job_id=2, pid=10158 2024-06-27T04:50:14.040158731Z [2024-06-27T04:50:14.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:50:14.041154995Z [2024-06-27T04:50:14.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:45:00+00:00, run_id=scheduled__2024-06-27T04:45:00+00:00, run_start_date=2024-06-27 04:50:01.087259+00:00, run_end_date=2024-06-27 04:50:14.039962+00:00, run_duration=12.952703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:45:00+00:00, data_interval_end=2024-06-27 04:50:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T04:50:14.047852105Z [2024-06-27T04:50:14.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:50:00+00:00, run_after=2024-06-27T04:55:00+00:00 2024-06-27T04:50:15.138156766Z [2024-06-27T04:50:15.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:45:00+00:00 exited with status success for try_number 1 2024-06-27T04:50:15.142787366Z [2024-06-27T04:50:15.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:45:00+00:00, map_index=-1, run_start_date=2024-06-27 04:50:13.554938+00:00, run_end_date=2024-06-27 04:50:13.977917+00:00, run_duration=0.422979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:50:11.767846+00:00, queued_by_job_id=2, pid=10179 2024-06-27T04:51:00.029023199Z [2024-06-27T04:51:00.028+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:51:00+00:00, run_after=2024-06-27T04:52:00+00:00 2024-06-27T04:51:00.042353862Z [2024-06-27T04:51:00.041+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:51:00.075797110Z [2024-06-27T04:51:00.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:51:00+00:00, run_after=2024-06-27T04:52:00+00:00 2024-06-27T04:51:00.191956999Z [2024-06-27T04:51:00.191+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:51:00.192010769Z 2024-06-27T04:51:00.192014594Z 2024-06-27T04:51:00.192017772Z 2024-06-27T04:51:00.192084932Z [2024-06-27T04:51:00.191+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:51:00.192202855Z [2024-06-27T04:51:00.192+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:51:00.192356258Z [2024-06-27T04:51:00.192+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:51:00.192990622Z [2024-06-27T04:51:00.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:51:00.193004107Z 2024-06-27T04:51:00.193007545Z 2024-06-27T04:51:00.193010692Z 2024-06-27T04:51:00.196049429Z [2024-06-27T04:51:00.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:51:00.196283896Z [2024-06-27T04:51:00.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:51:00.196549520Z [2024-06-27T04:51:00.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:51:00.196670224Z [2024-06-27T04:51:00.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:51:00.197035825Z [2024-06-27T04:51:00.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:51:00.197211125Z [2024-06-27T04:51:00.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:51:00.519668678Z [2024-06-27T04:51:00.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status queued for try_number 1 2024-06-27T04:51:00.519802176Z [2024-06-27T04:51:00.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status queued for try_number 1 2024-06-27T04:51:00.528595304Z [2024-06-27T04:51:00.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status queued for try_number 1 2024-06-27T04:51:00.536997164Z [2024-06-27T04:51:00.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdfda3ab-6f06-4008-8e58-97c84e5201d5 2024-06-27T04:51:00.537338691Z [2024-06-27T04:51:00.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15ab0f0c-d449-4064-8476-416372abbfef 2024-06-27T04:51:00.537733229Z [2024-06-27T04:51:00.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7d57985-a204-4fd1-ab61-65a56d5f371a 2024-06-27T04:51:01.730455949Z [2024-06-27T04:51:01.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:51:01.731047207Z [2024-06-27T04:51:01.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:50:00+00:00, run_id=scheduled__2024-06-27T04:50:00+00:00, run_start_date=2024-06-27 04:51:00.098958+00:00, run_end_date=2024-06-27 04:51:01.730366+00:00, run_duration=1.631408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:50:00+00:00, data_interval_end=2024-06-27 04:51:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:51:01.741307953Z [2024-06-27T04:51:01.740+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:51:00+00:00, run_after=2024-06-27T04:52:00+00:00 2024-06-27T04:51:01.785427799Z [2024-06-27T04:51:01.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status success for try_number 1 2024-06-27T04:51:01.791711919Z [2024-06-27T04:51:01.791+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:50:00+00:00, map_index=-1, run_start_date=2024-06-27 04:51:01.136386+00:00, run_end_date=2024-06-27 04:51:01.539135+00:00, run_duration=0.402749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:51:00.193660+00:00, queued_by_job_id=2, pid=10204 2024-06-27T04:51:03.986416575Z [2024-06-27T04:51:03.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:51:03.986996337Z [2024-06-27T04:51:03.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:50:00+00:00, run_id=scheduled__2024-06-27T04:50:00+00:00, run_start_date=2024-06-27 04:51:00.102397+00:00, run_end_date=2024-06-27 04:51:03.986532+00:00, run_duration=3.884135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:50:00+00:00, data_interval_end=2024-06-27 04:51:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:51:04.001995400Z [2024-06-27T04:51:04.001+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:51:00+00:00, run_after=2024-06-27T04:52:00+00:00 2024-06-27T04:51:04.011804889Z [2024-06-27T04:51:04.011+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:51:04.012276700Z [2024-06-27T04:51:04.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:50:00+00:00, run_id=scheduled__2024-06-27T04:50:00+00:00, run_start_date=2024-06-27 04:51:00.100990+00:00, run_end_date=2024-06-27 04:51:04.011703+00:00, run_duration=3.910713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:50:00+00:00, data_interval_end=2024-06-27 04:51:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:51:04.023452668Z [2024-06-27T04:51:04.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:51:00+00:00, run_after=2024-06-27T04:52:00+00:00 2024-06-27T04:51:04.070728389Z [2024-06-27T04:51:04.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status success for try_number 1 2024-06-27T04:51:04.070910943Z [2024-06-27T04:51:04.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status success for try_number 1 2024-06-27T04:51:04.081735395Z [2024-06-27T04:51:04.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:50:00+00:00, map_index=-1, run_start_date=2024-06-27 04:51:02.209004+00:00, run_end_date=2024-06-27 04:51:03.732253+00:00, run_duration=1.523249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:51:00.193660+00:00, queued_by_job_id=2, pid=10234 2024-06-27T04:51:04.082429498Z [2024-06-27T04:51:04.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:50:00+00:00, map_index=-1, run_start_date=2024-06-27 04:51:02.242167+00:00, run_end_date=2024-06-27 04:51:03.519724+00:00, run_duration=1.277557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:51:00.193660+00:00, queued_by_job_id=2, pid=10235 2024-06-27T04:52:00.902756628Z [2024-06-27T04:52:00.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:52:00+00:00, run_after=2024-06-27T04:53:00+00:00 2024-06-27T04:52:00.910554408Z [2024-06-27T04:52:00.910+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:52:00.917083288Z [2024-06-27T04:52:00.916+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:52:00.929055295Z [2024-06-27T04:52:00.928+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:52:00+00:00, run_after=2024-06-27T04:53:00+00:00 2024-06-27T04:52:01.035830760Z [2024-06-27T04:52:01.035+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:52:01.035864510Z 2024-06-27T04:52:01.035870725Z 2024-06-27T04:52:01.035876025Z 2024-06-27T04:52:01.035881195Z 2024-06-27T04:52:01.036113677Z [2024-06-27T04:52:01.035+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:52:01.036332084Z [2024-06-27T04:52:01.036+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:52:01.036560096Z [2024-06-27T04:52:01.036+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:52:01.036788334Z [2024-06-27T04:52:01.036+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:52:01.037583779Z [2024-06-27T04:52:01.037+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:52:01.037595604Z 2024-06-27T04:52:01.037599707Z 2024-06-27T04:52:01.037602839Z 2024-06-27T04:52:01.037605935Z 2024-06-27T04:52:01.042359674Z [2024-06-27T04:52:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:52:01.042645050Z [2024-06-27T04:52:01.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:52:01.042986999Z [2024-06-27T04:52:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:52:01.043205289Z [2024-06-27T04:52:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:52:01.043531934Z [2024-06-27T04:52:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:52:01.043763650Z [2024-06-27T04:52:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:52:01.044098351Z [2024-06-27T04:52:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:52:01.044291868Z [2024-06-27T04:52:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:52:01.365501930Z [2024-06-27T04:52:01.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status queued for try_number 1 2024-06-27T04:52:01.365610497Z [2024-06-27T04:52:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:51:00+00:00 exited with status queued for try_number 1 2024-06-27T04:52:01.365651085Z [2024-06-27T04:52:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:51:00+00:00 exited with status queued for try_number 1 2024-06-27T04:52:01.365694453Z [2024-06-27T04:52:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:51:00+00:00 exited with status queued for try_number 1 2024-06-27T04:52:01.386500068Z [2024-06-27T04:52:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to e95a07e5-7fab-49a7-812b-da0eb0b47aa3 2024-06-27T04:52:01.386625601Z [2024-06-27T04:52:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28f4efda-2746-48ba-a4f4-f73439db115c 2024-06-27T04:52:01.386736291Z [2024-06-27T04:52:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fd93dd8-7823-4c0a-9129-d8c294c798a8 2024-06-27T04:52:01.386861635Z [2024-06-27T04:52:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to b46f0a07-83f6-4d00-a127-8fbf06142245 2024-06-27T04:52:02.747727303Z [2024-06-27T04:52:02.746+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:52:02.747756973Z [2024-06-27T04:52:02.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:51:00+00:00, run_id=scheduled__2024-06-27T04:51:00+00:00, run_start_date=2024-06-27 04:52:00.943669+00:00, run_end_date=2024-06-27 04:52:02.746585+00:00, run_duration=1.802916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:51:00+00:00, data_interval_end=2024-06-27 04:52:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:52:02.800834070Z [2024-06-27T04:52:02.796+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:52:00+00:00, run_after=2024-06-27T04:53:00+00:00 2024-06-27T04:52:02.939005451Z [2024-06-27T04:52:02.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status success for try_number 1 2024-06-27T04:52:02.939312260Z [2024-06-27T04:52:02.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:51:00+00:00 exited with status success for try_number 1 2024-06-27T04:52:02.945624226Z [2024-06-27T04:52:02.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:50:00+00:00, map_index=-1, run_start_date=2024-06-27 04:52:02.133301+00:00, run_end_date=2024-06-27 04:52:02.683339+00:00, run_duration=0.550038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:52:01.038570+00:00, queued_by_job_id=2, pid=10281 2024-06-27T04:52:02.946028465Z [2024-06-27T04:52:02.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:51:00+00:00, map_index=-1, run_start_date=2024-06-27 04:52:02.101159+00:00, run_end_date=2024-06-27 04:52:02.691449+00:00, run_duration=0.59029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:52:01.038570+00:00, queued_by_job_id=2, pid=10279 2024-06-27T04:52:03.881055805Z [2024-06-27T04:52:03.880+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:52:03.881504115Z [2024-06-27T04:52:03.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:50:00+00:00, run_id=scheduled__2024-06-27T04:50:00+00:00, run_start_date=2024-06-27 04:52:00.941800+00:00, run_end_date=2024-06-27 04:52:03.880974+00:00, run_duration=2.939174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:50:00+00:00, data_interval_end=2024-06-27 04:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:52:03.889326137Z [2024-06-27T04:52:03.888+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:52:00+00:00, run_after=2024-06-27T04:54:00+00:00 2024-06-27T04:52:05.055075710Z [2024-06-27T04:52:05.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:52:05.055485616Z [2024-06-27T04:52:05.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:51:00+00:00, run_id=scheduled__2024-06-27T04:51:00+00:00, run_start_date=2024-06-27 04:52:00.945126+00:00, run_end_date=2024-06-27 04:52:05.055072+00:00, run_duration=4.109946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:51:00+00:00, data_interval_end=2024-06-27 04:52:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:52:05.067265480Z [2024-06-27T04:52:05.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:52:00+00:00, run_after=2024-06-27T04:53:00+00:00 2024-06-27T04:52:06.175334011Z [2024-06-27T04:52:06.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:52:06.175447983Z [2024-06-27T04:52:06.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:51:00+00:00, run_id=scheduled__2024-06-27T04:51:00+00:00, run_start_date=2024-06-27 04:52:00.951732+00:00, run_end_date=2024-06-27 04:52:06.175239+00:00, run_duration=5.223507, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:51:00+00:00, data_interval_end=2024-06-27 04:52:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:52:06.184198506Z [2024-06-27T04:52:06.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:52:00+00:00, run_after=2024-06-27T04:53:00+00:00 2024-06-27T04:52:06.219135335Z [2024-06-27T04:52:06.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:51:00+00:00 exited with status success for try_number 1 2024-06-27T04:52:06.219163311Z [2024-06-27T04:52:06.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:51:00+00:00 exited with status success for try_number 1 2024-06-27T04:52:06.229224420Z [2024-06-27T04:52:06.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:51:00+00:00, map_index=-1, run_start_date=2024-06-27 04:52:03.415857+00:00, run_end_date=2024-06-27 04:52:04.976398+00:00, run_duration=1.560541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:52:01.038570+00:00, queued_by_job_id=2, pid=10319 2024-06-27T04:52:06.229492867Z [2024-06-27T04:52:06.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:51:00+00:00, map_index=-1, run_start_date=2024-06-27 04:52:03.420713+00:00, run_end_date=2024-06-27 04:52:05.270662+00:00, run_duration=1.849949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:52:01.038570+00:00, queued_by_job_id=2, pid=10320 2024-06-27T04:53:00.865618927Z [2024-06-27T04:53:00.864+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:53:00.893332610Z [2024-06-27T04:53:00.892+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:53:00+00:00, run_after=2024-06-27T04:54:00+00:00 2024-06-27T04:53:00.912888505Z [2024-06-27T04:53:00.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:53:00+00:00, run_after=2024-06-27T04:54:00+00:00 2024-06-27T04:53:01.007060660Z [2024-06-27T04:53:01.006+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:53:01.007087980Z 2024-06-27T04:53:01.007093713Z 2024-06-27T04:53:01.007098609Z 2024-06-27T04:53:01.007112341Z [2024-06-27T04:53:01.006+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:53:01.007291577Z [2024-06-27T04:53:01.007+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:53:01.007307309Z [2024-06-27T04:53:01.007+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:53:01.009389879Z [2024-06-27T04:53:01.008+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:53:01.009431602Z 2024-06-27T04:53:01.009443050Z 2024-06-27T04:53:01.009452823Z 2024-06-27T04:53:01.018238331Z [2024-06-27T04:53:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:53:01.018722277Z [2024-06-27T04:53:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:53:01.019284998Z [2024-06-27T04:53:01.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:53:01.019697919Z [2024-06-27T04:53:01.019+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:53:01.020367714Z [2024-06-27T04:53:01.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:53:01.020876975Z [2024-06-27T04:53:01.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:53:01.398217182Z [2024-06-27T04:53:01.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:52:00+00:00 exited with status queued for try_number 1 2024-06-27T04:53:01.398620193Z [2024-06-27T04:53:01.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:52:00+00:00 exited with status queued for try_number 1 2024-06-27T04:53:01.398871560Z [2024-06-27T04:53:01.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:52:00+00:00 exited with status queued for try_number 1 2024-06-27T04:53:01.412485438Z [2024-06-27T04:53:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to c422db96-0130-47b8-9307-1107268dafd2 2024-06-27T04:53:01.413095292Z [2024-06-27T04:53:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to f434bc7f-60b1-4298-9c1b-c58b6aeb32bc 2024-06-27T04:53:01.413402863Z [2024-06-27T04:53:01.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9a04787-0b3a-432b-b916-74d50fcf4b97 2024-06-27T04:53:02.582950177Z [2024-06-27T04:53:02.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:53:02.583291969Z [2024-06-27T04:53:02.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:52:00+00:00, run_id=scheduled__2024-06-27T04:52:00+00:00, run_start_date=2024-06-27 04:53:00.925474+00:00, run_end_date=2024-06-27 04:53:02.582827+00:00, run_duration=1.657353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:52:00+00:00, data_interval_end=2024-06-27 04:53:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:53:02.593755518Z [2024-06-27T04:53:02.593+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:53:00+00:00, run_after=2024-06-27T04:54:00+00:00 2024-06-27T04:53:02.639097311Z [2024-06-27T04:53:02.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:52:00+00:00 exited with status success for try_number 1 2024-06-27T04:53:02.645938835Z [2024-06-27T04:53:02.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:52:00+00:00, map_index=-1, run_start_date=2024-06-27 04:53:01.942716+00:00, run_end_date=2024-06-27 04:53:02.312943+00:00, run_duration=0.370227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:53:01.011783+00:00, queued_by_job_id=2, pid=10364 2024-06-27T04:53:04.819688422Z [2024-06-27T04:53:04.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:53:04.820348406Z [2024-06-27T04:53:04.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:52:00+00:00, run_id=scheduled__2024-06-27T04:52:00+00:00, run_start_date=2024-06-27 04:53:00.928023+00:00, run_end_date=2024-06-27 04:53:04.819712+00:00, run_duration=3.891689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:52:00+00:00, data_interval_end=2024-06-27 04:53:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:53:04.834473492Z [2024-06-27T04:53:04.834+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:53:00+00:00, run_after=2024-06-27T04:54:00+00:00 2024-06-27T04:53:04.903781685Z [2024-06-27T04:53:04.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:52:00+00:00 exited with status success for try_number 1 2024-06-27T04:53:04.915969383Z [2024-06-27T04:53:04.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:52:00+00:00, map_index=-1, run_start_date=2024-06-27 04:53:03.009372+00:00, run_end_date=2024-06-27 04:53:04.432167+00:00, run_duration=1.422795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:53:01.011783+00:00, queued_by_job_id=2, pid=10385 2024-06-27T04:53:05.993004573Z [2024-06-27T04:53:05.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:53:05.993281908Z [2024-06-27T04:53:05.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:52:00+00:00, run_id=scheduled__2024-06-27T04:52:00+00:00, run_start_date=2024-06-27 04:53:00.931069+00:00, run_end_date=2024-06-27 04:53:05.992680+00:00, run_duration=5.061611, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:52:00+00:00, data_interval_end=2024-06-27 04:53:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:53:06.016809276Z [2024-06-27T04:53:06.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:53:00+00:00, run_after=2024-06-27T04:54:00+00:00 2024-06-27T04:53:06.064424697Z [2024-06-27T04:53:06.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:52:00+00:00 exited with status success for try_number 1 2024-06-27T04:53:06.070590840Z [2024-06-27T04:53:06.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:52:00+00:00, map_index=-1, run_start_date=2024-06-27 04:53:03.369976+00:00, run_end_date=2024-06-27 04:53:05.593134+00:00, run_duration=2.223158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:53:01.011783+00:00, queued_by_job_id=2, pid=10404 2024-06-27T04:54:00.268422117Z [2024-06-27T04:54:00.267+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:54:00+00:00, run_after=2024-06-27T04:55:00+00:00 2024-06-27T04:54:00.281111340Z [2024-06-27T04:54:00.280+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:54:00.292012340Z [2024-06-27T04:54:00.291+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:54:00.322496715Z [2024-06-27T04:54:00.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:54:00+00:00, run_after=2024-06-27T04:55:00+00:00 2024-06-27T04:54:00.440558040Z [2024-06-27T04:54:00.440+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:54:00.440589059Z 2024-06-27T04:54:00.440594951Z 2024-06-27T04:54:00.440599327Z 2024-06-27T04:54:00.440603979Z 2024-06-27T04:54:00.441003112Z [2024-06-27T04:54:00.440+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:54:00.441328811Z [2024-06-27T04:54:00.441+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:54:00.441624957Z [2024-06-27T04:54:00.441+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:54:00.442049914Z [2024-06-27T04:54:00.441+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:54:00.443502334Z [2024-06-27T04:54:00.443+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:54:00.443533751Z 2024-06-27T04:54:00.443543953Z 2024-06-27T04:54:00.443552875Z 2024-06-27T04:54:00.443593615Z 2024-06-27T04:54:00.447593904Z [2024-06-27T04:54:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:54:00.447893643Z [2024-06-27T04:54:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:54:00.448436495Z [2024-06-27T04:54:00.448+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:54:00.448831864Z [2024-06-27T04:54:00.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:54:00.449465999Z [2024-06-27T04:54:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:54:00.449700009Z [2024-06-27T04:54:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:54:00.450013266Z [2024-06-27T04:54:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:54:00.450227863Z [2024-06-27T04:54:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:54:00.855134528Z [2024-06-27T04:54:00.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:52:00+00:00 exited with status queued for try_number 1 2024-06-27T04:54:00.855168849Z [2024-06-27T04:54:00.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:53:00+00:00 exited with status queued for try_number 1 2024-06-27T04:54:00.855211966Z [2024-06-27T04:54:00.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:53:00+00:00 exited with status queued for try_number 1 2024-06-27T04:54:00.855273589Z [2024-06-27T04:54:00.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:53:00+00:00 exited with status queued for try_number 1 2024-06-27T04:54:00.874677633Z [2024-06-27T04:54:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to c54b8dbe-b833-4da5-b3b8-ceb3092ad3cc 2024-06-27T04:54:00.874740015Z [2024-06-27T04:54:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to 357289c5-31a5-4507-8bf7-f4fb67eeb770 2024-06-27T04:54:00.874858257Z [2024-06-27T04:54:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to f895c4d2-7279-4130-b7dd-39ff21fe9704 2024-06-27T04:54:00.874931839Z [2024-06-27T04:54:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to 096b1c0e-cd38-4c5a-bd8e-aec0bbcac4bd 2024-06-27T04:54:02.116191678Z [2024-06-27T04:54:02.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:54:02.116687076Z [2024-06-27T04:54:02.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:52:00+00:00, run_id=scheduled__2024-06-27T04:52:00+00:00, run_start_date=2024-06-27 04:54:00.338955+00:00, run_end_date=2024-06-27 04:54:02.116285+00:00, run_duration=1.77733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:52:00+00:00, data_interval_end=2024-06-27 04:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:54:02.126280561Z [2024-06-27T04:54:02.125+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:54:00+00:00, run_after=2024-06-27T04:56:00+00:00 2024-06-27T04:54:02.134870854Z [2024-06-27T04:54:02.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:54:02.135893693Z [2024-06-27T04:54:02.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:53:00+00:00, run_id=scheduled__2024-06-27T04:53:00+00:00, run_start_date=2024-06-27 04:54:00.341977+00:00, run_end_date=2024-06-27 04:54:02.135317+00:00, run_duration=1.79334, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:53:00+00:00, data_interval_end=2024-06-27 04:54:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:54:02.152427060Z [2024-06-27T04:54:02.151+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:54:00+00:00, run_after=2024-06-27T04:55:00+00:00 2024-06-27T04:54:02.205862014Z [2024-06-27T04:54:02.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:52:00+00:00 exited with status success for try_number 1 2024-06-27T04:54:02.206171022Z [2024-06-27T04:54:02.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:53:00+00:00 exited with status success for try_number 1 2024-06-27T04:54:02.212628355Z [2024-06-27T04:54:02.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:52:00+00:00, map_index=-1, run_start_date=2024-06-27 04:54:01.331048+00:00, run_end_date=2024-06-27 04:54:01.759736+00:00, run_duration=0.428688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:54:00.444435+00:00, queued_by_job_id=2, pid=10440 2024-06-27T04:54:02.213038290Z [2024-06-27T04:54:02.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:53:00+00:00, map_index=-1, run_start_date=2024-06-27 04:54:01.379007+00:00, run_end_date=2024-06-27 04:54:01.783914+00:00, run_duration=0.404907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:54:00.444435+00:00, queued_by_job_id=2, pid=10441 2024-06-27T04:54:04.366572319Z [2024-06-27T04:54:04.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:54:04.367001480Z [2024-06-27T04:54:04.366+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:53:00+00:00, run_id=scheduled__2024-06-27T04:53:00+00:00, run_start_date=2024-06-27 04:54:00.345354+00:00, run_end_date=2024-06-27 04:54:04.366612+00:00, run_duration=4.021258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:53:00+00:00, data_interval_end=2024-06-27 04:54:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:54:04.377484983Z [2024-06-27T04:54:04.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:54:00+00:00, run_after=2024-06-27T04:55:00+00:00 2024-06-27T04:54:04.423601719Z [2024-06-27T04:54:04.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:53:00+00:00 exited with status success for try_number 1 2024-06-27T04:54:04.443421473Z [2024-06-27T04:54:04.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:53:00+00:00, map_index=-1, run_start_date=2024-06-27 04:54:02.503743+00:00, run_end_date=2024-06-27 04:54:04.137343+00:00, run_duration=1.6336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:54:00.444435+00:00, queued_by_job_id=2, pid=10480 2024-06-27T04:54:05.495515035Z [2024-06-27T04:54:05.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:54:05.497143979Z [2024-06-27T04:54:05.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:53:00+00:00, run_id=scheduled__2024-06-27T04:53:00+00:00, run_start_date=2024-06-27 04:54:00.348528+00:00, run_end_date=2024-06-27 04:54:05.496692+00:00, run_duration=5.148164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:53:00+00:00, data_interval_end=2024-06-27 04:54:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:54:05.506753778Z [2024-06-27T04:54:05.506+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:54:00+00:00, run_after=2024-06-27T04:55:00+00:00 2024-06-27T04:54:05.548407368Z [2024-06-27T04:54:05.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:53:00+00:00 exited with status success for try_number 1 2024-06-27T04:54:05.559762071Z [2024-06-27T04:54:05.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:53:00+00:00, map_index=-1, run_start_date=2024-06-27 04:54:02.697490+00:00, run_end_date=2024-06-27 04:54:04.960688+00:00, run_duration=2.263198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:54:00.444435+00:00, queued_by_job_id=2, pid=10481 2024-06-27T04:55:00.620547289Z [2024-06-27T04:55:00.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:55:00+00:00, run_after=2024-06-27T04:56:00+00:00 2024-06-27T04:55:00.639006781Z [2024-06-27T04:55:00.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:55:00+00:00, run_after=2024-06-27T05:00:00+00:00 2024-06-27T04:55:00.664003710Z [2024-06-27T04:55:00.663+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:55:00+00:00, run_after=2024-06-27T04:56:00+00:00 2024-06-27T04:55:00.675374873Z [2024-06-27T04:55:00.675+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:55:00.789236574Z [2024-06-27T04:55:00.788+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:55:00.789264193Z 2024-06-27T04:55:00.789268940Z 2024-06-27T04:55:00.789272307Z 2024-06-27T04:55:00.789275630Z 2024-06-27T04:55:00.789419863Z [2024-06-27T04:55:00.789+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:55:00.789597027Z [2024-06-27T04:55:00.789+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:55:00.789774239Z [2024-06-27T04:55:00.789+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:55:00.789948574Z [2024-06-27T04:55:00.789+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:55:00.790585482Z [2024-06-27T04:55:00.790+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:55:00.790594606Z 2024-06-27T04:55:00.790598287Z 2024-06-27T04:55:00.790601699Z 2024-06-27T04:55:00.790619174Z 2024-06-27T04:55:00.794530880Z [2024-06-27T04:55:00.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T04:55:00.794662464Z [2024-06-27T04:55:00.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:55:00.794990444Z [2024-06-27T04:55:00.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:55:00.795188763Z [2024-06-27T04:55:00.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:55:00.795470504Z [2024-06-27T04:55:00.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:55:00.795640622Z [2024-06-27T04:55:00.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:55:00.795897994Z [2024-06-27T04:55:00.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:55:00.796072046Z [2024-06-27T04:55:00.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:55:01.207694157Z [2024-06-27T04:55:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status queued for try_number 1 2024-06-27T04:55:01.209028678Z [2024-06-27T04:55:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:54:00+00:00 exited with status queued for try_number 1 2024-06-27T04:55:01.209279792Z [2024-06-27T04:55:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:54:00+00:00 exited with status queued for try_number 1 2024-06-27T04:55:01.209434987Z [2024-06-27T04:55:01.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:54:00+00:00 exited with status queued for try_number 1 2024-06-27T04:55:01.222028026Z [2024-06-27T04:55:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed957533-cb3f-4ff7-b26a-4f40759abeae 2024-06-27T04:55:01.222580217Z [2024-06-27T04:55:01.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6326f264-cb13-497f-a884-076af38986a9 2024-06-27T04:55:01.222886953Z [2024-06-27T04:55:01.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f1340c6-cf64-46c4-add0-872e06931923 2024-06-27T04:55:01.223301810Z [2024-06-27T04:55:01.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to c294c10d-a565-415d-a485-2adbb57c36e4 2024-06-27T04:55:03.135013674Z [2024-06-27T04:55:03.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:55:03.135111728Z [2024-06-27T04:55:03.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:54:00+00:00, run_id=scheduled__2024-06-27T04:54:00+00:00, run_start_date=2024-06-27 04:55:00.693018+00:00, run_end_date=2024-06-27 04:55:03.134693+00:00, run_duration=2.441675, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:54:00+00:00, data_interval_end=2024-06-27 04:55:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:55:03.148927226Z [2024-06-27T04:55:03.148+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:55:00+00:00, run_after=2024-06-27T04:56:00+00:00 2024-06-27T04:55:03.233965983Z [2024-06-27T04:55:03.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:54:00+00:00 exited with status success for try_number 1 2024-06-27T04:55:03.240713976Z [2024-06-27T04:55:03.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:54:00+00:00, map_index=-1, run_start_date=2024-06-27 04:55:01.754530+00:00, run_end_date=2024-06-27 04:55:02.154651+00:00, run_duration=0.400121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:55:00.791641+00:00, queued_by_job_id=2, pid=10526 2024-06-27T04:55:04.312206839Z [2024-06-27T04:55:04.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:55:04.312910938Z [2024-06-27T04:55:04.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:54:00+00:00, run_id=scheduled__2024-06-27T04:54:00+00:00, run_start_date=2024-06-27 04:55:00.694618+00:00, run_end_date=2024-06-27 04:55:04.312301+00:00, run_duration=3.617683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:54:00+00:00, data_interval_end=2024-06-27 04:55:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:55:04.322740808Z [2024-06-27T04:55:04.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:55:00+00:00, run_after=2024-06-27T04:56:00+00:00 2024-06-27T04:55:04.364714688Z [2024-06-27T04:55:04.364+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:55:04.364828202Z 2024-06-27T04:55:04.365446287Z [2024-06-27T04:55:04.364+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:55:04.366548659Z [2024-06-27T04:55:04.366+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:55:04.366583172Z 2024-06-27T04:55:04.370353716Z [2024-06-27T04:55:04.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T04:55:04.370997338Z [2024-06-27T04:55:04.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:55:04.426285377Z [2024-06-27T04:55:04.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status queued for try_number 1 2024-06-27T04:55:04.427222607Z [2024-06-27T04:55:04.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status success for try_number 1 2024-06-27T04:55:04.432690738Z [2024-06-27T04:55:04.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bcc6b8b-8327-429a-987c-79a31eabbe9e 2024-06-27T04:55:04.433311770Z [2024-06-27T04:55:04.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:50:00+00:00, map_index=-1, run_start_date=2024-06-27 04:55:03.103294+00:00, run_end_date=2024-06-27 04:55:03.506867+00:00, run_duration=0.403573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:55:00.791641+00:00, queued_by_job_id=2, pid=10567 2024-06-27T04:55:04.557532606Z [2024-06-27T04:55:04.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:54:00+00:00 exited with status success for try_number 1 2024-06-27T04:55:04.563263495Z [2024-06-27T04:55:04.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:54:00+00:00, map_index=-1, run_start_date=2024-06-27 04:55:02.832133+00:00, run_end_date=2024-06-27 04:55:04.258230+00:00, run_duration=1.426097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:55:00.791641+00:00, queued_by_job_id=2, pid=10563 2024-06-27T04:55:05.625249858Z [2024-06-27T04:55:05.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:55:05.625516970Z [2024-06-27T04:55:05.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:54:00+00:00, run_id=scheduled__2024-06-27T04:54:00+00:00, run_start_date=2024-06-27 04:55:00.695795+00:00, run_end_date=2024-06-27 04:55:05.625004+00:00, run_duration=4.929209, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:54:00+00:00, data_interval_end=2024-06-27 04:55:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:55:05.640897391Z [2024-06-27T04:55:05.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:55:00+00:00, run_after=2024-06-27T04:56:00+00:00 2024-06-27T04:55:05.689351126Z [2024-06-27T04:55:05.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:54:00+00:00 exited with status success for try_number 1 2024-06-27T04:55:05.697300615Z [2024-06-27T04:55:05.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:54:00+00:00, map_index=-1, run_start_date=2024-06-27 04:55:03.105640+00:00, run_end_date=2024-06-27 04:55:04.614346+00:00, run_duration=1.508706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:55:00.791641+00:00, queued_by_job_id=2, pid=10568 2024-06-27T04:55:06.563556506Z [2024-06-27T04:55:06.563+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:55:06.563581405Z 2024-06-27T04:55:06.564019215Z [2024-06-27T04:55:06.563+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:55:06.564547234Z [2024-06-27T04:55:06.564+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:55:06.564558251Z 2024-06-27T04:55:06.568490372Z [2024-06-27T04:55:06.568+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T04:55:06.568637048Z [2024-06-27T04:55:06.568+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T04:55:06.632128482Z [2024-06-27T04:55:06.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status queued for try_number 1 2024-06-27T04:55:06.633707039Z [2024-06-27T04:55:06.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status success for try_number 1 2024-06-27T04:55:06.641295115Z [2024-06-27T04:55:06.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2609691-4f10-4d87-9372-37f72a6244a3 2024-06-27T04:55:06.641583574Z [2024-06-27T04:55:06.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T04:50:00+00:00, map_index=-1, run_start_date=2024-06-27 04:55:05.980471+00:00, run_end_date=2024-06-27 04:55:06.342346+00:00, run_duration=0.361875, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:55:04.367250+00:00, queued_by_job_id=2, pid=10606 2024-06-27T04:55:06.661175523Z [2024-06-27T04:55:06.660+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T04:55:10.776517180Z [2024-06-27T04:55:10.775+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T04:55:10.776570835Z 2024-06-27T04:55:10.776971128Z [2024-06-27T04:55:10.776+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:55:10.778588389Z [2024-06-27T04:55:10.778+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:55:10.778601042Z 2024-06-27T04:55:10.783364311Z [2024-06-27T04:55:10.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:55:10.783681535Z [2024-06-27T04:55:10.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T04:55:10.855680664Z [2024-06-27T04:55:10.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status queued for try_number 1 2024-06-27T04:55:10.855821139Z [2024-06-27T04:55:10.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status success for try_number 1 2024-06-27T04:55:10.860989654Z [2024-06-27T04:55:10.860+0000] {scheduler_job.py:635} INFO - Setting external_id for to 956ba9b0-53b0-48bf-a347-f6f042a2ff32 2024-06-27T04:55:10.861283708Z [2024-06-27T04:55:10.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:50:00+00:00, map_index=0, run_start_date=2024-06-27 04:55:08.135579+00:00, run_end_date=2024-06-27 04:55:09.543382+00:00, run_duration=1.407803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:55:06.566414+00:00, queued_by_job_id=2, pid=10618 2024-06-27T04:55:13.260855453Z [2024-06-27T04:55:13.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:55:13.261067563Z [2024-06-27T04:55:13.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:50:00+00:00, run_id=scheduled__2024-06-27T04:50:00+00:00, run_start_date=2024-06-27 04:55:00.691206+00:00, run_end_date=2024-06-27 04:55:13.260630+00:00, run_duration=12.569424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:50:00+00:00, data_interval_end=2024-06-27 04:55:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T04:55:13.268557028Z [2024-06-27T04:55:13.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:55:00+00:00, run_after=2024-06-27T05:00:00+00:00 2024-06-27T04:55:13.318084422Z [2024-06-27T04:55:13.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:50:00+00:00 exited with status success for try_number 1 2024-06-27T04:55:13.329517754Z [2024-06-27T04:55:13.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:50:00+00:00, map_index=-1, run_start_date=2024-06-27 04:55:12.332416+00:00, run_end_date=2024-06-27 04:55:12.774251+00:00, run_duration=0.441835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:55:10.779448+00:00, queued_by_job_id=2, pid=10638 2024-06-27T04:56:01.090663530Z [2024-06-27T04:56:01.088+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:56:01.104198509Z [2024-06-27T04:56:01.103+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:56:01.121601629Z [2024-06-27T04:56:01.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:56:00+00:00, run_after=2024-06-27T04:57:00+00:00 2024-06-27T04:56:01.140838320Z [2024-06-27T04:56:01.140+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:56:00+00:00, run_after=2024-06-27T04:57:00+00:00 2024-06-27T04:56:01.248365074Z [2024-06-27T04:56:01.248+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:56:01.248388282Z 2024-06-27T04:56:01.248392414Z 2024-06-27T04:56:01.248395958Z 2024-06-27T04:56:01.248416285Z 2024-06-27T04:56:01.248550497Z [2024-06-27T04:56:01.248+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:56:01.248781003Z [2024-06-27T04:56:01.248+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:56:01.248988549Z [2024-06-27T04:56:01.248+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:56:01.249317040Z [2024-06-27T04:56:01.249+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:56:01.249953361Z [2024-06-27T04:56:01.249+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:56:01.249971839Z 2024-06-27T04:56:01.249977580Z 2024-06-27T04:56:01.249982538Z 2024-06-27T04:56:01.249987194Z 2024-06-27T04:56:01.255081246Z [2024-06-27T04:56:01.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:56:01.255101180Z [2024-06-27T04:56:01.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:56:01.255114080Z [2024-06-27T04:56:01.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:56:01.255117932Z [2024-06-27T04:56:01.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:56:01.255121271Z [2024-06-27T04:56:01.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:56:01.255124372Z [2024-06-27T04:56:01.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:56:01.255127484Z [2024-06-27T04:56:01.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:56:01.255333909Z [2024-06-27T04:56:01.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:56:01.538301793Z [2024-06-27T04:56:01.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:54:00+00:00 exited with status queued for try_number 1 2024-06-27T04:56:01.538334913Z [2024-06-27T04:56:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status queued for try_number 1 2024-06-27T04:56:01.538422570Z [2024-06-27T04:56:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status queued for try_number 1 2024-06-27T04:56:01.538475706Z [2024-06-27T04:56:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status queued for try_number 1 2024-06-27T04:56:01.549454014Z [2024-06-27T04:56:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce7a34aa-7036-474c-b518-ccf3e89908dc 2024-06-27T04:56:01.549628056Z [2024-06-27T04:56:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41457b62-c104-44c3-b909-80e69a21411b 2024-06-27T04:56:01.549815067Z [2024-06-27T04:56:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to a17ad52a-9bd4-4d38-9cca-1646fed212cf 2024-06-27T04:56:01.550001216Z [2024-06-27T04:56:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfde5aa3-3371-44e1-8207-3da7bc519200 2024-06-27T04:56:02.739645613Z [2024-06-27T04:56:02.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:56:02.739848618Z [2024-06-27T04:56:02.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:54:00+00:00, run_id=scheduled__2024-06-27T04:54:00+00:00, run_start_date=2024-06-27 04:56:01.153370+00:00, run_end_date=2024-06-27 04:56:02.739562+00:00, run_duration=1.586192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:54:00+00:00, data_interval_end=2024-06-27 04:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:56:02.750285010Z [2024-06-27T04:56:02.746+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:56:00+00:00, run_after=2024-06-27T04:58:00+00:00 2024-06-27T04:56:02.766121953Z [2024-06-27T04:56:02.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:56:02.766277009Z [2024-06-27T04:56:02.766+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:55:00+00:00, run_id=scheduled__2024-06-27T04:55:00+00:00, run_start_date=2024-06-27 04:56:01.154705+00:00, run_end_date=2024-06-27 04:56:02.766023+00:00, run_duration=1.611318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:55:00+00:00, data_interval_end=2024-06-27 04:56:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:56:02.776111706Z [2024-06-27T04:56:02.775+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:56:00+00:00, run_after=2024-06-27T04:57:00+00:00 2024-06-27T04:56:02.889693481Z [2024-06-27T04:56:02.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:54:00+00:00 exited with status success for try_number 1 2024-06-27T04:56:02.889717830Z [2024-06-27T04:56:02.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status success for try_number 1 2024-06-27T04:56:02.903287445Z [2024-06-27T04:56:02.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:54:00+00:00, map_index=-1, run_start_date=2024-06-27 04:56:02.027903+00:00, run_end_date=2024-06-27 04:56:02.388244+00:00, run_duration=0.360341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:56:01.250780+00:00, queued_by_job_id=2, pid=10665 2024-06-27T04:56:02.903384394Z [2024-06-27T04:56:02.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:55:00+00:00, map_index=-1, run_start_date=2024-06-27 04:56:02.190971+00:00, run_end_date=2024-06-27 04:56:02.573064+00:00, run_duration=0.382093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:56:01.250780+00:00, queued_by_job_id=2, pid=10666 2024-06-27T04:56:05.346387474Z [2024-06-27T04:56:05.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:56:05.346820407Z [2024-06-27T04:56:05.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:55:00+00:00, run_id=scheduled__2024-06-27T04:55:00+00:00, run_start_date=2024-06-27 04:56:01.155820+00:00, run_end_date=2024-06-27 04:56:05.346325+00:00, run_duration=4.190505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:55:00+00:00, data_interval_end=2024-06-27 04:56:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:56:05.356179338Z [2024-06-27T04:56:05.355+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:56:00+00:00, run_after=2024-06-27T04:57:00+00:00 2024-06-27T04:56:05.363888869Z [2024-06-27T04:56:05.363+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:56:05.364325818Z [2024-06-27T04:56:05.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:55:00+00:00, run_id=scheduled__2024-06-27T04:55:00+00:00, run_start_date=2024-06-27 04:56:01.157720+00:00, run_end_date=2024-06-27 04:56:05.363825+00:00, run_duration=4.206105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:55:00+00:00, data_interval_end=2024-06-27 04:56:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:56:05.380914201Z [2024-06-27T04:56:05.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:56:00+00:00, run_after=2024-06-27T04:57:00+00:00 2024-06-27T04:56:05.425969660Z [2024-06-27T04:56:05.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status success for try_number 1 2024-06-27T04:56:05.426327782Z [2024-06-27T04:56:05.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status success for try_number 1 2024-06-27T04:56:05.446593079Z [2024-06-27T04:56:05.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:55:00+00:00, map_index=-1, run_start_date=2024-06-27 04:56:03.310202+00:00, run_end_date=2024-06-27 04:56:05.020594+00:00, run_duration=1.710392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:56:01.250780+00:00, queued_by_job_id=2, pid=10706 2024-06-27T04:56:05.447589557Z [2024-06-27T04:56:05.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:55:00+00:00, map_index=-1, run_start_date=2024-06-27 04:56:03.110260+00:00, run_end_date=2024-06-27 04:56:04.626243+00:00, run_duration=1.515983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:56:01.250780+00:00, queued_by_job_id=2, pid=10696 2024-06-27T04:57:00.417430422Z [2024-06-27T04:57:00.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:57:00+00:00, run_after=2024-06-27T04:58:00+00:00 2024-06-27T04:57:00.433221810Z [2024-06-27T04:57:00.432+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:57:00+00:00, run_after=2024-06-27T04:58:00+00:00 2024-06-27T04:57:00.442754964Z [2024-06-27T04:57:00.442+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:57:00.528173064Z [2024-06-27T04:57:00.527+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:57:00.528205945Z 2024-06-27T04:57:00.528210733Z 2024-06-27T04:57:00.528215280Z 2024-06-27T04:57:00.528565527Z [2024-06-27T04:57:00.528+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:57:00.528858972Z [2024-06-27T04:57:00.528+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:57:00.529070903Z [2024-06-27T04:57:00.528+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:57:00.530029462Z [2024-06-27T04:57:00.529+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:57:00.530045604Z 2024-06-27T04:57:00.530052575Z 2024-06-27T04:57:00.530058479Z 2024-06-27T04:57:00.533531059Z [2024-06-27T04:57:00.533+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:57:00.533796051Z [2024-06-27T04:57:00.533+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:57:00.534253662Z [2024-06-27T04:57:00.533+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:57:00.534457033Z [2024-06-27T04:57:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:57:00.534890737Z [2024-06-27T04:57:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:57:00.535097820Z [2024-06-27T04:57:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:57:00.780312414Z [2024-06-27T04:57:00.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:56:00+00:00 exited with status queued for try_number 1 2024-06-27T04:57:00.781606134Z [2024-06-27T04:57:00.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:56:00+00:00 exited with status queued for try_number 1 2024-06-27T04:57:00.781623840Z [2024-06-27T04:57:00.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:56:00+00:00 exited with status queued for try_number 1 2024-06-27T04:57:00.788763624Z [2024-06-27T04:57:00.788+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b84d69d-8c52-45fa-ab81-24a96839d604 2024-06-27T04:57:00.789082518Z [2024-06-27T04:57:00.788+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87cbe626-396f-4e2a-bd5f-e8fbba3e1e15 2024-06-27T04:57:00.789373880Z [2024-06-27T04:57:00.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21ed6349-4f4e-42aa-85c7-05dcbf391f0c 2024-06-27T04:57:01.941724389Z [2024-06-27T04:57:01.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:57:01.941860152Z [2024-06-27T04:57:01.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:56:00+00:00, run_id=scheduled__2024-06-27T04:56:00+00:00, run_start_date=2024-06-27 04:57:00.456910+00:00, run_end_date=2024-06-27 04:57:01.941559+00:00, run_duration=1.484649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:56:00+00:00, data_interval_end=2024-06-27 04:57:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:57:01.951574146Z [2024-06-27T04:57:01.951+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:57:00+00:00, run_after=2024-06-27T04:58:00+00:00 2024-06-27T04:57:03.094564846Z [2024-06-27T04:57:03.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:56:00+00:00 exited with status success for try_number 1 2024-06-27T04:57:03.099698081Z [2024-06-27T04:57:03.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:56:00+00:00, map_index=-1, run_start_date=2024-06-27 04:57:01.358001+00:00, run_end_date=2024-06-27 04:57:01.868178+00:00, run_duration=0.510177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:57:00.530783+00:00, queued_by_job_id=2, pid=10750 2024-06-27T04:57:04.155299653Z [2024-06-27T04:57:04.154+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:57:04.155663731Z [2024-06-27T04:57:04.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:56:00+00:00, run_id=scheduled__2024-06-27T04:56:00+00:00, run_start_date=2024-06-27 04:57:00.458469+00:00, run_end_date=2024-06-27 04:57:04.155156+00:00, run_duration=3.696687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:56:00+00:00, data_interval_end=2024-06-27 04:57:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:57:04.179920699Z [2024-06-27T04:57:04.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:57:00+00:00, run_after=2024-06-27T04:58:00+00:00 2024-06-27T04:57:04.225050648Z [2024-06-27T04:57:04.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:56:00+00:00 exited with status success for try_number 1 2024-06-27T04:57:04.231293361Z [2024-06-27T04:57:04.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:56:00+00:00, map_index=-1, run_start_date=2024-06-27 04:57:02.356778+00:00, run_end_date=2024-06-27 04:57:03.648170+00:00, run_duration=1.291392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:57:00.530783+00:00, queued_by_job_id=2, pid=10780 2024-06-27T04:57:05.302249961Z [2024-06-27T04:57:05.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:57:05.302502293Z [2024-06-27T04:57:05.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:56:00+00:00, run_id=scheduled__2024-06-27T04:56:00+00:00, run_start_date=2024-06-27 04:57:00.459890+00:00, run_end_date=2024-06-27 04:57:05.302038+00:00, run_duration=4.842148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:56:00+00:00, data_interval_end=2024-06-27 04:57:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:57:05.315618654Z [2024-06-27T04:57:05.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:57:00+00:00, run_after=2024-06-27T04:58:00+00:00 2024-06-27T04:57:05.371301285Z [2024-06-27T04:57:05.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:56:00+00:00 exited with status success for try_number 1 2024-06-27T04:57:05.376973676Z [2024-06-27T04:57:05.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:56:00+00:00, map_index=-1, run_start_date=2024-06-27 04:57:02.547619+00:00, run_end_date=2024-06-27 04:57:04.210932+00:00, run_duration=1.663313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:57:00.530783+00:00, queued_by_job_id=2, pid=10781 2024-06-27T04:58:00.140099437Z [2024-06-27T04:58:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:58:00+00:00, run_after=2024-06-27T04:59:00+00:00 2024-06-27T04:58:00.148065657Z [2024-06-27T04:58:00.147+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:58:00.154483310Z [2024-06-27T04:58:00.154+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:58:00.165898755Z [2024-06-27T04:58:00.165+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:58:00+00:00, run_after=2024-06-27T04:59:00+00:00 2024-06-27T04:58:00.249877354Z [2024-06-27T04:58:00.249+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T04:58:00.249900506Z 2024-06-27T04:58:00.249904940Z 2024-06-27T04:58:00.249908461Z 2024-06-27T04:58:00.249912517Z 2024-06-27T04:58:00.250367495Z [2024-06-27T04:58:00.250+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T04:58:00.251429380Z [2024-06-27T04:58:00.251+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:58:00.251622868Z [2024-06-27T04:58:00.251+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:58:00.251810773Z [2024-06-27T04:58:00.251+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:58:00.252500994Z [2024-06-27T04:58:00.252+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:58:00.252506453Z 2024-06-27T04:58:00.252509760Z 2024-06-27T04:58:00.252513170Z 2024-06-27T04:58:00.252516914Z 2024-06-27T04:58:00.257627797Z [2024-06-27T04:58:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:58:00.258157478Z [2024-06-27T04:58:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T04:58:00.258445217Z [2024-06-27T04:58:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:58:00.258610500Z [2024-06-27T04:58:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:58:00.258852607Z [2024-06-27T04:58:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:58:00.259097780Z [2024-06-27T04:58:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:58:00.259422630Z [2024-06-27T04:58:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:58:00.259836209Z [2024-06-27T04:58:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:58:00.669977842Z [2024-06-27T04:58:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:56:00+00:00 exited with status queued for try_number 1 2024-06-27T04:58:00.672239371Z [2024-06-27T04:58:00.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:57:00+00:00 exited with status queued for try_number 1 2024-06-27T04:58:00.672353865Z [2024-06-27T04:58:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:57:00+00:00 exited with status queued for try_number 1 2024-06-27T04:58:00.672461730Z [2024-06-27T04:58:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:57:00+00:00 exited with status queued for try_number 1 2024-06-27T04:58:00.684283385Z [2024-06-27T04:58:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 362ff2b5-be02-45e3-9080-ca69c42915dc 2024-06-27T04:58:00.684461094Z [2024-06-27T04:58:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5440f8d1-4c2f-4b90-87ec-4809ee6b4c88 2024-06-27T04:58:00.684611220Z [2024-06-27T04:58:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1d2267a-d996-4ae8-9aed-e590ea06a6b5 2024-06-27T04:58:00.684778374Z [2024-06-27T04:58:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 933c9707-5a01-4ada-8692-b7d82b00af32 2024-06-27T04:58:01.834907603Z [2024-06-27T04:58:01.834+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:58:01.835368413Z [2024-06-27T04:58:01.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:56:00+00:00, run_id=scheduled__2024-06-27T04:56:00+00:00, run_start_date=2024-06-27 04:58:00.176353+00:00, run_end_date=2024-06-27 04:58:01.835000+00:00, run_duration=1.658647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:56:00+00:00, data_interval_end=2024-06-27 04:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T04:58:01.844182421Z [2024-06-27T04:58:01.843+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T04:58:00+00:00, run_after=2024-06-27T05:00:00+00:00 2024-06-27T04:58:01.923535277Z [2024-06-27T04:58:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:56:00+00:00 exited with status success for try_number 1 2024-06-27T04:58:01.929195609Z [2024-06-27T04:58:01.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:56:00+00:00, map_index=-1, run_start_date=2024-06-27 04:58:01.015704+00:00, run_end_date=2024-06-27 04:58:01.427724+00:00, run_duration=0.41202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:58:00.254695+00:00, queued_by_job_id=2, pid=10817 2024-06-27T04:58:03.007962861Z [2024-06-27T04:58:03.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:58:03.008409829Z [2024-06-27T04:58:03.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:57:00+00:00, run_id=scheduled__2024-06-27T04:57:00+00:00, run_start_date=2024-06-27 04:58:00.177656+00:00, run_end_date=2024-06-27 04:58:03.008053+00:00, run_duration=2.830397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:57:00+00:00, data_interval_end=2024-06-27 04:58:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:58:03.019070453Z [2024-06-27T04:58:03.018+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:58:00+00:00, run_after=2024-06-27T04:59:00+00:00 2024-06-27T04:58:03.057397537Z [2024-06-27T04:58:03.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:57:00+00:00 exited with status success for try_number 1 2024-06-27T04:58:03.066708198Z [2024-06-27T04:58:03.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:57:00+00:00, map_index=-1, run_start_date=2024-06-27 04:58:01.360594+00:00, run_end_date=2024-06-27 04:58:01.864330+00:00, run_duration=0.503736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:58:00.254695+00:00, queued_by_job_id=2, pid=10836 2024-06-27T04:58:04.133235902Z [2024-06-27T04:58:04.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:58:04.133326680Z [2024-06-27T04:58:04.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:57:00+00:00, run_id=scheduled__2024-06-27T04:57:00+00:00, run_start_date=2024-06-27 04:58:00.178666+00:00, run_end_date=2024-06-27 04:58:04.132941+00:00, run_duration=3.954275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:57:00+00:00, data_interval_end=2024-06-27 04:58:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:58:04.142932146Z [2024-06-27T04:58:04.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:58:00+00:00, run_after=2024-06-27T04:59:00+00:00 2024-06-27T04:58:04.150039163Z [2024-06-27T04:58:04.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:58:04.150071676Z [2024-06-27T04:58:04.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:57:00+00:00, run_id=scheduled__2024-06-27T04:57:00+00:00, run_start_date=2024-06-27 04:58:00.179722+00:00, run_end_date=2024-06-27 04:58:04.148824+00:00, run_duration=3.969102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:57:00+00:00, data_interval_end=2024-06-27 04:58:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:58:04.164299286Z [2024-06-27T04:58:04.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:58:00+00:00, run_after=2024-06-27T04:59:00+00:00 2024-06-27T04:58:04.212896732Z [2024-06-27T04:58:04.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:57:00+00:00 exited with status success for try_number 1 2024-06-27T04:58:04.213051164Z [2024-06-27T04:58:04.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:57:00+00:00 exited with status success for try_number 1 2024-06-27T04:58:04.222896401Z [2024-06-27T04:58:04.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:57:00+00:00, map_index=-1, run_start_date=2024-06-27 04:58:02.202007+00:00, run_end_date=2024-06-27 04:58:03.824119+00:00, run_duration=1.622112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:58:00.254695+00:00, queued_by_job_id=2, pid=10857 2024-06-27T04:58:04.223212267Z [2024-06-27T04:58:04.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:57:00+00:00, map_index=-1, run_start_date=2024-06-27 04:58:02.533898+00:00, run_end_date=2024-06-27 04:58:03.792275+00:00, run_duration=1.258377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:58:00.254695+00:00, queued_by_job_id=2, pid=10876 2024-06-27T04:59:00.349913743Z [2024-06-27T04:59:00.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:59:00+00:00, run_after=2024-06-27T05:00:00+00:00 2024-06-27T04:59:00.364476440Z [2024-06-27T04:59:00.364+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T04:59:00.402410259Z [2024-06-27T04:59:00.402+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:59:00+00:00, run_after=2024-06-27T05:00:00+00:00 2024-06-27T04:59:00.463961684Z [2024-06-27T04:59:00.463+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T04:59:00.463994934Z 2024-06-27T04:59:00.463998412Z 2024-06-27T04:59:00.464001477Z 2024-06-27T04:59:00.464131067Z [2024-06-27T04:59:00.463+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:59:00.464365359Z [2024-06-27T04:59:00.464+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T04:59:00.464577760Z [2024-06-27T04:59:00.464+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T04:59:00.465243672Z [2024-06-27T04:59:00.465+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T04:59:00.465255586Z 2024-06-27T04:59:00.465259151Z 2024-06-27T04:59:00.465262331Z 2024-06-27T04:59:00.468072234Z [2024-06-27T04:59:00.467+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:59:00.468313884Z [2024-06-27T04:59:00.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T04:59:00.468655824Z [2024-06-27T04:59:00.468+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:59:00.468930720Z [2024-06-27T04:59:00.468+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T04:59:00.469277255Z [2024-06-27T04:59:00.469+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T04:59:00.469480265Z [2024-06-27T04:59:00.469+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T04:59:00.689201213Z [2024-06-27T04:59:00.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:58:00+00:00 exited with status queued for try_number 1 2024-06-27T04:59:00.689289705Z [2024-06-27T04:59:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:58:00+00:00 exited with status queued for try_number 1 2024-06-27T04:59:00.689301295Z [2024-06-27T04:59:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:58:00+00:00 exited with status queued for try_number 1 2024-06-27T04:59:00.698704730Z [2024-06-27T04:59:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b5a9417-677b-45f7-98d9-29dc890aff29 2024-06-27T04:59:00.698765293Z [2024-06-27T04:59:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce783a2b-b75c-4d14-98cd-5fe05b6255ec 2024-06-27T04:59:00.699635971Z [2024-06-27T04:59:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to a54f5708-3282-45bd-b4eb-c2a2f53b6742 2024-06-27T04:59:02.873378182Z [2024-06-27T04:59:02.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:59:02.873765231Z [2024-06-27T04:59:02.873+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:58:00+00:00, run_id=scheduled__2024-06-27T04:58:00+00:00, run_start_date=2024-06-27 04:59:00.412423+00:00, run_end_date=2024-06-27 04:59:02.873434+00:00, run_duration=2.461011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:58:00+00:00, data_interval_end=2024-06-27 04:59:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T04:59:02.885300598Z [2024-06-27T04:59:02.885+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T04:59:00+00:00, run_after=2024-06-27T05:00:00+00:00 2024-06-27T04:59:02.965903437Z [2024-06-27T04:59:02.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:58:00+00:00 exited with status success for try_number 1 2024-06-27T04:59:02.972798956Z [2024-06-27T04:59:02.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:58:00+00:00, map_index=-1, run_start_date=2024-06-27 04:59:01.363520+00:00, run_end_date=2024-06-27 04:59:01.841645+00:00, run_duration=0.478125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:59:00.465938+00:00, queued_by_job_id=2, pid=10911 2024-06-27T04:59:05.151527455Z [2024-06-27T04:59:05.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:59:05.151827854Z [2024-06-27T04:59:05.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:58:00+00:00, run_id=scheduled__2024-06-27T04:58:00+00:00, run_start_date=2024-06-27 04:59:00.413693+00:00, run_end_date=2024-06-27 04:59:05.151316+00:00, run_duration=4.737623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:58:00+00:00, data_interval_end=2024-06-27 04:59:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T04:59:05.162521684Z [2024-06-27T04:59:05.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:59:00+00:00, run_after=2024-06-27T05:00:00+00:00 2024-06-27T04:59:05.220305342Z [2024-06-27T04:59:05.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:58:00+00:00 exited with status success for try_number 1 2024-06-27T04:59:05.227401351Z [2024-06-27T04:59:05.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:58:00+00:00, map_index=-1, run_start_date=2024-06-27 04:59:02.471421+00:00, run_end_date=2024-06-27 04:59:04.160111+00:00, run_duration=1.68869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:59:00.465938+00:00, queued_by_job_id=2, pid=10942 2024-06-27T04:59:06.292315987Z [2024-06-27T04:59:06.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T04:59:06.292828304Z [2024-06-27T04:59:06.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:58:00+00:00, run_id=scheduled__2024-06-27T04:58:00+00:00, run_start_date=2024-06-27 04:59:00.414695+00:00, run_end_date=2024-06-27 04:59:06.292200+00:00, run_duration=5.877505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:58:00+00:00, data_interval_end=2024-06-27 04:59:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T04:59:06.304525553Z [2024-06-27T04:59:06.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T04:59:00+00:00, run_after=2024-06-27T05:00:00+00:00 2024-06-27T04:59:06.353532267Z [2024-06-27T04:59:06.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:58:00+00:00 exited with status success for try_number 1 2024-06-27T04:59:06.367079634Z [2024-06-27T04:59:06.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:58:00+00:00, map_index=-1, run_start_date=2024-06-27 04:59:02.402189+00:00, run_end_date=2024-06-27 04:59:05.142402+00:00, run_duration=2.740213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 04:59:00.465938+00:00, queued_by_job_id=2, pid=10941 2024-06-27T05:00:00.810524780Z [2024-06-27T05:00:00.809+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:00:00.818267083Z [2024-06-27T05:00:00.817+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:00:00.832215918Z [2024-06-27T05:00:00.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:00:00+00:00, run_after=2024-06-27T05:01:00+00:00 2024-06-27T05:00:00.846229472Z [2024-06-27T05:00:00.845+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:00:00+00:00, run_after=2024-06-27T05:05:00+00:00 2024-06-27T05:00:00.860926257Z [2024-06-27T05:00:00.860+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:00:00+00:00, run_after=2024-06-27T05:01:00+00:00 2024-06-27T05:00:00.995368836Z [2024-06-27T05:00:00.992+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T05:00:00.995385468Z 2024-06-27T05:00:00.995389139Z 2024-06-27T05:00:00.995392791Z 2024-06-27T05:00:00.995396030Z 2024-06-27T05:00:00.995399260Z 2024-06-27T05:00:00.995593596Z [2024-06-27T05:00:00.995+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:00:00.995765732Z [2024-06-27T05:00:00.995+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:00:00.995915710Z [2024-06-27T05:00:00.995+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:00:00.995979549Z [2024-06-27T05:00:00.995+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:00:00.996115892Z [2024-06-27T05:00:00.995+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:00:00.997022536Z [2024-06-27T05:00:00.996+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:00:00.997034240Z 2024-06-27T05:00:00.997038019Z 2024-06-27T05:00:00.997041420Z 2024-06-27T05:00:00.997044861Z 2024-06-27T05:00:00.997048036Z 2024-06-27T05:00:01.002626159Z [2024-06-27T05:00:01.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T04:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T05:00:01.002712278Z [2024-06-27T05:00:01.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:00:01.003199851Z [2024-06-27T05:00:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T04:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:00:01.003284077Z [2024-06-27T05:00:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T04:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:00:01.003535998Z [2024-06-27T05:00:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:00:01.003574488Z [2024-06-27T05:00:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:00:01.003929105Z [2024-06-27T05:00:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:00:01.003977378Z [2024-06-27T05:00:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:00:01.004176131Z [2024-06-27T05:00:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T04:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:00:01.004227464Z [2024-06-27T05:00:01.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T04:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:00:01.614110142Z [2024-06-27T05:00:01.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status queued for try_number 1 2024-06-27T05:00:01.614558487Z [2024-06-27T05:00:01.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:58:00+00:00 exited with status queued for try_number 1 2024-06-27T05:00:01.614712692Z [2024-06-27T05:00:01.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:59:00+00:00 exited with status queued for try_number 1 2024-06-27T05:00:01.614849979Z [2024-06-27T05:00:01.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:59:00+00:00 exited with status queued for try_number 1 2024-06-27T05:00:01.614984482Z [2024-06-27T05:00:01.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:59:00+00:00 exited with status queued for try_number 1 2024-06-27T05:00:01.632589034Z [2024-06-27T05:00:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40471771-212e-489e-9860-a6cc7f6db177 2024-06-27T05:00:01.632612682Z [2024-06-27T05:00:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4962aa6-5361-4cd6-93bb-fa4d44c3ad88 2024-06-27T05:00:01.632616346Z [2024-06-27T05:00:01.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51dd4a1c-6d38-41f3-a7dd-46d120e8f735 2024-06-27T05:00:01.632619691Z [2024-06-27T05:00:01.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to 342d6e02-e47c-4bf8-a2fb-c413ff9bd221 2024-06-27T05:00:01.632622764Z [2024-06-27T05:00:01.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to d54da06f-d571-4bee-b223-fb062d775e4d 2024-06-27T05:00:02.842796980Z [2024-06-27T05:00:02.842+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:00:02.845538907Z [2024-06-27T05:00:02.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 04:58:00+00:00, run_id=scheduled__2024-06-27T04:58:00+00:00, run_start_date=2024-06-27 05:00:00.877710+00:00, run_end_date=2024-06-27 05:00:02.844993+00:00, run_duration=1.967283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:58:00+00:00, data_interval_end=2024-06-27 05:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:00:02.880979167Z [2024-06-27T05:00:02.880+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:00:00+00:00, run_after=2024-06-27T05:02:00+00:00 2024-06-27T05:00:03.032360977Z [2024-06-27T05:00:03.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T04:58:00+00:00 exited with status success for try_number 1 2024-06-27T05:00:03.041097466Z [2024-06-27T05:00:03.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T04:58:00+00:00, map_index=-1, run_start_date=2024-06-27 05:00:02.097997+00:00, run_end_date=2024-06-27 05:00:02.450628+00:00, run_duration=0.352631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:00:00.997971+00:00, queued_by_job_id=2, pid=10979 2024-06-27T05:00:04.150669366Z [2024-06-27T05:00:04.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:00:04.151149803Z [2024-06-27T05:00:04.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 04:59:00+00:00, run_id=scheduled__2024-06-27T04:59:00+00:00, run_start_date=2024-06-27 05:00:00.879004+00:00, run_end_date=2024-06-27 05:00:04.150700+00:00, run_duration=3.271696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:59:00+00:00, data_interval_end=2024-06-27 05:00:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:00:04.166264008Z [2024-06-27T05:00:04.165+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:00:00+00:00, run_after=2024-06-27T05:01:00+00:00 2024-06-27T05:00:04.295589410Z [2024-06-27T05:00:04.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:59:00+00:00 exited with status success for try_number 1 2024-06-27T05:00:04.303326052Z [2024-06-27T05:00:04.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:59:00+00:00, map_index=-1, run_start_date=2024-06-27 05:00:02.463535+00:00, run_end_date=2024-06-27 05:00:03.107394+00:00, run_duration=0.643859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:00:00.997971+00:00, queued_by_job_id=2, pid=11000 2024-06-27T05:00:05.427227049Z [2024-06-27T05:00:05.426+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:00:05.427261472Z 2024-06-27T05:00:05.427707898Z [2024-06-27T05:00:05.427+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:00:05.428482238Z [2024-06-27T05:00:05.428+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:00:05.428499053Z 2024-06-27T05:00:05.431564091Z [2024-06-27T05:00:05.431+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T04:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T05:00:05.431725573Z [2024-06-27T05:00:05.431+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:00:05.487467950Z [2024-06-27T05:00:05.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status queued for try_number 1 2024-06-27T05:00:05.489689554Z [2024-06-27T05:00:05.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status success for try_number 1 2024-06-27T05:00:05.495957779Z [2024-06-27T05:00:05.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to dae03d6d-b671-431b-b23e-26af840038eb 2024-06-27T05:00:05.496286897Z [2024-06-27T05:00:05.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T04:55:00+00:00, map_index=-1, run_start_date=2024-06-27 05:00:03.609785+00:00, run_end_date=2024-06-27 05:00:04.260026+00:00, run_duration=0.650241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:00:00.997971+00:00, queued_by_job_id=2, pid=11029 2024-06-27T05:00:05.555303673Z [2024-06-27T05:00:05.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:00:05.555593428Z [2024-06-27T05:00:05.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:59:00+00:00, run_id=scheduled__2024-06-27T04:59:00+00:00, run_start_date=2024-06-27 05:00:00.880314+00:00, run_end_date=2024-06-27 05:00:05.555248+00:00, run_duration=4.674934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:59:00+00:00, data_interval_end=2024-06-27 05:00:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:00:05.564428023Z [2024-06-27T05:00:05.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:00:00+00:00, run_after=2024-06-27T05:01:00+00:00 2024-06-27T05:00:05.637061473Z [2024-06-27T05:00:05.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:59:00+00:00 exited with status success for try_number 1 2024-06-27T05:00:05.646956956Z [2024-06-27T05:00:05.646+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:59:00+00:00, map_index=-1, run_start_date=2024-06-27 05:00:03.968898+00:00, run_end_date=2024-06-27 05:00:05.410450+00:00, run_duration=1.441552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:00:00.997971+00:00, queued_by_job_id=2, pid=11040 2024-06-27T05:00:06.698838434Z [2024-06-27T05:00:06.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:00:06.699159833Z [2024-06-27T05:00:06.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:59:00+00:00, run_id=scheduled__2024-06-27T04:59:00+00:00, run_start_date=2024-06-27 05:00:00.881653+00:00, run_end_date=2024-06-27 05:00:06.698629+00:00, run_duration=5.816976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:59:00+00:00, data_interval_end=2024-06-27 05:00:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:00:06.710350583Z [2024-06-27T05:00:06.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:00:00+00:00, run_after=2024-06-27T05:01:00+00:00 2024-06-27T05:00:06.775148360Z [2024-06-27T05:00:06.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T04:59:00+00:00 exited with status success for try_number 1 2024-06-27T05:00:06.782158606Z [2024-06-27T05:00:06.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T04:59:00+00:00, map_index=-1, run_start_date=2024-06-27 05:00:03.805606+00:00, run_end_date=2024-06-27 05:00:05.687097+00:00, run_duration=1.881491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:00:00.997971+00:00, queued_by_job_id=2, pid=11039 2024-06-27T05:00:06.794200743Z [2024-06-27T05:00:06.793+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T05:00:07.867801393Z [2024-06-27T05:00:07.867+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:00:07.867849280Z 2024-06-27T05:00:07.868366161Z [2024-06-27T05:00:07.868+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:00:07.870059056Z [2024-06-27T05:00:07.869+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:00:07.870071644Z 2024-06-27T05:00:07.874349073Z [2024-06-27T05:00:07.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T04:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T05:00:07.874797758Z [2024-06-27T05:00:07.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T05:00:07.942209318Z [2024-06-27T05:00:07.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status queued for try_number 1 2024-06-27T05:00:07.942371565Z [2024-06-27T05:00:07.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status success for try_number 1 2024-06-27T05:00:07.949714477Z [2024-06-27T05:00:07.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 119e6e7c-938c-4a22-a06a-fe8611873099 2024-06-27T05:00:07.949876246Z [2024-06-27T05:00:07.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T04:55:00+00:00, map_index=-1, run_start_date=2024-06-27 05:00:07.091440+00:00, run_end_date=2024-06-27 05:00:07.506823+00:00, run_duration=0.415383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:00:05.428963+00:00, queued_by_job_id=2, pid=11079 2024-06-27T05:00:11.038429307Z [2024-06-27T05:00:11.037+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:00:11.038494063Z 2024-06-27T05:00:11.038501109Z [2024-06-27T05:00:11.038+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:00:11.039046962Z [2024-06-27T05:00:11.038+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:00:11.039083800Z 2024-06-27T05:00:11.041022901Z [2024-06-27T05:00:11.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T04:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:00:11.041107318Z [2024-06-27T05:00:11.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:00:11.146033703Z [2024-06-27T05:00:11.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status queued for try_number 1 2024-06-27T05:00:11.153607590Z [2024-06-27T05:00:11.153+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14de4a2a-ad34-4dd0-8ede-ee0be5cb476c 2024-06-27T05:00:11.235288673Z [2024-06-27T05:00:11.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status success for try_number 1 2024-06-27T05:00:11.243084576Z [2024-06-27T05:00:11.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T04:55:00+00:00, map_index=0, run_start_date=2024-06-27 05:00:09.587669+00:00, run_end_date=2024-06-27 05:00:10.906339+00:00, run_duration=1.31867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:00:07.871035+00:00, queued_by_job_id=2, pid=11091 2024-06-27T05:00:13.612236765Z [2024-06-27T05:00:13.611+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:00:13.612570000Z [2024-06-27T05:00:13.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 04:55:00+00:00, run_id=scheduled__2024-06-27T04:55:00+00:00, run_start_date=2024-06-27 05:00:00.876036+00:00, run_end_date=2024-06-27 05:00:13.612124+00:00, run_duration=12.736088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 04:55:00+00:00, data_interval_end=2024-06-27 05:00:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T05:00:13.619227332Z [2024-06-27T05:00:13.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:00:00+00:00, run_after=2024-06-27T05:05:00+00:00 2024-06-27T05:00:13.650535123Z [2024-06-27T05:00:13.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T04:55:00+00:00 exited with status success for try_number 1 2024-06-27T05:00:13.661245079Z [2024-06-27T05:00:13.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T04:55:00+00:00, map_index=-1, run_start_date=2024-06-27 05:00:13.022641+00:00, run_end_date=2024-06-27 05:00:13.411355+00:00, run_duration=0.388714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:00:11.039203+00:00, queued_by_job_id=2, pid=11112 2024-06-27T05:01:00.191425109Z [2024-06-27T05:01:00.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:01:00+00:00, run_after=2024-06-27T05:02:00+00:00 2024-06-27T05:01:00.208480718Z [2024-06-27T05:01:00.208+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:01:00+00:00, run_after=2024-06-27T05:02:00+00:00 2024-06-27T05:01:00.227308770Z [2024-06-27T05:01:00.226+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:01:00.302564373Z [2024-06-27T05:01:00.302+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:01:00.302599908Z 2024-06-27T05:01:00.302606231Z 2024-06-27T05:01:00.302611679Z 2024-06-27T05:01:00.302617437Z [2024-06-27T05:01:00.302+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:01:00.302839250Z [2024-06-27T05:01:00.302+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:01:00.302974037Z [2024-06-27T05:01:00.302+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:01:00.303665554Z [2024-06-27T05:01:00.303+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:01:00.303678242Z 2024-06-27T05:01:00.303684270Z 2024-06-27T05:01:00.303689728Z 2024-06-27T05:01:00.307373034Z [2024-06-27T05:01:00.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:01:00.307499573Z [2024-06-27T05:01:00.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:01:00.307746966Z [2024-06-27T05:01:00.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:01:00.307827753Z [2024-06-27T05:01:00.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:01:00.308104791Z [2024-06-27T05:01:00.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:01:00.308181881Z [2024-06-27T05:01:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:01:00.584017882Z [2024-06-27T05:01:00.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status queued for try_number 1 2024-06-27T05:01:00.584519019Z [2024-06-27T05:01:00.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status queued for try_number 1 2024-06-27T05:01:00.585123190Z [2024-06-27T05:01:00.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status queued for try_number 1 2024-06-27T05:01:00.593088981Z [2024-06-27T05:01:00.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48eb994c-6693-47d9-a90e-00e9a61c91b1 2024-06-27T05:01:00.593405905Z [2024-06-27T05:01:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 335c0cd3-685c-43fc-acbb-b0b8534c950e 2024-06-27T05:01:00.593658098Z [2024-06-27T05:01:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6683e2e-a243-444d-8c7c-d18d85c31a5d 2024-06-27T05:01:01.734911190Z [2024-06-27T05:01:01.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:01:01.736315323Z [2024-06-27T05:01:01.735+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:00:00+00:00, run_id=scheduled__2024-06-27T05:00:00+00:00, run_start_date=2024-06-27 05:01:00.246442+00:00, run_end_date=2024-06-27 05:01:01.734802+00:00, run_duration=1.48836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:00:00+00:00, data_interval_end=2024-06-27 05:01:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:01:01.749806680Z [2024-06-27T05:01:01.749+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:01:00+00:00, run_after=2024-06-27T05:02:00+00:00 2024-06-27T05:01:01.806158108Z [2024-06-27T05:01:01.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status success for try_number 1 2024-06-27T05:01:01.815542217Z [2024-06-27T05:01:01.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:00:00+00:00, map_index=-1, run_start_date=2024-06-27 05:01:01.107782+00:00, run_end_date=2024-06-27 05:01:01.548843+00:00, run_duration=0.441061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:01:00.304323+00:00, queued_by_job_id=2, pid=11138 2024-06-27T05:01:04.203258298Z [2024-06-27T05:01:04.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:01:04.203744358Z [2024-06-27T05:01:04.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:00:00+00:00, run_id=scheduled__2024-06-27T05:00:00+00:00, run_start_date=2024-06-27 05:01:00.248045+00:00, run_end_date=2024-06-27 05:01:04.203361+00:00, run_duration=3.955316, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:00:00+00:00, data_interval_end=2024-06-27 05:01:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:01:04.213749858Z [2024-06-27T05:01:04.213+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:01:00+00:00, run_after=2024-06-27T05:02:00+00:00 2024-06-27T05:01:04.220847994Z [2024-06-27T05:01:04.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:01:04.221118048Z [2024-06-27T05:01:04.220+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:00:00+00:00, run_id=scheduled__2024-06-27T05:00:00+00:00, run_start_date=2024-06-27 05:01:00.249247+00:00, run_end_date=2024-06-27 05:01:04.220772+00:00, run_duration=3.971525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:00:00+00:00, data_interval_end=2024-06-27 05:01:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:01:04.230807985Z [2024-06-27T05:01:04.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:01:00+00:00, run_after=2024-06-27T05:02:00+00:00 2024-06-27T05:01:04.267619533Z [2024-06-27T05:01:04.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status success for try_number 1 2024-06-27T05:01:04.267661411Z [2024-06-27T05:01:04.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status success for try_number 1 2024-06-27T05:01:04.275868580Z [2024-06-27T05:01:04.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:00:00+00:00, map_index=-1, run_start_date=2024-06-27 05:01:02.229326+00:00, run_end_date=2024-06-27 05:01:03.833877+00:00, run_duration=1.604551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:01:00.304323+00:00, queued_by_job_id=2, pid=11168 2024-06-27T05:01:04.275924899Z [2024-06-27T05:01:04.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:00:00+00:00, map_index=-1, run_start_date=2024-06-27 05:01:02.412806+00:00, run_end_date=2024-06-27 05:01:04.023978+00:00, run_duration=1.611172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:01:00.304323+00:00, queued_by_job_id=2, pid=11169 2024-06-27T05:01:40.959866647Z [2024-06-27T05:01:40.959+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:01:40.959898814Z 2024-06-27T05:01:40.960422200Z [2024-06-27T05:01:40.960+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-06-27T05:01:40.961320123Z [2024-06-27T05:01:40.961+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:01:40.961336116Z 2024-06-27T05:01:40.964951355Z [2024-06-27T05:01:40.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240627050139_893423', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:01:40.965354866Z [2024-06-27T05:01:40.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240627050139_893423', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-06-27T05:01:41.042306589Z [2024-06-27T05:01:41.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240627050139_893423 exited with status queued for try_number 1 2024-06-27T05:01:41.055278137Z [2024-06-27T05:01:41.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8a0a60b-47c6-46af-9cef-844fbefc8942 2024-06-27T05:01:42.432912863Z [2024-06-27T05:01:42.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:01:42.434076478Z [2024-06-27T05:01:42.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-06-27 05:01:40.225437+00:00, run_id=scaleout_vdu_20240627050139_893423, run_start_date=2024-06-27 05:01:40.898373+00:00, run_end_date=2024-06-27 05:01:42.433111+00:00, run_duration=1.534738, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-27 05:01:40.225437+00:00, data_interval_end=2024-06-27 05:01:40.225437+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-06-27T05:01:42.436968242Z [2024-06-27T05:01:42.436+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-06-27T05:01:42.474948644Z [2024-06-27T05:01:42.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240627050139_893423 exited with status success for try_number 1 2024-06-27T05:01:42.481515754Z [2024-06-27T05:01:42.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240627050139_893423, map_index=-1, run_start_date=2024-06-27 05:01:41.756032+00:00, run_end_date=2024-06-27 05:01:42.171382+00:00, run_duration=0.41535, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:01:40.961866+00:00, queued_by_job_id=2, pid=11203 2024-06-27T05:02:00.121307436Z [2024-06-27T05:02:00.120+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:02:00.164945541Z [2024-06-27T05:02:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:02:00+00:00, run_after=2024-06-27T05:03:00+00:00 2024-06-27T05:02:00.178293987Z [2024-06-27T05:02:00.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:02:00+00:00, run_after=2024-06-27T05:03:00+00:00 2024-06-27T05:02:00.194919142Z [2024-06-27T05:02:00.194+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:02:00.308896707Z [2024-06-27T05:02:00.308+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:02:00.308930551Z 2024-06-27T05:02:00.308934264Z 2024-06-27T05:02:00.308937182Z 2024-06-27T05:02:00.308940068Z 2024-06-27T05:02:00.309212208Z [2024-06-27T05:02:00.308+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:02:00.309447366Z [2024-06-27T05:02:00.309+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:02:00.309688823Z [2024-06-27T05:02:00.309+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:02:00.309886489Z [2024-06-27T05:02:00.309+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:02:00.310521909Z [2024-06-27T05:02:00.310+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:02:00.310539258Z 2024-06-27T05:02:00.310543920Z 2024-06-27T05:02:00.310548022Z 2024-06-27T05:02:00.310552153Z 2024-06-27T05:02:00.314183437Z [2024-06-27T05:02:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:02:00.314529076Z [2024-06-27T05:02:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:02:00.314912903Z [2024-06-27T05:02:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:02:00.315135971Z [2024-06-27T05:02:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:02:00.315425539Z [2024-06-27T05:02:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:02:00.315622216Z [2024-06-27T05:02:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:02:00.315929017Z [2024-06-27T05:02:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:02:00.316214677Z [2024-06-27T05:02:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:02:00.701877821Z [2024-06-27T05:02:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status queued for try_number 1 2024-06-27T05:02:00.702026854Z [2024-06-27T05:02:00.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:01:00+00:00 exited with status queued for try_number 1 2024-06-27T05:02:00.702070346Z [2024-06-27T05:02:00.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:01:00+00:00 exited with status queued for try_number 1 2024-06-27T05:02:00.702192283Z [2024-06-27T05:02:00.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:01:00+00:00 exited with status queued for try_number 1 2024-06-27T05:02:00.722044550Z [2024-06-27T05:02:00.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c6e56be-146f-4012-92ca-20b86cdbe933 2024-06-27T05:02:00.722107164Z [2024-06-27T05:02:00.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b6aaafa-0348-4d36-ac91-1bcfe2aff567 2024-06-27T05:02:00.722205934Z [2024-06-27T05:02:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8880c1b7-c5b7-49ac-a846-286c7e534054 2024-06-27T05:02:00.722292399Z [2024-06-27T05:02:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf1c88d6-4053-43a9-ad28-26be1cc865a0 2024-06-27T05:02:01.900433174Z [2024-06-27T05:02:01.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:02:01.900918031Z [2024-06-27T05:02:01.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:00:00+00:00, run_id=scheduled__2024-06-27T05:00:00+00:00, run_start_date=2024-06-27 05:02:00.223402+00:00, run_end_date=2024-06-27 05:02:01.900497+00:00, run_duration=1.677095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:00:00+00:00, data_interval_end=2024-06-27 05:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:02:01.920738650Z [2024-06-27T05:02:01.920+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:02:00+00:00, run_after=2024-06-27T05:04:00+00:00 2024-06-27T05:02:01.935752723Z [2024-06-27T05:02:01.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:02:01.936077344Z [2024-06-27T05:02:01.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:01:00+00:00, run_id=scheduled__2024-06-27T05:01:00+00:00, run_start_date=2024-06-27 05:02:00.235685+00:00, run_end_date=2024-06-27 05:02:01.935716+00:00, run_duration=1.700031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:01:00+00:00, data_interval_end=2024-06-27 05:02:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:02:01.947414854Z [2024-06-27T05:02:01.947+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:02:00+00:00, run_after=2024-06-27T05:03:00+00:00 2024-06-27T05:02:01.998296897Z [2024-06-27T05:02:01.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status success for try_number 1 2024-06-27T05:02:01.998697483Z [2024-06-27T05:02:01.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:01:00+00:00 exited with status success for try_number 1 2024-06-27T05:02:02.010654854Z [2024-06-27T05:02:02.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:00:00+00:00, map_index=-1, run_start_date=2024-06-27 05:02:01.132505+00:00, run_end_date=2024-06-27 05:02:01.638906+00:00, run_duration=0.506401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:02:00.311367+00:00, queued_by_job_id=2, pid=11227 2024-06-27T05:02:02.011137668Z [2024-06-27T05:02:02.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:01:00+00:00, map_index=-1, run_start_date=2024-06-27 05:02:01.332120+00:00, run_end_date=2024-06-27 05:02:01.760863+00:00, run_duration=0.428743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:02:00.311367+00:00, queued_by_job_id=2, pid=11228 2024-06-27T05:02:05.013763543Z [2024-06-27T05:02:05.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:02:05.014586561Z [2024-06-27T05:02:05.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:01:00+00:00, run_id=scheduled__2024-06-27T05:01:00+00:00, run_start_date=2024-06-27 05:02:00.238377+00:00, run_end_date=2024-06-27 05:02:05.013926+00:00, run_duration=4.775549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:01:00+00:00, data_interval_end=2024-06-27 05:02:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:02:05.028598681Z [2024-06-27T05:02:05.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:02:00+00:00, run_after=2024-06-27T05:03:00+00:00 2024-06-27T05:02:05.064379057Z [2024-06-27T05:02:05.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:01:00+00:00 exited with status success for try_number 1 2024-06-27T05:02:05.070703531Z [2024-06-27T05:02:05.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:01:00+00:00, map_index=-1, run_start_date=2024-06-27 05:02:02.909402+00:00, run_end_date=2024-06-27 05:02:04.574931+00:00, run_duration=1.665529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:02:00.311367+00:00, queued_by_job_id=2, pid=11268 2024-06-27T05:02:05.805594225Z [2024-06-27T05:02:05.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:02:05.806410534Z [2024-06-27T05:02:05.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:01:00+00:00, run_id=scheduled__2024-06-27T05:01:00+00:00, run_start_date=2024-06-27 05:02:00.239918+00:00, run_end_date=2024-06-27 05:02:05.805417+00:00, run_duration=5.565499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:01:00+00:00, data_interval_end=2024-06-27 05:02:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:02:05.825692727Z [2024-06-27T05:02:05.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:02:00+00:00, run_after=2024-06-27T05:03:00+00:00 2024-06-27T05:02:05.875605284Z [2024-06-27T05:02:05.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:01:00+00:00 exited with status success for try_number 1 2024-06-27T05:02:05.884370559Z [2024-06-27T05:02:05.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:01:00+00:00, map_index=-1, run_start_date=2024-06-27 05:02:02.546416+00:00, run_end_date=2024-06-27 05:02:04.906713+00:00, run_duration=2.360297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:02:00.311367+00:00, queued_by_job_id=2, pid=11259 2024-06-27T05:03:00.149877691Z [2024-06-27T05:03:00.148+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:03:00+00:00, run_after=2024-06-27T05:04:00+00:00 2024-06-27T05:03:00.159475356Z [2024-06-27T05:03:00.159+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:03:00.173880185Z [2024-06-27T05:03:00.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:03:00+00:00, run_after=2024-06-27T05:04:00+00:00 2024-06-27T05:03:00.248425303Z [2024-06-27T05:03:00.248+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:03:00.248451822Z 2024-06-27T05:03:00.248457098Z 2024-06-27T05:03:00.248461940Z 2024-06-27T05:03:00.248960750Z [2024-06-27T05:03:00.248+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:03:00.249257118Z [2024-06-27T05:03:00.249+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:03:00.249524739Z [2024-06-27T05:03:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:03:00.250299513Z [2024-06-27T05:03:00.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:03:00.250309170Z 2024-06-27T05:03:00.250313777Z 2024-06-27T05:03:00.250318241Z 2024-06-27T05:03:00.254256589Z [2024-06-27T05:03:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:03:00.254621181Z [2024-06-27T05:03:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:03:00.254991750Z [2024-06-27T05:03:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:03:00.255216696Z [2024-06-27T05:03:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:03:00.255549268Z [2024-06-27T05:03:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:03:00.255778261Z [2024-06-27T05:03:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:03:00.605430530Z [2024-06-27T05:03:00.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:02:00+00:00 exited with status queued for try_number 1 2024-06-27T05:03:00.605672114Z [2024-06-27T05:03:00.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:02:00+00:00 exited with status queued for try_number 1 2024-06-27T05:03:00.605879716Z [2024-06-27T05:03:00.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:02:00+00:00 exited with status queued for try_number 1 2024-06-27T05:03:00.613271187Z [2024-06-27T05:03:00.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5ef50f6-6ec3-4d45-b402-324e304a9aab 2024-06-27T05:03:00.613449508Z [2024-06-27T05:03:00.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35b18b3a-ccdc-412e-99a1-3a06eb149a3e 2024-06-27T05:03:00.613826217Z [2024-06-27T05:03:00.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3a82ab5-d763-492d-8bd6-d0afd0dbfe4e 2024-06-27T05:03:01.767426566Z [2024-06-27T05:03:01.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:03:01.767938756Z [2024-06-27T05:03:01.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:02:00+00:00, run_id=scheduled__2024-06-27T05:02:00+00:00, run_start_date=2024-06-27 05:03:00.189938+00:00, run_end_date=2024-06-27 05:03:01.767525+00:00, run_duration=1.577587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:02:00+00:00, data_interval_end=2024-06-27 05:03:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:03:01.778093265Z [2024-06-27T05:03:01.777+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:03:00+00:00, run_after=2024-06-27T05:04:00+00:00 2024-06-27T05:03:01.824710007Z [2024-06-27T05:03:01.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:02:00+00:00 exited with status success for try_number 1 2024-06-27T05:03:01.831519138Z [2024-06-27T05:03:01.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:02:00+00:00, map_index=-1, run_start_date=2024-06-27 05:03:01.231313+00:00, run_end_date=2024-06-27 05:03:01.646908+00:00, run_duration=0.415595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:03:00.251163+00:00, queued_by_job_id=2, pid=11314 2024-06-27T05:03:04.328385185Z [2024-06-27T05:03:04.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:03:04.328568090Z [2024-06-27T05:03:04.328+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:02:00+00:00, run_id=scheduled__2024-06-27T05:02:00+00:00, run_start_date=2024-06-27 05:03:00.192449+00:00, run_end_date=2024-06-27 05:03:04.328197+00:00, run_duration=4.135748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:02:00+00:00, data_interval_end=2024-06-27 05:03:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:03:04.339065420Z [2024-06-27T05:03:04.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:03:00+00:00, run_after=2024-06-27T05:04:00+00:00 2024-06-27T05:03:04.346921857Z [2024-06-27T05:03:04.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:03:04.346975600Z [2024-06-27T05:03:04.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:02:00+00:00, run_id=scheduled__2024-06-27T05:02:00+00:00, run_start_date=2024-06-27 05:03:00.191337+00:00, run_end_date=2024-06-27 05:03:04.346739+00:00, run_duration=4.155402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:02:00+00:00, data_interval_end=2024-06-27 05:03:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:03:04.357835196Z [2024-06-27T05:03:04.357+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:03:00+00:00, run_after=2024-06-27T05:04:00+00:00 2024-06-27T05:03:04.419177716Z [2024-06-27T05:03:04.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:02:00+00:00 exited with status success for try_number 1 2024-06-27T05:03:04.419262579Z [2024-06-27T05:03:04.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:02:00+00:00 exited with status success for try_number 1 2024-06-27T05:03:04.432490996Z [2024-06-27T05:03:04.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:02:00+00:00, map_index=-1, run_start_date=2024-06-27 05:03:02.312001+00:00, run_end_date=2024-06-27 05:03:03.674781+00:00, run_duration=1.36278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:03:00.251163+00:00, queued_by_job_id=2, pid=11344 2024-06-27T05:03:04.433185376Z [2024-06-27T05:03:04.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:02:00+00:00, map_index=-1, run_start_date=2024-06-27 05:03:02.116238+00:00, run_end_date=2024-06-27 05:03:03.731161+00:00, run_duration=1.614923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:03:00.251163+00:00, queued_by_job_id=2, pid=11343 2024-06-27T05:04:00.859320795Z [2024-06-27T05:04:00.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:04:00+00:00, run_after=2024-06-27T05:05:00+00:00 2024-06-27T05:04:00.872958021Z [2024-06-27T05:04:00.870+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:04:00+00:00, run_after=2024-06-27T05:05:00+00:00 2024-06-27T05:04:00.877436854Z [2024-06-27T05:04:00.877+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:04:00.884688427Z [2024-06-27T05:04:00.883+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:04:00.968398013Z [2024-06-27T05:04:00.967+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:04:00.968499646Z 2024-06-27T05:04:00.968515347Z 2024-06-27T05:04:00.968527580Z 2024-06-27T05:04:00.968539542Z 2024-06-27T05:04:00.968590852Z [2024-06-27T05:04:00.968+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:04:00.968606345Z [2024-06-27T05:04:00.968+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:04:00.968656276Z [2024-06-27T05:04:00.968+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:04:00.968876456Z [2024-06-27T05:04:00.968+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:04:00.969606266Z [2024-06-27T05:04:00.969+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:04:00.969637033Z 2024-06-27T05:04:00.969641744Z 2024-06-27T05:04:00.969645441Z 2024-06-27T05:04:00.969649168Z 2024-06-27T05:04:00.974688710Z [2024-06-27T05:04:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:04:00.974708579Z [2024-06-27T05:04:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:04:00.975068867Z [2024-06-27T05:04:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:04:00.975316068Z [2024-06-27T05:04:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:04:00.975746209Z [2024-06-27T05:04:00.975+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:04:00.975976215Z [2024-06-27T05:04:00.975+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:04:00.976331945Z [2024-06-27T05:04:00.976+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:04:00.976552010Z [2024-06-27T05:04:00.976+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:04:01.443623800Z [2024-06-27T05:04:01.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:02:00+00:00 exited with status queued for try_number 1 2024-06-27T05:04:01.443859448Z [2024-06-27T05:04:01.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:03:00+00:00 exited with status queued for try_number 1 2024-06-27T05:04:01.443992868Z [2024-06-27T05:04:01.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:03:00+00:00 exited with status queued for try_number 1 2024-06-27T05:04:01.444109871Z [2024-06-27T05:04:01.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:03:00+00:00 exited with status queued for try_number 1 2024-06-27T05:04:01.462288854Z [2024-06-27T05:04:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to c727ded1-599d-40fc-a655-9556a867a3c1 2024-06-27T05:04:01.462471243Z [2024-06-27T05:04:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1293ee9-6731-4032-abf5-daf62b8ba493 2024-06-27T05:04:01.462640454Z [2024-06-27T05:04:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54599b05-e8a1-4f4a-bf66-e10c2af77dca 2024-06-27T05:04:01.462809285Z [2024-06-27T05:04:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd8c0922-f4e5-4bce-9702-3bf6504877e7 2024-06-27T05:04:02.633742529Z [2024-06-27T05:04:02.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:04:02.633999968Z [2024-06-27T05:04:02.633+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:02:00+00:00, run_id=scheduled__2024-06-27T05:02:00+00:00, run_start_date=2024-06-27 05:04:00.897033+00:00, run_end_date=2024-06-27 05:04:02.633646+00:00, run_duration=1.736613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:02:00+00:00, data_interval_end=2024-06-27 05:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:04:02.647948540Z [2024-06-27T05:04:02.647+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:04:00+00:00, run_after=2024-06-27T05:06:00+00:00 2024-06-27T05:04:02.694579696Z [2024-06-27T05:04:02.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:02:00+00:00 exited with status success for try_number 1 2024-06-27T05:04:02.694607623Z [2024-06-27T05:04:02.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:03:00+00:00 exited with status success for try_number 1 2024-06-27T05:04:02.700431395Z [2024-06-27T05:04:02.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:02:00+00:00, map_index=-1, run_start_date=2024-06-27 05:04:01.968738+00:00, run_end_date=2024-06-27 05:04:02.365192+00:00, run_duration=0.396454, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:04:00.970694+00:00, queued_by_job_id=2, pid=11389 2024-06-27T05:04:02.700719593Z [2024-06-27T05:04:02.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:03:00+00:00, map_index=-1, run_start_date=2024-06-27 05:04:02.103295+00:00, run_end_date=2024-06-27 05:04:02.577729+00:00, run_duration=0.474434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:04:00.970694+00:00, queued_by_job_id=2, pid=11390 2024-06-27T05:04:03.618127863Z [2024-06-27T05:04:03.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:04:03.618331152Z [2024-06-27T05:04:03.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:03:00+00:00, run_id=scheduled__2024-06-27T05:03:00+00:00, run_start_date=2024-06-27 05:04:00.898413+00:00, run_end_date=2024-06-27 05:04:03.618040+00:00, run_duration=2.719627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:03:00+00:00, data_interval_end=2024-06-27 05:04:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:04:03.630233586Z [2024-06-27T05:04:03.629+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:04:00+00:00, run_after=2024-06-27T05:05:00+00:00 2024-06-27T05:04:05.851974057Z [2024-06-27T05:04:05.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:04:05.852593096Z [2024-06-27T05:04:05.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:03:00+00:00, run_id=scheduled__2024-06-27T05:03:00+00:00, run_start_date=2024-06-27 05:04:00.899368+00:00, run_end_date=2024-06-27 05:04:05.851917+00:00, run_duration=4.952549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:03:00+00:00, data_interval_end=2024-06-27 05:04:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:04:05.873818602Z [2024-06-27T05:04:05.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:04:00+00:00, run_after=2024-06-27T05:05:00+00:00 2024-06-27T05:04:05.884555182Z [2024-06-27T05:04:05.883+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:04:05.884960238Z [2024-06-27T05:04:05.884+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:03:00+00:00, run_id=scheduled__2024-06-27T05:03:00+00:00, run_start_date=2024-06-27 05:04:00.900418+00:00, run_end_date=2024-06-27 05:04:05.884475+00:00, run_duration=4.984057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:03:00+00:00, data_interval_end=2024-06-27 05:04:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:04:05.899135636Z [2024-06-27T05:04:05.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:04:00+00:00, run_after=2024-06-27T05:05:00+00:00 2024-06-27T05:04:05.940628590Z [2024-06-27T05:04:05.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:03:00+00:00 exited with status success for try_number 1 2024-06-27T05:04:05.949145736Z [2024-06-27T05:04:05.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:03:00+00:00, map_index=-1, run_start_date=2024-06-27 05:04:03.297432+00:00, run_end_date=2024-06-27 05:04:04.919073+00:00, run_duration=1.621641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:04:00.970694+00:00, queued_by_job_id=2, pid=11430 2024-06-27T05:04:07.027094845Z [2024-06-27T05:04:07.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:03:00+00:00 exited with status success for try_number 1 2024-06-27T05:04:07.034039698Z [2024-06-27T05:04:07.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:03:00+00:00, map_index=-1, run_start_date=2024-06-27 05:04:03.190770+00:00, run_end_date=2024-06-27 05:04:05.787599+00:00, run_duration=2.596829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:04:00.970694+00:00, queued_by_job_id=2, pid=11429 2024-06-27T05:05:00.727515908Z [2024-06-27T05:05:00.726+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:05:00+00:00, run_after=2024-06-27T05:06:00+00:00 2024-06-27T05:05:00.736376740Z [2024-06-27T05:05:00.735+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:05:00.748898155Z [2024-06-27T05:05:00.748+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:05:00+00:00, run_after=2024-06-27T05:06:00+00:00 2024-06-27T05:05:00.784160287Z [2024-06-27T05:05:00.783+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:05:00+00:00, run_after=2024-06-27T05:10:00+00:00 2024-06-27T05:05:00.910047687Z [2024-06-27T05:05:00.909+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:05:00.910078364Z 2024-06-27T05:05:00.910089346Z 2024-06-27T05:05:00.910094728Z 2024-06-27T05:05:00.910120475Z 2024-06-27T05:05:00.910589245Z [2024-06-27T05:05:00.910+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:05:00.910905097Z [2024-06-27T05:05:00.910+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:05:00.911147573Z [2024-06-27T05:05:00.911+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:05:00.911382370Z [2024-06-27T05:05:00.911+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:05:00.912202948Z [2024-06-27T05:05:00.911+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:05:00.912218270Z 2024-06-27T05:05:00.912252307Z 2024-06-27T05:05:00.912258068Z 2024-06-27T05:05:00.912262887Z 2024-06-27T05:05:00.917539181Z [2024-06-27T05:05:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T05:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T05:05:00.917971742Z [2024-06-27T05:05:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T05:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:05:00.918651135Z [2024-06-27T05:05:00.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:05:00.919189454Z [2024-06-27T05:05:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:05:00.919859408Z [2024-06-27T05:05:00.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:05:00.920149176Z [2024-06-27T05:05:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:05:00.920583914Z [2024-06-27T05:05:00.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:05:00.920953460Z [2024-06-27T05:05:00.920+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:05:01.391155914Z [2024-06-27T05:05:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status queued for try_number 1 2024-06-27T05:05:01.392937676Z [2024-06-27T05:05:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:04:00+00:00 exited with status queued for try_number 1 2024-06-27T05:05:01.393218406Z [2024-06-27T05:05:01.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:04:00+00:00 exited with status queued for try_number 1 2024-06-27T05:05:01.393432604Z [2024-06-27T05:05:01.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:04:00+00:00 exited with status queued for try_number 1 2024-06-27T05:05:01.413108227Z [2024-06-27T05:05:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to cac07652-d063-4908-bf6b-b0bc13f49e50 2024-06-27T05:05:01.413433776Z [2024-06-27T05:05:01.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4722ba42-7a1a-4018-851a-a7ea7a46b75e 2024-06-27T05:05:01.413648240Z [2024-06-27T05:05:01.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5534195-ccf4-4b7f-a838-812728409cd1 2024-06-27T05:05:01.413866745Z [2024-06-27T05:05:01.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to 062cb47c-efb3-4767-bf38-56b534912cfc 2024-06-27T05:05:03.707803158Z [2024-06-27T05:05:03.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:05:03.708379815Z [2024-06-27T05:05:03.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:04:00+00:00, run_id=scheduled__2024-06-27T05:04:00+00:00, run_start_date=2024-06-27 05:05:00.806003+00:00, run_end_date=2024-06-27 05:05:03.707727+00:00, run_duration=2.901724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:04:00+00:00, data_interval_end=2024-06-27 05:05:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:05:03.719105111Z [2024-06-27T05:05:03.718+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:05:00+00:00, run_after=2024-06-27T05:06:00+00:00 2024-06-27T05:05:03.781251982Z [2024-06-27T05:05:03.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:04:00+00:00 exited with status success for try_number 1 2024-06-27T05:05:03.794118587Z [2024-06-27T05:05:03.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:04:00+00:00, map_index=-1, run_start_date=2024-06-27 05:05:02.357827+00:00, run_end_date=2024-06-27 05:05:02.778722+00:00, run_duration=0.420895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:05:00.913706+00:00, queued_by_job_id=2, pid=11476 2024-06-27T05:05:04.169913654Z [2024-06-27T05:05:04.169+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:05:04.169947346Z 2024-06-27T05:05:04.170188555Z [2024-06-27T05:05:04.169+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:05:04.170792606Z [2024-06-27T05:05:04.170+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:05:04.170804364Z 2024-06-27T05:05:04.173224070Z [2024-06-27T05:05:04.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T05:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T05:05:04.173499565Z [2024-06-27T05:05:04.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T05:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:05:04.229515004Z [2024-06-27T05:05:04.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status queued for try_number 1 2024-06-27T05:05:04.229730501Z [2024-06-27T05:05:04.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status success for try_number 1 2024-06-27T05:05:04.234934820Z [2024-06-27T05:05:04.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fc5fe51-1664-4b76-98ad-326658567386 2024-06-27T05:05:04.235227583Z [2024-06-27T05:05:04.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T05:00:00+00:00, map_index=-1, run_start_date=2024-06-27 05:05:03.620662+00:00, run_end_date=2024-06-27 05:05:04.045483+00:00, run_duration=0.424821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:05:00.913706+00:00, queued_by_job_id=2, pid=11517 2024-06-27T05:05:05.453104341Z [2024-06-27T05:05:05.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:05:05.453180749Z [2024-06-27T05:05:05.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:04:00+00:00, run_id=scheduled__2024-06-27T05:04:00+00:00, run_start_date=2024-06-27 05:05:00.808006+00:00, run_end_date=2024-06-27 05:05:05.452821+00:00, run_duration=4.644815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:04:00+00:00, data_interval_end=2024-06-27 05:05:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:05:05.463864239Z [2024-06-27T05:05:05.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:05:00+00:00, run_after=2024-06-27T05:06:00+00:00 2024-06-27T05:05:05.472102106Z [2024-06-27T05:05:05.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:05:05.472350471Z [2024-06-27T05:05:05.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:04:00+00:00, run_id=scheduled__2024-06-27T05:04:00+00:00, run_start_date=2024-06-27 05:05:00.810081+00:00, run_end_date=2024-06-27 05:05:05.472007+00:00, run_duration=4.661926, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:04:00+00:00, data_interval_end=2024-06-27 05:05:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:05:05.485755953Z [2024-06-27T05:05:05.485+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:05:00+00:00, run_after=2024-06-27T05:06:00+00:00 2024-06-27T05:05:05.537046960Z [2024-06-27T05:05:05.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:04:00+00:00 exited with status success for try_number 1 2024-06-27T05:05:05.537768511Z [2024-06-27T05:05:05.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:04:00+00:00 exited with status success for try_number 1 2024-06-27T05:05:05.552587964Z [2024-06-27T05:05:05.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:04:00+00:00, map_index=-1, run_start_date=2024-06-27 05:05:03.462102+00:00, run_end_date=2024-06-27 05:05:04.703310+00:00, run_duration=1.241208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:05:00.913706+00:00, queued_by_job_id=2, pid=11516 2024-06-27T05:05:05.553925399Z [2024-06-27T05:05:05.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:04:00+00:00, map_index=-1, run_start_date=2024-06-27 05:05:03.615110+00:00, run_end_date=2024-06-27 05:05:05.200517+00:00, run_duration=1.585407, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:05:00.913706+00:00, queued_by_job_id=2, pid=11518 2024-06-27T05:05:06.643610109Z [2024-06-27T05:05:06.643+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:05:06.643655225Z 2024-06-27T05:05:06.643727608Z [2024-06-27T05:05:06.643+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:05:06.644402002Z [2024-06-27T05:05:06.644+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:05:06.644422940Z 2024-06-27T05:05:06.647417529Z [2024-06-27T05:05:06.647+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T05:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T05:05:06.647635538Z [2024-06-27T05:05:06.647+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T05:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T05:05:06.711405837Z [2024-06-27T05:05:06.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status queued for try_number 1 2024-06-27T05:05:06.711460975Z [2024-06-27T05:05:06.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status success for try_number 1 2024-06-27T05:05:06.726820827Z [2024-06-27T05:05:06.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to 996e08d6-bcca-4e24-9bdc-f6487b7c70ba 2024-06-27T05:05:06.727293242Z [2024-06-27T05:05:06.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T05:00:00+00:00, map_index=-1, run_start_date=2024-06-27 05:05:05.946669+00:00, run_end_date=2024-06-27 05:05:06.330695+00:00, run_duration=0.384026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:05:04.171143+00:00, queued_by_job_id=2, pid=11557 2024-06-27T05:05:06.853988224Z [2024-06-27T05:05:06.853+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T05:05:11.121860327Z [2024-06-27T05:05:11.121+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:05:11.121910886Z 2024-06-27T05:05:11.121919423Z [2024-06-27T05:05:11.121+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:05:11.122571647Z [2024-06-27T05:05:11.122+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:05:11.122584580Z 2024-06-27T05:05:11.126930117Z [2024-06-27T05:05:11.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T05:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:05:11.127000817Z [2024-06-27T05:05:11.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T05:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:05:11.185968224Z [2024-06-27T05:05:11.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status queued for try_number 1 2024-06-27T05:05:11.186023777Z [2024-06-27T05:05:11.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status success for try_number 1 2024-06-27T05:05:11.192182837Z [2024-06-27T05:05:11.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 705e5dda-0c64-42eb-b302-cd3bf322f187 2024-06-27T05:05:11.192349798Z [2024-06-27T05:05:11.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T05:00:00+00:00, map_index=0, run_start_date=2024-06-27 05:05:08.449120+00:00, run_end_date=2024-06-27 05:05:10.282516+00:00, run_duration=1.833396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:05:06.644788+00:00, queued_by_job_id=2, pid=11569 2024-06-27T05:05:13.632459002Z [2024-06-27T05:05:13.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:05:13.635058620Z [2024-06-27T05:05:13.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:00:00+00:00, run_id=scheduled__2024-06-27T05:00:00+00:00, run_start_date=2024-06-27 05:05:00.804186+00:00, run_end_date=2024-06-27 05:05:13.632599+00:00, run_duration=12.828413, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:00:00+00:00, data_interval_end=2024-06-27 05:05:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T05:05:13.655073321Z [2024-06-27T05:05:13.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:05:00+00:00, run_after=2024-06-27T05:10:00+00:00 2024-06-27T05:05:13.703067792Z [2024-06-27T05:05:13.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:00:00+00:00 exited with status success for try_number 1 2024-06-27T05:05:13.712865530Z [2024-06-27T05:05:13.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T05:00:00+00:00, map_index=-1, run_start_date=2024-06-27 05:05:12.723087+00:00, run_end_date=2024-06-27 05:05:13.154383+00:00, run_duration=0.431296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:05:11.122972+00:00, queued_by_job_id=2, pid=11590 2024-06-27T05:06:00.750390343Z [2024-06-27T05:06:00.749+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:06:00.771685125Z [2024-06-27T05:06:00.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:06:00+00:00, run_after=2024-06-27T05:07:00+00:00 2024-06-27T05:06:00.788563851Z [2024-06-27T05:06:00.787+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:06:00+00:00, run_after=2024-06-27T05:07:00+00:00 2024-06-27T05:06:00.795451979Z [2024-06-27T05:06:00.795+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:06:00.879514507Z [2024-06-27T05:06:00.878+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:06:00.879593330Z 2024-06-27T05:06:00.879603160Z 2024-06-27T05:06:00.879609742Z 2024-06-27T05:06:00.879616400Z 2024-06-27T05:06:00.879984528Z [2024-06-27T05:06:00.879+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:06:00.880369886Z [2024-06-27T05:06:00.880+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:06:00.881006097Z [2024-06-27T05:06:00.880+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:06:00.881108282Z [2024-06-27T05:06:00.880+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:06:00.882426205Z [2024-06-27T05:06:00.882+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:06:00.882453418Z 2024-06-27T05:06:00.882465362Z 2024-06-27T05:06:00.882476133Z 2024-06-27T05:06:00.882486335Z 2024-06-27T05:06:00.894370204Z [2024-06-27T05:06:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:06:00.894388647Z [2024-06-27T05:06:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:06:00.894397868Z [2024-06-27T05:06:00.893+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:06:00.894402992Z [2024-06-27T05:06:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:06:00.894413764Z [2024-06-27T05:06:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:06:00.894689472Z [2024-06-27T05:06:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:06:00.895972005Z [2024-06-27T05:06:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:06:00.896335701Z [2024-06-27T05:06:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:06:01.290093541Z [2024-06-27T05:06:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:04:00+00:00 exited with status queued for try_number 1 2024-06-27T05:06:01.290390779Z [2024-06-27T05:06:01.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status queued for try_number 1 2024-06-27T05:06:01.290619289Z [2024-06-27T05:06:01.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status queued for try_number 1 2024-06-27T05:06:01.290822267Z [2024-06-27T05:06:01.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status queued for try_number 1 2024-06-27T05:06:01.301187314Z [2024-06-27T05:06:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to d45e770e-7c62-4fb2-b68b-54398539abf8 2024-06-27T05:06:01.301459020Z [2024-06-27T05:06:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3673b4d9-88df-4aac-8c21-50fd6fa95614 2024-06-27T05:06:01.301664842Z [2024-06-27T05:06:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4ffc300-27cc-4382-9c9d-f50591267198 2024-06-27T05:06:01.301867191Z [2024-06-27T05:06:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to d329985c-44bb-4123-b65f-8d30ba2b5290 2024-06-27T05:06:02.576568393Z [2024-06-27T05:06:02.576+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:06:02.576835760Z [2024-06-27T05:06:02.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:04:00+00:00, run_id=scheduled__2024-06-27T05:04:00+00:00, run_start_date=2024-06-27 05:06:00.806884+00:00, run_end_date=2024-06-27 05:06:02.576458+00:00, run_duration=1.769574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:04:00+00:00, data_interval_end=2024-06-27 05:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:06:02.583902682Z [2024-06-27T05:06:02.583+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:06:00+00:00, run_after=2024-06-27T05:08:00+00:00 2024-06-27T05:06:02.596607603Z [2024-06-27T05:06:02.596+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:06:02.596825586Z [2024-06-27T05:06:02.596+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:05:00+00:00, run_id=scheduled__2024-06-27T05:05:00+00:00, run_start_date=2024-06-27 05:06:00.808242+00:00, run_end_date=2024-06-27 05:06:02.596490+00:00, run_duration=1.788248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:05:00+00:00, data_interval_end=2024-06-27 05:06:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:06:02.606671348Z [2024-06-27T05:06:02.606+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:06:00+00:00, run_after=2024-06-27T05:07:00+00:00 2024-06-27T05:06:02.653540927Z [2024-06-27T05:06:02.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:04:00+00:00 exited with status success for try_number 1 2024-06-27T05:06:02.653609132Z [2024-06-27T05:06:02.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status success for try_number 1 2024-06-27T05:06:02.664197530Z [2024-06-27T05:06:02.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:04:00+00:00, map_index=-1, run_start_date=2024-06-27 05:06:01.823713+00:00, run_end_date=2024-06-27 05:06:02.275507+00:00, run_duration=0.451794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:06:00.886910+00:00, queued_by_job_id=2, pid=11617 2024-06-27T05:06:02.664390398Z [2024-06-27T05:06:02.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:05:00+00:00, map_index=-1, run_start_date=2024-06-27 05:06:01.953606+00:00, run_end_date=2024-06-27 05:06:02.379283+00:00, run_duration=0.425677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:06:00.886910+00:00, queued_by_job_id=2, pid=11618 2024-06-27T05:06:04.637264192Z [2024-06-27T05:06:04.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:06:04.637686213Z [2024-06-27T05:06:04.637+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:05:00+00:00, run_id=scheduled__2024-06-27T05:05:00+00:00, run_start_date=2024-06-27 05:06:00.809480+00:00, run_end_date=2024-06-27 05:06:04.637167+00:00, run_duration=3.827687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:05:00+00:00, data_interval_end=2024-06-27 05:06:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:06:04.650056100Z [2024-06-27T05:06:04.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:06:00+00:00, run_after=2024-06-27T05:07:00+00:00 2024-06-27T05:06:04.694287485Z [2024-06-27T05:06:04.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status success for try_number 1 2024-06-27T05:06:04.702847665Z [2024-06-27T05:06:04.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:05:00+00:00, map_index=-1, run_start_date=2024-06-27 05:06:03.018016+00:00, run_end_date=2024-06-27 05:06:04.326649+00:00, run_duration=1.308633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:06:00.886910+00:00, queued_by_job_id=2, pid=11657 2024-06-27T05:06:05.888430070Z [2024-06-27T05:06:05.887+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:06:05.890309236Z [2024-06-27T05:06:05.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:05:00+00:00, run_id=scheduled__2024-06-27T05:05:00+00:00, run_start_date=2024-06-27 05:06:00.810526+00:00, run_end_date=2024-06-27 05:06:05.888172+00:00, run_duration=5.077646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:05:00+00:00, data_interval_end=2024-06-27 05:06:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:06:05.903010453Z [2024-06-27T05:06:05.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:06:00+00:00, run_after=2024-06-27T05:07:00+00:00 2024-06-27T05:06:05.943344935Z [2024-06-27T05:06:05.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status success for try_number 1 2024-06-27T05:06:05.950573615Z [2024-06-27T05:06:05.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:05:00+00:00, map_index=-1, run_start_date=2024-06-27 05:06:03.146757+00:00, run_end_date=2024-06-27 05:06:04.931013+00:00, run_duration=1.784256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:06:00.886910+00:00, queued_by_job_id=2, pid=11658 2024-06-27T05:07:00.167816846Z [2024-06-27T05:07:00.167+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:07:00.192533538Z [2024-06-27T05:07:00.192+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:07:00+00:00, run_after=2024-06-27T05:08:00+00:00 2024-06-27T05:07:00.209163294Z [2024-06-27T05:07:00.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:07:00+00:00, run_after=2024-06-27T05:08:00+00:00 2024-06-27T05:07:00.288703862Z [2024-06-27T05:07:00.288+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:07:00.288744155Z 2024-06-27T05:07:00.288837072Z 2024-06-27T05:07:00.288886470Z 2024-06-27T05:07:00.288894018Z [2024-06-27T05:07:00.288+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:07:00.288989328Z [2024-06-27T05:07:00.288+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:07:00.289150142Z [2024-06-27T05:07:00.288+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:07:00.290327304Z [2024-06-27T05:07:00.290+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:07:00.290341293Z 2024-06-27T05:07:00.290344732Z 2024-06-27T05:07:00.290347976Z 2024-06-27T05:07:00.293919077Z [2024-06-27T05:07:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:07:00.294435094Z [2024-06-27T05:07:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:07:00.294757196Z [2024-06-27T05:07:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:07:00.294947822Z [2024-06-27T05:07:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:07:00.295209527Z [2024-06-27T05:07:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:07:00.295364385Z [2024-06-27T05:07:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:07:00.558049181Z [2024-06-27T05:07:00.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:06:00+00:00 exited with status queued for try_number 1 2024-06-27T05:07:00.558368189Z [2024-06-27T05:07:00.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:06:00+00:00 exited with status queued for try_number 1 2024-06-27T05:07:00.558538128Z [2024-06-27T05:07:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:06:00+00:00 exited with status queued for try_number 1 2024-06-27T05:07:00.565944046Z [2024-06-27T05:07:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to e11b1b80-47bc-4f1d-938d-7ba0fb0912a8 2024-06-27T05:07:00.566168547Z [2024-06-27T05:07:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a533306-bbbd-4b13-8d1d-28e22b26b088 2024-06-27T05:07:00.567908934Z [2024-06-27T05:07:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to adac11b3-73b3-4b89-88ea-cd7f637ee521 2024-06-27T05:07:01.725247917Z [2024-06-27T05:07:01.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:07:01.725707032Z [2024-06-27T05:07:01.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:06:00+00:00, run_id=scheduled__2024-06-27T05:06:00+00:00, run_start_date=2024-06-27 05:07:00.231737+00:00, run_end_date=2024-06-27 05:07:01.725339+00:00, run_duration=1.493602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:06:00+00:00, data_interval_end=2024-06-27 05:07:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:07:01.735255168Z [2024-06-27T05:07:01.734+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:07:00+00:00, run_after=2024-06-27T05:08:00+00:00 2024-06-27T05:07:02.864745316Z [2024-06-27T05:07:02.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:06:00+00:00 exited with status success for try_number 1 2024-06-27T05:07:02.870173796Z [2024-06-27T05:07:02.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:06:00+00:00, map_index=-1, run_start_date=2024-06-27 05:07:01.223524+00:00, run_end_date=2024-06-27 05:07:01.677434+00:00, run_duration=0.45391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:07:00.291166+00:00, queued_by_job_id=2, pid=11702 2024-06-27T05:07:03.935485357Z [2024-06-27T05:07:03.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:07:03.936092666Z [2024-06-27T05:07:03.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:06:00+00:00, run_id=scheduled__2024-06-27T05:06:00+00:00, run_start_date=2024-06-27 05:07:00.233555+00:00, run_end_date=2024-06-27 05:07:03.935307+00:00, run_duration=3.701752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:06:00+00:00, data_interval_end=2024-06-27 05:07:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:07:03.944820261Z [2024-06-27T05:07:03.944+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:07:00+00:00, run_after=2024-06-27T05:08:00+00:00 2024-06-27T05:07:04.011387066Z [2024-06-27T05:07:04.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:06:00+00:00 exited with status success for try_number 1 2024-06-27T05:07:04.018628385Z [2024-06-27T05:07:04.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:06:00+00:00, map_index=-1, run_start_date=2024-06-27 05:07:02.232426+00:00, run_end_date=2024-06-27 05:07:03.463822+00:00, run_duration=1.231396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:07:00.291166+00:00, queued_by_job_id=2, pid=11732 2024-06-27T05:07:05.068444985Z [2024-06-27T05:07:05.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:07:05.068859180Z [2024-06-27T05:07:05.068+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:06:00+00:00, run_id=scheduled__2024-06-27T05:06:00+00:00, run_start_date=2024-06-27 05:07:00.235263+00:00, run_end_date=2024-06-27 05:07:05.068207+00:00, run_duration=4.832944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:06:00+00:00, data_interval_end=2024-06-27 05:07:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:07:05.081890495Z [2024-06-27T05:07:05.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:07:00+00:00, run_after=2024-06-27T05:08:00+00:00 2024-06-27T05:07:05.123383912Z [2024-06-27T05:07:05.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:06:00+00:00 exited with status success for try_number 1 2024-06-27T05:07:05.131654585Z [2024-06-27T05:07:05.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:06:00+00:00, map_index=-1, run_start_date=2024-06-27 05:07:02.399333+00:00, run_end_date=2024-06-27 05:07:04.115399+00:00, run_duration=1.716066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:07:00.291166+00:00, queued_by_job_id=2, pid=11733 2024-06-27T05:07:40.503291108Z [2024-06-27T05:07:40.502+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:07:40.503322236Z 2024-06-27T05:07:40.503351810Z [2024-06-27T05:07:40.503+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-06-27T05:07:40.503761401Z [2024-06-27T05:07:40.503+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:07:40.503772634Z 2024-06-27T05:07:40.506082468Z [2024-06-27T05:07:40.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240627050739_629311', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:07:40.506178284Z [2024-06-27T05:07:40.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240627050739_629311', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-06-27T05:07:40.559091089Z [2024-06-27T05:07:40.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240627050739_629311 exited with status queued for try_number 1 2024-06-27T05:07:40.572313560Z [2024-06-27T05:07:40.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9497f97c-dbb7-4254-a786-e4f9f3ffa48f 2024-06-27T05:07:42.513962265Z [2024-06-27T05:07:42.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:07:42.514391717Z [2024-06-27T05:07:42.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-06-27 05:07:40.235765+00:00, run_id=scaleout_vdu_20240627050739_629311, run_start_date=2024-06-27 05:07:40.470326+00:00, run_end_date=2024-06-27 05:07:42.513760+00:00, run_duration=2.043434, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-27 05:07:40.235765+00:00, data_interval_end=2024-06-27 05:07:40.235765+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-06-27T05:07:42.519044237Z [2024-06-27T05:07:42.518+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-06-27T05:07:42.554076446Z [2024-06-27T05:07:42.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240627050739_629311 exited with status success for try_number 1 2024-06-27T05:07:42.559002811Z [2024-06-27T05:07:42.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240627050739_629311, map_index=-1, run_start_date=2024-06-27 05:07:41.238717+00:00, run_end_date=2024-06-27 05:07:41.660242+00:00, run_duration=0.421525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:07:40.503966+00:00, queued_by_job_id=2, pid=11766 2024-06-27T05:08:00.436253924Z [2024-06-27T05:08:00.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:08:00+00:00, run_after=2024-06-27T05:09:00+00:00 2024-06-27T05:08:00.447877785Z [2024-06-27T05:08:00.447+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:08:00.462795155Z [2024-06-27T05:08:00.462+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:08:00+00:00, run_after=2024-06-27T05:09:00+00:00 2024-06-27T05:08:00.470530061Z [2024-06-27T05:08:00.470+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:08:00.549004882Z [2024-06-27T05:08:00.548+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:08:00.549040373Z 2024-06-27T05:08:00.549045160Z 2024-06-27T05:08:00.549049140Z 2024-06-27T05:08:00.549052481Z 2024-06-27T05:08:00.549184723Z [2024-06-27T05:08:00.548+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:08:00.549505300Z [2024-06-27T05:08:00.549+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:08:00.549785014Z [2024-06-27T05:08:00.549+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:08:00.550025765Z [2024-06-27T05:08:00.549+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:08:00.550849416Z [2024-06-27T05:08:00.550+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:08:00.550867413Z 2024-06-27T05:08:00.550873983Z 2024-06-27T05:08:00.550878934Z 2024-06-27T05:08:00.550883729Z 2024-06-27T05:08:00.555207915Z [2024-06-27T05:08:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:08:00.555386127Z [2024-06-27T05:08:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:08:00.555712199Z [2024-06-27T05:08:00.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:08:00.555876370Z [2024-06-27T05:08:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:08:00.556134346Z [2024-06-27T05:08:00.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:08:00.556286693Z [2024-06-27T05:08:00.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:08:00.557793006Z [2024-06-27T05:08:00.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:08:00.558075212Z [2024-06-27T05:08:00.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:08:01.273992315Z [2024-06-27T05:08:01.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:06:00+00:00 exited with status queued for try_number 1 2024-06-27T05:08:01.274026980Z [2024-06-27T05:08:01.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:07:00+00:00 exited with status queued for try_number 1 2024-06-27T05:08:01.274067896Z [2024-06-27T05:08:01.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:07:00+00:00 exited with status queued for try_number 1 2024-06-27T05:08:01.274138412Z [2024-06-27T05:08:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:07:00+00:00 exited with status queued for try_number 1 2024-06-27T05:08:01.298980932Z [2024-06-27T05:08:01.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c8c33ca-87c5-4b37-828f-c2ac06e79818 2024-06-27T05:08:01.299013216Z [2024-06-27T05:08:01.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f6402eb-c2ae-4b14-9cfa-2fe033177777 2024-06-27T05:08:01.299149056Z [2024-06-27T05:08:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9b502c1-547f-4e1e-84fb-2312551d85fe 2024-06-27T05:08:01.299227812Z [2024-06-27T05:08:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d223b82-7385-4058-8d37-42c8c8edcb29 2024-06-27T05:08:02.897570858Z [2024-06-27T05:08:02.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:08:02.897777078Z [2024-06-27T05:08:02.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:06:00+00:00, run_id=scheduled__2024-06-27T05:06:00+00:00, run_start_date=2024-06-27 05:08:00.482547+00:00, run_end_date=2024-06-27 05:08:02.897492+00:00, run_duration=2.414945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:06:00+00:00, data_interval_end=2024-06-27 05:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:08:02.906617740Z [2024-06-27T05:08:02.906+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:08:00+00:00, run_after=2024-06-27T05:10:00+00:00 2024-06-27T05:08:02.930713387Z [2024-06-27T05:08:02.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:08:02.930871481Z [2024-06-27T05:08:02.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:07:00+00:00, run_id=scheduled__2024-06-27T05:07:00+00:00, run_start_date=2024-06-27 05:08:00.483744+00:00, run_end_date=2024-06-27 05:08:02.930632+00:00, run_duration=2.446888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:07:00+00:00, data_interval_end=2024-06-27 05:08:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:08:02.940552911Z [2024-06-27T05:08:02.940+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:08:00+00:00, run_after=2024-06-27T05:09:00+00:00 2024-06-27T05:08:02.971964935Z [2024-06-27T05:08:02.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:06:00+00:00 exited with status success for try_number 1 2024-06-27T05:08:02.971994976Z [2024-06-27T05:08:02.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:07:00+00:00 exited with status success for try_number 1 2024-06-27T05:08:02.979998029Z [2024-06-27T05:08:02.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:06:00+00:00, map_index=-1, run_start_date=2024-06-27 05:08:01.851491+00:00, run_end_date=2024-06-27 05:08:02.305917+00:00, run_duration=0.454426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:08:00.551957+00:00, queued_by_job_id=2, pid=11789 2024-06-27T05:08:02.980405431Z [2024-06-27T05:08:02.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:07:00+00:00, map_index=-1, run_start_date=2024-06-27 05:08:02.044396+00:00, run_end_date=2024-06-27 05:08:02.501729+00:00, run_duration=0.457333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:08:00.551957+00:00, queued_by_job_id=2, pid=11790 2024-06-27T05:08:05.118727267Z [2024-06-27T05:08:05.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:08:05.118957997Z [2024-06-27T05:08:05.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:07:00+00:00, run_id=scheduled__2024-06-27T05:07:00+00:00, run_start_date=2024-06-27 05:08:00.484815+00:00, run_end_date=2024-06-27 05:08:05.118633+00:00, run_duration=4.633818, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:07:00+00:00, data_interval_end=2024-06-27 05:08:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:08:05.149012775Z [2024-06-27T05:08:05.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:08:00+00:00, run_after=2024-06-27T05:09:00+00:00 2024-06-27T05:08:05.212843021Z [2024-06-27T05:08:05.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:07:00+00:00 exited with status success for try_number 1 2024-06-27T05:08:05.220678520Z [2024-06-27T05:08:05.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:07:00+00:00, map_index=-1, run_start_date=2024-06-27 05:08:03.125486+00:00, run_end_date=2024-06-27 05:08:04.550399+00:00, run_duration=1.424913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:08:00.551957+00:00, queued_by_job_id=2, pid=11820 2024-06-27T05:08:05.496577016Z [2024-06-27T05:08:05.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:08:05.496620082Z [2024-06-27T05:08:05.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:07:00+00:00, run_id=scheduled__2024-06-27T05:07:00+00:00, run_start_date=2024-06-27 05:08:00.485879+00:00, run_end_date=2024-06-27 05:08:05.495325+00:00, run_duration=5.009446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:07:00+00:00, data_interval_end=2024-06-27 05:08:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:08:05.504975571Z [2024-06-27T05:08:05.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:08:00+00:00, run_after=2024-06-27T05:09:00+00:00 2024-06-27T05:08:05.545686139Z [2024-06-27T05:08:05.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:07:00+00:00 exited with status success for try_number 1 2024-06-27T05:08:05.557176542Z [2024-06-27T05:08:05.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:07:00+00:00, map_index=-1, run_start_date=2024-06-27 05:08:03.449718+00:00, run_end_date=2024-06-27 05:08:05.104277+00:00, run_duration=1.654559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:08:00.551957+00:00, queued_by_job_id=2, pid=11830 2024-06-27T05:09:00.700130684Z [2024-06-27T05:09:00.699+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:09:00.728257072Z [2024-06-27T05:09:00.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:09:00+00:00, run_after=2024-06-27T05:10:00+00:00 2024-06-27T05:09:00.756984850Z [2024-06-27T05:09:00.755+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:09:00+00:00, run_after=2024-06-27T05:10:00+00:00 2024-06-27T05:09:00.869648379Z [2024-06-27T05:09:00.869+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:09:00.869696609Z 2024-06-27T05:09:00.869703445Z 2024-06-27T05:09:00.869709464Z 2024-06-27T05:09:00.870276743Z [2024-06-27T05:09:00.869+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:09:00.871022330Z [2024-06-27T05:09:00.870+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:09:00.871694926Z [2024-06-27T05:09:00.871+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:09:00.872987183Z [2024-06-27T05:09:00.872+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:09:00.873008402Z 2024-06-27T05:09:00.873038900Z 2024-06-27T05:09:00.873045862Z 2024-06-27T05:09:00.884217102Z [2024-06-27T05:09:00.881+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:09:00.884686060Z [2024-06-27T05:09:00.884+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:09:00.887250240Z [2024-06-27T05:09:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:09:00.887463837Z [2024-06-27T05:09:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:09:00.887773064Z [2024-06-27T05:09:00.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:09:00.887955260Z [2024-06-27T05:09:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:09:01.158987715Z [2024-06-27T05:09:01.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:08:00+00:00 exited with status queued for try_number 1 2024-06-27T05:09:01.159022870Z [2024-06-27T05:09:01.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:08:00+00:00 exited with status queued for try_number 1 2024-06-27T05:09:01.159026345Z [2024-06-27T05:09:01.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:08:00+00:00 exited with status queued for try_number 1 2024-06-27T05:09:01.178761507Z [2024-06-27T05:09:01.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91c6c48c-a236-43de-bf45-14c3fc9acbcd 2024-06-27T05:09:01.178785341Z [2024-06-27T05:09:01.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to a08f300c-e04a-4f3e-9262-16a07057adaf 2024-06-27T05:09:01.184719233Z [2024-06-27T05:09:01.184+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a636f25-9243-4b75-a926-fefe0a21c8dd 2024-06-27T05:09:02.350686225Z [2024-06-27T05:09:02.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:09:02.351329395Z [2024-06-27T05:09:02.351+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:08:00+00:00, run_id=scheduled__2024-06-27T05:08:00+00:00, run_start_date=2024-06-27 05:09:00.772260+00:00, run_end_date=2024-06-27 05:09:02.350896+00:00, run_duration=1.578636, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:08:00+00:00, data_interval_end=2024-06-27 05:09:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:09:02.363913638Z [2024-06-27T05:09:02.363+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:09:00+00:00, run_after=2024-06-27T05:10:00+00:00 2024-06-27T05:09:02.424402772Z [2024-06-27T05:09:02.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:08:00+00:00 exited with status success for try_number 1 2024-06-27T05:09:02.431802705Z [2024-06-27T05:09:02.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:08:00+00:00, map_index=-1, run_start_date=2024-06-27 05:09:01.707934+00:00, run_end_date=2024-06-27 05:09:02.158065+00:00, run_duration=0.450131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:09:00.874544+00:00, queued_by_job_id=2, pid=11875 2024-06-27T05:09:06.010175157Z [2024-06-27T05:09:06.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:09:06.010451167Z [2024-06-27T05:09:06.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:08:00+00:00, run_id=scheduled__2024-06-27T05:08:00+00:00, run_start_date=2024-06-27 05:09:00.774025+00:00, run_end_date=2024-06-27 05:09:06.009966+00:00, run_duration=5.235941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:08:00+00:00, data_interval_end=2024-06-27 05:09:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:09:06.020293013Z [2024-06-27T05:09:06.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:09:00+00:00, run_after=2024-06-27T05:10:00+00:00 2024-06-27T05:09:06.028523358Z [2024-06-27T05:09:06.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:09:06.028581749Z [2024-06-27T05:09:06.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:08:00+00:00, run_id=scheduled__2024-06-27T05:08:00+00:00, run_start_date=2024-06-27 05:09:00.775747+00:00, run_end_date=2024-06-27 05:09:06.028344+00:00, run_duration=5.252597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:08:00+00:00, data_interval_end=2024-06-27 05:09:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:09:06.037884394Z [2024-06-27T05:09:06.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:09:00+00:00, run_after=2024-06-27T05:10:00+00:00 2024-06-27T05:09:06.079473869Z [2024-06-27T05:09:06.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:08:00+00:00 exited with status success for try_number 1 2024-06-27T05:09:06.079518473Z [2024-06-27T05:09:06.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:08:00+00:00 exited with status success for try_number 1 2024-06-27T05:09:06.089668545Z [2024-06-27T05:09:06.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:08:00+00:00, map_index=-1, run_start_date=2024-06-27 05:09:03.086839+00:00, run_end_date=2024-06-27 05:09:05.491051+00:00, run_duration=2.404212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:09:00.874544+00:00, queued_by_job_id=2, pid=11906 2024-06-27T05:09:06.089702278Z [2024-06-27T05:09:06.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:08:00+00:00, map_index=-1, run_start_date=2024-06-27 05:09:02.970630+00:00, run_end_date=2024-06-27 05:09:04.996506+00:00, run_duration=2.025876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:09:00.874544+00:00, queued_by_job_id=2, pid=11905 2024-06-27T05:09:40.556625521Z [2024-06-27T05:09:40.555+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:09:40.556692918Z 2024-06-27T05:09:40.557014920Z [2024-06-27T05:09:40.556+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-06-27T05:09:40.558004983Z [2024-06-27T05:09:40.557+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:09:40.558026938Z 2024-06-27T05:09:40.561859920Z [2024-06-27T05:09:40.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240627050939_680217', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:09:40.562183549Z [2024-06-27T05:09:40.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240627050939_680217', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-06-27T05:09:40.641174253Z [2024-06-27T05:09:40.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240627050939_680217 exited with status queued for try_number 1 2024-06-27T05:09:40.658004478Z [2024-06-27T05:09:40.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3900a6d-f048-4065-a43d-f5231e0e297b 2024-06-27T05:09:41.783381315Z [2024-06-27T05:09:41.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:09:41.783610662Z [2024-06-27T05:09:41.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-06-27 05:09:40.205734+00:00, run_id=scaleout_vdu_20240627050939_680217, run_start_date=2024-06-27 05:09:40.508850+00:00, run_end_date=2024-06-27 05:09:41.783325+00:00, run_duration=1.274475, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-27 05:09:40.205734+00:00, data_interval_end=2024-06-27 05:09:40.205734+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-06-27T05:09:41.786928745Z [2024-06-27T05:09:41.786+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-06-27T05:09:42.929274129Z [2024-06-27T05:09:42.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240627050939_680217 exited with status success for try_number 1 2024-06-27T05:09:42.934698657Z [2024-06-27T05:09:42.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240627050939_680217, map_index=-1, run_start_date=2024-06-27 05:09:41.334506+00:00, run_end_date=2024-06-27 05:09:41.691453+00:00, run_duration=0.356947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:09:40.558528+00:00, queued_by_job_id=2, pid=11939 2024-06-27T05:10:00.972445241Z [2024-06-27T05:10:00.971+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:10:00+00:00, run_after=2024-06-27T05:11:00+00:00 2024-06-27T05:10:00.991511647Z [2024-06-27T05:10:00.990+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:10:00+00:00, run_after=2024-06-27T05:11:00+00:00 2024-06-27T05:10:01.010045684Z [2024-06-27T05:10:01.009+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:10:00+00:00, run_after=2024-06-27T05:15:00+00:00 2024-06-27T05:10:01.018849860Z [2024-06-27T05:10:01.018+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:10:01.028192586Z [2024-06-27T05:10:01.027+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:10:01.184577484Z [2024-06-27T05:10:01.184+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T05:10:01.184621577Z 2024-06-27T05:10:01.184631098Z 2024-06-27T05:10:01.184642869Z 2024-06-27T05:10:01.184651260Z 2024-06-27T05:10:01.184659096Z 2024-06-27T05:10:01.184680216Z [2024-06-27T05:10:01.184+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:10:01.184967081Z [2024-06-27T05:10:01.184+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:10:01.185185716Z [2024-06-27T05:10:01.184+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:10:01.185373795Z [2024-06-27T05:10:01.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:10:01.185545060Z [2024-06-27T05:10:01.185+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:10:01.186197041Z [2024-06-27T05:10:01.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:10:01.186215229Z 2024-06-27T05:10:01.186225080Z 2024-06-27T05:10:01.186234037Z 2024-06-27T05:10:01.186242605Z 2024-06-27T05:10:01.186250999Z 2024-06-27T05:10:01.190792902Z [2024-06-27T05:10:01.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T05:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T05:10:01.190846298Z [2024-06-27T05:10:01.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T05:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:10:01.191049729Z [2024-06-27T05:10:01.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:10:01.191074643Z [2024-06-27T05:10:01.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:10:01.191296481Z [2024-06-27T05:10:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:10:01.191317793Z [2024-06-27T05:10:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:10:01.191535751Z [2024-06-27T05:10:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:10:01.191638383Z [2024-06-27T05:10:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:10:01.191924223Z [2024-06-27T05:10:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:10:01.192001047Z [2024-06-27T05:10:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:10:01.698516387Z [2024-06-27T05:10:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status queued for try_number 1 2024-06-27T05:10:01.698704895Z [2024-06-27T05:10:01.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:08:00+00:00 exited with status queued for try_number 1 2024-06-27T05:10:01.698831333Z [2024-06-27T05:10:01.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:09:00+00:00 exited with status queued for try_number 1 2024-06-27T05:10:01.699047678Z [2024-06-27T05:10:01.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:09:00+00:00 exited with status queued for try_number 1 2024-06-27T05:10:01.699132002Z [2024-06-27T05:10:01.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:09:00+00:00 exited with status queued for try_number 1 2024-06-27T05:10:01.721569509Z [2024-06-27T05:10:01.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to db21af1d-2fb2-4b6c-b7fc-fa9069c02280 2024-06-27T05:10:01.721735772Z [2024-06-27T05:10:01.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e4366d9-ca12-43f9-99f8-fbc784760fa9 2024-06-27T05:10:01.721930177Z [2024-06-27T05:10:01.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab0dfb29-9d32-4e49-8c23-28186584589f 2024-06-27T05:10:01.722085479Z [2024-06-27T05:10:01.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to caaa6090-0103-41f2-988c-85245c79f6a8 2024-06-27T05:10:01.722231337Z [2024-06-27T05:10:01.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to d25d8276-5ac2-4e8f-b7de-90c2ab4e30e1 2024-06-27T05:10:03.040304801Z [2024-06-27T05:10:03.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:10:03.040896836Z [2024-06-27T05:10:03.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:08:00+00:00, run_id=scheduled__2024-06-27T05:08:00+00:00, run_start_date=2024-06-27 05:10:01.045141+00:00, run_end_date=2024-06-27 05:10:03.040508+00:00, run_duration=1.995367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:08:00+00:00, data_interval_end=2024-06-27 05:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:10:03.052020252Z [2024-06-27T05:10:03.051+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:10:00+00:00, run_after=2024-06-27T05:12:00+00:00 2024-06-27T05:10:03.119062232Z [2024-06-27T05:10:03.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:08:00+00:00 exited with status success for try_number 1 2024-06-27T05:10:03.127096358Z [2024-06-27T05:10:03.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:08:00+00:00, map_index=-1, run_start_date=2024-06-27 05:10:02.134816+00:00, run_end_date=2024-06-27 05:10:02.536050+00:00, run_duration=0.401234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:10:01.187116+00:00, queued_by_job_id=2, pid=11954 2024-06-27T05:10:03.786677460Z [2024-06-27T05:10:03.785+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:10:03.787020366Z [2024-06-27T05:10:03.786+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:09:00+00:00, run_id=scheduled__2024-06-27T05:09:00+00:00, run_start_date=2024-06-27 05:10:01.046464+00:00, run_end_date=2024-06-27 05:10:03.786703+00:00, run_duration=2.740239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:09:00+00:00, data_interval_end=2024-06-27 05:10:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:10:03.807480273Z [2024-06-27T05:10:03.807+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:10:00+00:00, run_after=2024-06-27T05:11:00+00:00 2024-06-27T05:10:03.898970047Z [2024-06-27T05:10:03.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:09:00+00:00 exited with status success for try_number 1 2024-06-27T05:10:03.908453510Z [2024-06-27T05:10:03.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:09:00+00:00, map_index=-1, run_start_date=2024-06-27 05:10:02.529591+00:00, run_end_date=2024-06-27 05:10:03.144900+00:00, run_duration=0.615309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:10:01.187116+00:00, queued_by_job_id=2, pid=11974 2024-06-27T05:10:05.037055604Z [2024-06-27T05:10:05.036+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:10:05.037096033Z 2024-06-27T05:10:05.037547578Z [2024-06-27T05:10:05.037+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:10:05.038059467Z [2024-06-27T05:10:05.037+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:10:05.038088040Z 2024-06-27T05:10:05.040420018Z [2024-06-27T05:10:05.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T05:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T05:10:05.040592242Z [2024-06-27T05:10:05.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T05:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:10:05.101044004Z [2024-06-27T05:10:05.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status queued for try_number 1 2024-06-27T05:10:05.101170257Z [2024-06-27T05:10:05.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status success for try_number 1 2024-06-27T05:10:05.107381545Z [2024-06-27T05:10:05.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5893cb1-b66c-4de4-9299-53bd5cd2ce09 2024-06-27T05:10:05.107649233Z [2024-06-27T05:10:05.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T05:05:00+00:00, map_index=-1, run_start_date=2024-06-27 05:10:03.329674+00:00, run_end_date=2024-06-27 05:10:03.842757+00:00, run_duration=0.513083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:10:01.187116+00:00, queued_by_job_id=2, pid=11995 2024-06-27T05:10:06.295238626Z [2024-06-27T05:10:06.294+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:10:06.295742356Z [2024-06-27T05:10:06.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:09:00+00:00, run_id=scheduled__2024-06-27T05:09:00+00:00, run_start_date=2024-06-27 05:10:01.047731+00:00, run_end_date=2024-06-27 05:10:06.295262+00:00, run_duration=5.247531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:09:00+00:00, data_interval_end=2024-06-27 05:10:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:10:06.307512551Z [2024-06-27T05:10:06.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:10:00+00:00, run_after=2024-06-27T05:11:00+00:00 2024-06-27T05:10:06.314063922Z [2024-06-27T05:10:06.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:10:06.314374594Z [2024-06-27T05:10:06.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:09:00+00:00, run_id=scheduled__2024-06-27T05:09:00+00:00, run_start_date=2024-06-27 05:10:01.049070+00:00, run_end_date=2024-06-27 05:10:06.314058+00:00, run_duration=5.264988, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:09:00+00:00, data_interval_end=2024-06-27 05:10:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:10:06.323031665Z [2024-06-27T05:10:06.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:10:00+00:00, run_after=2024-06-27T05:11:00+00:00 2024-06-27T05:10:06.419101952Z [2024-06-27T05:10:06.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:09:00+00:00 exited with status success for try_number 1 2024-06-27T05:10:06.419134867Z [2024-06-27T05:10:06.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:09:00+00:00 exited with status success for try_number 1 2024-06-27T05:10:06.424404343Z [2024-06-27T05:10:06.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:09:00+00:00, map_index=-1, run_start_date=2024-06-27 05:10:04.006497+00:00, run_end_date=2024-06-27 05:10:05.247276+00:00, run_duration=1.240779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:10:01.187116+00:00, queued_by_job_id=2, pid=12024 2024-06-27T05:10:06.424551424Z [2024-06-27T05:10:06.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:09:00+00:00, map_index=-1, run_start_date=2024-06-27 05:10:03.807298+00:00, run_end_date=2024-06-27 05:10:05.504572+00:00, run_duration=1.697274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:10:01.187116+00:00, queued_by_job_id=2, pid=12023 2024-06-27T05:10:06.974992692Z [2024-06-27T05:10:06.974+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T05:10:08.052546989Z [2024-06-27T05:10:08.052+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:10:08.052588285Z 2024-06-27T05:10:08.052594332Z [2024-06-27T05:10:08.052+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:10:08.053179539Z [2024-06-27T05:10:08.052+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:10:08.053187854Z 2024-06-27T05:10:08.056907271Z [2024-06-27T05:10:08.055+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T05:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T05:10:08.056944254Z [2024-06-27T05:10:08.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T05:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T05:10:08.170369867Z [2024-06-27T05:10:08.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status queued for try_number 1 2024-06-27T05:10:08.170397878Z [2024-06-27T05:10:08.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status success for try_number 1 2024-06-27T05:10:08.178992090Z [2024-06-27T05:10:08.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to 938d4fee-1387-4ef6-aa9b-52341ad74b03 2024-06-27T05:10:08.179054591Z [2024-06-27T05:10:08.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T05:05:00+00:00, map_index=-1, run_start_date=2024-06-27 05:10:06.873875+00:00, run_end_date=2024-06-27 05:10:07.240976+00:00, run_duration=0.367101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:10:05.038256+00:00, queued_by_job_id=2, pid=12054 2024-06-27T05:10:11.231386305Z [2024-06-27T05:10:11.230+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:10:11.231435729Z 2024-06-27T05:10:11.231603490Z [2024-06-27T05:10:11.231+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:10:11.232296654Z [2024-06-27T05:10:11.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:10:11.232324894Z 2024-06-27T05:10:11.235248100Z [2024-06-27T05:10:11.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T05:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:10:11.235600606Z [2024-06-27T05:10:11.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T05:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:10:11.305740487Z [2024-06-27T05:10:11.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status queued for try_number 1 2024-06-27T05:10:11.305774528Z [2024-06-27T05:10:11.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status success for try_number 1 2024-06-27T05:10:11.315339796Z [2024-06-27T05:10:11.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6526dd1c-4f36-4ba8-a847-b4d31c244524 2024-06-27T05:10:11.315833508Z [2024-06-27T05:10:11.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T05:05:00+00:00, map_index=0, run_start_date=2024-06-27 05:10:09.798402+00:00, run_end_date=2024-06-27 05:10:10.959947+00:00, run_duration=1.161545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:10:08.053691+00:00, queued_by_job_id=2, pid=12066 2024-06-27T05:10:13.604318061Z [2024-06-27T05:10:13.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:10:13.604709444Z [2024-06-27T05:10:13.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:05:00+00:00, run_id=scheduled__2024-06-27T05:05:00+00:00, run_start_date=2024-06-27 05:10:01.043343+00:00, run_end_date=2024-06-27 05:10:13.604173+00:00, run_duration=12.56083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:05:00+00:00, data_interval_end=2024-06-27 05:10:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T05:10:13.615088127Z [2024-06-27T05:10:13.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:10:00+00:00, run_after=2024-06-27T05:15:00+00:00 2024-06-27T05:10:13.664971533Z [2024-06-27T05:10:13.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:05:00+00:00 exited with status success for try_number 1 2024-06-27T05:10:13.674005445Z [2024-06-27T05:10:13.673+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T05:05:00+00:00, map_index=-1, run_start_date=2024-06-27 05:10:12.973664+00:00, run_end_date=2024-06-27 05:10:13.372602+00:00, run_duration=0.398938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:10:11.232890+00:00, queued_by_job_id=2, pid=12087 2024-06-27T05:11:00.909359695Z [2024-06-27T05:11:00.908+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:11:00.934140079Z [2024-06-27T05:11:00.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:11:00+00:00, run_after=2024-06-27T05:12:00+00:00 2024-06-27T05:11:00.952412484Z [2024-06-27T05:11:00.951+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:11:00+00:00, run_after=2024-06-27T05:12:00+00:00 2024-06-27T05:11:01.058862324Z [2024-06-27T05:11:01.058+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:11:01.058908762Z 2024-06-27T05:11:01.058962520Z 2024-06-27T05:11:01.058972779Z 2024-06-27T05:11:01.059054544Z [2024-06-27T05:11:01.058+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:11:01.059112034Z [2024-06-27T05:11:01.058+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:11:01.059187049Z [2024-06-27T05:11:01.058+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:11:01.059627369Z [2024-06-27T05:11:01.059+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:11:01.059640253Z 2024-06-27T05:11:01.059649261Z 2024-06-27T05:11:01.059659195Z 2024-06-27T05:11:01.063111890Z [2024-06-27T05:11:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:11:01.064085537Z [2024-06-27T05:11:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:11:01.064102319Z [2024-06-27T05:11:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:11:01.064106745Z [2024-06-27T05:11:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:11:01.064122182Z [2024-06-27T05:11:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:11:01.064125719Z [2024-06-27T05:11:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:11:01.336357844Z [2024-06-27T05:11:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status queued for try_number 1 2024-06-27T05:11:01.336532856Z [2024-06-27T05:11:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status queued for try_number 1 2024-06-27T05:11:01.336702343Z [2024-06-27T05:11:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status queued for try_number 1 2024-06-27T05:11:01.343645505Z [2024-06-27T05:11:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25d3332e-7577-4da5-b1df-c4d95e93f6a1 2024-06-27T05:11:01.343878958Z [2024-06-27T05:11:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75a314e0-2838-4c5a-9041-ec56e722c586 2024-06-27T05:11:01.344057064Z [2024-06-27T05:11:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4a59b3a-49c6-4fb9-95e0-8708891f9e10 2024-06-27T05:11:03.656362070Z [2024-06-27T05:11:03.655+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:11:03.656678061Z [2024-06-27T05:11:03.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:10:00+00:00, run_id=scheduled__2024-06-27T05:10:00+00:00, run_start_date=2024-06-27 05:11:00.968563+00:00, run_end_date=2024-06-27 05:11:03.656304+00:00, run_duration=2.687741, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:10:00+00:00, data_interval_end=2024-06-27 05:11:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:11:03.666132640Z [2024-06-27T05:11:03.665+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:11:00+00:00, run_after=2024-06-27T05:12:00+00:00 2024-06-27T05:11:03.717017772Z [2024-06-27T05:11:03.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status success for try_number 1 2024-06-27T05:11:03.724156003Z [2024-06-27T05:11:03.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:10:00+00:00, map_index=-1, run_start_date=2024-06-27 05:11:02.190151+00:00, run_end_date=2024-06-27 05:11:02.603707+00:00, run_duration=0.413556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:11:01.060250+00:00, queued_by_job_id=2, pid=12113 2024-06-27T05:11:04.930258073Z [2024-06-27T05:11:04.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:11:04.930627424Z [2024-06-27T05:11:04.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:10:00+00:00, run_id=scheduled__2024-06-27T05:10:00+00:00, run_start_date=2024-06-27 05:11:00.971170+00:00, run_end_date=2024-06-27 05:11:04.930114+00:00, run_duration=3.958944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:10:00+00:00, data_interval_end=2024-06-27 05:11:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:11:04.944991095Z [2024-06-27T05:11:04.944+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:11:00+00:00, run_after=2024-06-27T05:12:00+00:00 2024-06-27T05:11:04.991900816Z [2024-06-27T05:11:04.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status success for try_number 1 2024-06-27T05:11:04.999112775Z [2024-06-27T05:11:04.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:10:00+00:00, map_index=-1, run_start_date=2024-06-27 05:11:03.173686+00:00, run_end_date=2024-06-27 05:11:04.783391+00:00, run_duration=1.609705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:11:01.060250+00:00, queued_by_job_id=2, pid=12143 2024-06-27T05:11:06.811854191Z [2024-06-27T05:11:06.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:11:06.812055044Z [2024-06-27T05:11:06.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:10:00+00:00, run_id=scheduled__2024-06-27T05:10:00+00:00, run_start_date=2024-06-27 05:11:00.972485+00:00, run_end_date=2024-06-27 05:11:06.811716+00:00, run_duration=5.839231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:10:00+00:00, data_interval_end=2024-06-27 05:11:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:11:06.821238364Z [2024-06-27T05:11:06.820+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:11:00+00:00, run_after=2024-06-27T05:12:00+00:00 2024-06-27T05:11:06.865753727Z [2024-06-27T05:11:06.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status success for try_number 1 2024-06-27T05:11:06.873348375Z [2024-06-27T05:11:06.872+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:10:00+00:00, map_index=-1, run_start_date=2024-06-27 05:11:03.179310+00:00, run_end_date=2024-06-27 05:11:06.185647+00:00, run_duration=3.006337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:11:01.060250+00:00, queued_by_job_id=2, pid=12144 2024-06-27T05:12:00.465392918Z [2024-06-27T05:12:00.464+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:12:00+00:00, run_after=2024-06-27T05:13:00+00:00 2024-06-27T05:12:00.473621466Z [2024-06-27T05:12:00.473+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:12:00.481551600Z [2024-06-27T05:12:00.480+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:12:00.491871793Z [2024-06-27T05:12:00.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:12:00+00:00, run_after=2024-06-27T05:13:00+00:00 2024-06-27T05:12:00.598286315Z [2024-06-27T05:12:00.597+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:12:00.598320434Z 2024-06-27T05:12:00.598325486Z 2024-06-27T05:12:00.598329574Z 2024-06-27T05:12:00.598333990Z 2024-06-27T05:12:00.598519819Z [2024-06-27T05:12:00.598+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:12:00.598833512Z [2024-06-27T05:12:00.598+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:12:00.599053667Z [2024-06-27T05:12:00.598+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:12:00.599289198Z [2024-06-27T05:12:00.599+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:12:00.600382556Z [2024-06-27T05:12:00.599+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:12:00.600398177Z 2024-06-27T05:12:00.600403415Z 2024-06-27T05:12:00.600407940Z 2024-06-27T05:12:00.600418605Z 2024-06-27T05:12:00.608226947Z [2024-06-27T05:12:00.607+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:12:00.608493011Z [2024-06-27T05:12:00.608+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:12:00.609106599Z [2024-06-27T05:12:00.608+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:12:00.609373337Z [2024-06-27T05:12:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:12:00.609777880Z [2024-06-27T05:12:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:12:00.610046601Z [2024-06-27T05:12:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:12:00.610439394Z [2024-06-27T05:12:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:12:00.610608086Z [2024-06-27T05:12:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:12:00.936261650Z [2024-06-27T05:12:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status queued for try_number 1 2024-06-27T05:12:00.936623291Z [2024-06-27T05:12:00.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:11:00+00:00 exited with status queued for try_number 1 2024-06-27T05:12:00.936914287Z [2024-06-27T05:12:00.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:11:00+00:00 exited with status queued for try_number 1 2024-06-27T05:12:00.937320276Z [2024-06-27T05:12:00.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:11:00+00:00 exited with status queued for try_number 1 2024-06-27T05:12:00.949573255Z [2024-06-27T05:12:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54fd5be8-ea85-4d3f-a318-fb2c9c32ed3a 2024-06-27T05:12:00.949951724Z [2024-06-27T05:12:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26a92e8d-d8dd-4dd9-9ce9-fdbd7fea3b9e 2024-06-27T05:12:00.950245149Z [2024-06-27T05:12:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa52c365-d43c-4c40-9903-1040ddfec32a 2024-06-27T05:12:00.951772432Z [2024-06-27T05:12:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ee531c0-c388-497a-8e7b-f2e2294fd8bc 2024-06-27T05:12:02.274628358Z [2024-06-27T05:12:02.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:12:02.275056659Z [2024-06-27T05:12:02.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:10:00+00:00, run_id=scheduled__2024-06-27T05:10:00+00:00, run_start_date=2024-06-27 05:12:00.508554+00:00, run_end_date=2024-06-27 05:12:02.274698+00:00, run_duration=1.766144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:10:00+00:00, data_interval_end=2024-06-27 05:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:12:02.282594735Z [2024-06-27T05:12:02.282+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:12:00+00:00, run_after=2024-06-27T05:14:00+00:00 2024-06-27T05:12:02.289140291Z [2024-06-27T05:12:02.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:12:02.289499123Z [2024-06-27T05:12:02.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:11:00+00:00, run_id=scheduled__2024-06-27T05:11:00+00:00, run_start_date=2024-06-27 05:12:00.511490+00:00, run_end_date=2024-06-27 05:12:02.289208+00:00, run_duration=1.777718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:11:00+00:00, data_interval_end=2024-06-27 05:12:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:12:02.298468506Z [2024-06-27T05:12:02.298+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:12:00+00:00, run_after=2024-06-27T05:13:00+00:00 2024-06-27T05:12:02.347241574Z [2024-06-27T05:12:02.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status success for try_number 1 2024-06-27T05:12:02.347478110Z [2024-06-27T05:12:02.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:11:00+00:00 exited with status success for try_number 1 2024-06-27T05:12:02.354879887Z [2024-06-27T05:12:02.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:10:00+00:00, map_index=-1, run_start_date=2024-06-27 05:12:01.555126+00:00, run_end_date=2024-06-27 05:12:01.907831+00:00, run_duration=0.352705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:12:00.602129+00:00, queued_by_job_id=2, pid=12188 2024-06-27T05:12:02.355214916Z [2024-06-27T05:12:02.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:11:00+00:00, map_index=-1, run_start_date=2024-06-27 05:12:01.714532+00:00, run_end_date=2024-06-27 05:12:02.121951+00:00, run_duration=0.407419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:12:00.602129+00:00, queued_by_job_id=2, pid=12189 2024-06-27T05:12:05.649348105Z [2024-06-27T05:12:05.648+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:12:05.649453333Z [2024-06-27T05:12:05.649+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:11:00+00:00, run_id=scheduled__2024-06-27T05:11:00+00:00, run_start_date=2024-06-27 05:12:00.515903+00:00, run_end_date=2024-06-27 05:12:05.649076+00:00, run_duration=5.133173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:11:00+00:00, data_interval_end=2024-06-27 05:12:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:12:05.657599341Z [2024-06-27T05:12:05.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:12:00+00:00, run_after=2024-06-27T05:13:00+00:00 2024-06-27T05:12:05.664235445Z [2024-06-27T05:12:05.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:12:05.664563465Z [2024-06-27T05:12:05.664+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:11:00+00:00, run_id=scheduled__2024-06-27T05:11:00+00:00, run_start_date=2024-06-27 05:12:00.513506+00:00, run_end_date=2024-06-27 05:12:05.663963+00:00, run_duration=5.150457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:11:00+00:00, data_interval_end=2024-06-27 05:12:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:12:05.680389067Z [2024-06-27T05:12:05.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:12:00+00:00, run_after=2024-06-27T05:13:00+00:00 2024-06-27T05:12:05.713811386Z [2024-06-27T05:12:05.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:11:00+00:00 exited with status success for try_number 1 2024-06-27T05:12:05.714061721Z [2024-06-27T05:12:05.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:11:00+00:00 exited with status success for try_number 1 2024-06-27T05:12:05.721984012Z [2024-06-27T05:12:05.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:11:00+00:00, map_index=-1, run_start_date=2024-06-27 05:12:02.751261+00:00, run_end_date=2024-06-27 05:12:04.978323+00:00, run_duration=2.227062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:12:00.602129+00:00, queued_by_job_id=2, pid=12229 2024-06-27T05:12:05.722276122Z [2024-06-27T05:12:05.722+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:11:00+00:00, map_index=-1, run_start_date=2024-06-27 05:12:02.731571+00:00, run_end_date=2024-06-27 05:12:05.299668+00:00, run_duration=2.568097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:12:00.602129+00:00, queued_by_job_id=2, pid=12228 2024-06-27T05:13:00.773507909Z [2024-06-27T05:13:00.772+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:13:00+00:00, run_after=2024-06-27T05:14:00+00:00 2024-06-27T05:13:00.788146233Z [2024-06-27T05:13:00.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:13:00+00:00, run_after=2024-06-27T05:14:00+00:00 2024-06-27T05:13:00.794490083Z [2024-06-27T05:13:00.794+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:13:00.887974215Z [2024-06-27T05:13:00.887+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:13:00.888194702Z 2024-06-27T05:13:00.888207642Z 2024-06-27T05:13:00.888218963Z 2024-06-27T05:13:00.888265654Z [2024-06-27T05:13:00.887+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:13:00.888506628Z [2024-06-27T05:13:00.888+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:13:00.888860355Z [2024-06-27T05:13:00.888+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:13:00.890224077Z [2024-06-27T05:13:00.889+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:13:00.890251094Z 2024-06-27T05:13:00.890261947Z 2024-06-27T05:13:00.890272244Z 2024-06-27T05:13:00.895426557Z [2024-06-27T05:13:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:13:00.895731155Z [2024-06-27T05:13:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:13:00.896614842Z [2024-06-27T05:13:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:13:00.896635994Z [2024-06-27T05:13:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:13:00.897520404Z [2024-06-27T05:13:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:13:00.897766779Z [2024-06-27T05:13:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:13:01.219166641Z [2024-06-27T05:13:01.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:12:00+00:00 exited with status queued for try_number 1 2024-06-27T05:13:01.219312965Z [2024-06-27T05:13:01.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:12:00+00:00 exited with status queued for try_number 1 2024-06-27T05:13:01.219453782Z [2024-06-27T05:13:01.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:12:00+00:00 exited with status queued for try_number 1 2024-06-27T05:13:01.230135880Z [2024-06-27T05:13:01.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48cb4d7b-a445-441a-8c0a-6f7d5fd9d70e 2024-06-27T05:13:01.230259151Z [2024-06-27T05:13:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to cec7b968-f53d-472f-9128-ad7746ca2f05 2024-06-27T05:13:01.230424248Z [2024-06-27T05:13:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4b08dde-d6a7-40a2-b268-1f861dafb1a4 2024-06-27T05:13:03.093497961Z [2024-06-27T05:13:03.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:13:03.094058201Z [2024-06-27T05:13:03.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:12:00+00:00, run_id=scheduled__2024-06-27T05:12:00+00:00, run_start_date=2024-06-27 05:13:00.812916+00:00, run_end_date=2024-06-27 05:13:03.093426+00:00, run_duration=2.28051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:12:00+00:00, data_interval_end=2024-06-27 05:13:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:13:03.105630314Z [2024-06-27T05:13:03.105+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:13:00+00:00, run_after=2024-06-27T05:14:00+00:00 2024-06-27T05:13:03.178400326Z [2024-06-27T05:13:03.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:12:00+00:00 exited with status success for try_number 1 2024-06-27T05:13:03.183791543Z [2024-06-27T05:13:03.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:12:00+00:00, map_index=-1, run_start_date=2024-06-27 05:13:01.769449+00:00, run_end_date=2024-06-27 05:13:02.176910+00:00, run_duration=0.407461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:13:00.891628+00:00, queued_by_job_id=2, pid=12274 2024-06-27T05:13:04.326594445Z [2024-06-27T05:13:04.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:12:00+00:00 exited with status success for try_number 1 2024-06-27T05:13:04.334482074Z [2024-06-27T05:13:04.333+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:12:00+00:00, map_index=-1, run_start_date=2024-06-27 05:13:02.890794+00:00, run_end_date=2024-06-27 05:13:04.125800+00:00, run_duration=1.235006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:13:00.891628+00:00, queued_by_job_id=2, pid=12304 2024-06-27T05:13:05.374119082Z [2024-06-27T05:13:05.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:13:05.374359572Z [2024-06-27T05:13:05.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:12:00+00:00, run_id=scheduled__2024-06-27T05:12:00+00:00, run_start_date=2024-06-27 05:13:00.814610+00:00, run_end_date=2024-06-27 05:13:05.374064+00:00, run_duration=4.559454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:12:00+00:00, data_interval_end=2024-06-27 05:13:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:13:05.398568647Z [2024-06-27T05:13:05.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:13:00+00:00, run_after=2024-06-27T05:14:00+00:00 2024-06-27T05:13:05.408531248Z [2024-06-27T05:13:05.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:13:05.408721719Z [2024-06-27T05:13:05.408+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:12:00+00:00, run_id=scheduled__2024-06-27T05:12:00+00:00, run_start_date=2024-06-27 05:13:00.816399+00:00, run_end_date=2024-06-27 05:13:05.408447+00:00, run_duration=4.592048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:12:00+00:00, data_interval_end=2024-06-27 05:13:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:13:05.417892830Z [2024-06-27T05:13:05.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:13:00+00:00, run_after=2024-06-27T05:14:00+00:00 2024-06-27T05:13:05.445363281Z [2024-06-27T05:13:05.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:12:00+00:00 exited with status success for try_number 1 2024-06-27T05:13:05.452945933Z [2024-06-27T05:13:05.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:12:00+00:00, map_index=-1, run_start_date=2024-06-27 05:13:02.985020+00:00, run_end_date=2024-06-27 05:13:05.046467+00:00, run_duration=2.061447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:13:00.891628+00:00, queued_by_job_id=2, pid=12305 2024-06-27T05:14:00.982755878Z [2024-06-27T05:14:00.982+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:14:01.006576866Z [2024-06-27T05:14:01.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:14:00+00:00, run_after=2024-06-27T05:15:00+00:00 2024-06-27T05:14:01.030022967Z [2024-06-27T05:14:01.029+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:14:00+00:00, run_after=2024-06-27T05:15:00+00:00 2024-06-27T05:14:01.039130478Z [2024-06-27T05:14:01.038+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:14:01.202429678Z [2024-06-27T05:14:01.201+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:14:01.202460860Z 2024-06-27T05:14:01.202465677Z 2024-06-27T05:14:01.202473060Z 2024-06-27T05:14:01.202476287Z 2024-06-27T05:14:01.202661186Z [2024-06-27T05:14:01.202+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:14:01.202948179Z [2024-06-27T05:14:01.202+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:14:01.203149011Z [2024-06-27T05:14:01.202+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:14:01.203372054Z [2024-06-27T05:14:01.203+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:14:01.204061157Z [2024-06-27T05:14:01.203+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:14:01.204086809Z 2024-06-27T05:14:01.204091258Z 2024-06-27T05:14:01.204100969Z 2024-06-27T05:14:01.204104315Z 2024-06-27T05:14:01.211486978Z [2024-06-27T05:14:01.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:14:01.211794153Z [2024-06-27T05:14:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:14:01.212275999Z [2024-06-27T05:14:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:14:01.212477363Z [2024-06-27T05:14:01.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:14:01.212851475Z [2024-06-27T05:14:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:14:01.213124664Z [2024-06-27T05:14:01.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:14:01.213438919Z [2024-06-27T05:14:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:14:01.213606863Z [2024-06-27T05:14:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:14:01.679632696Z [2024-06-27T05:14:01.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:12:00+00:00 exited with status queued for try_number 1 2024-06-27T05:14:01.683336786Z [2024-06-27T05:14:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:13:00+00:00 exited with status queued for try_number 1 2024-06-27T05:14:01.683634429Z [2024-06-27T05:14:01.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:13:00+00:00 exited with status queued for try_number 1 2024-06-27T05:14:01.683884760Z [2024-06-27T05:14:01.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:13:00+00:00 exited with status queued for try_number 1 2024-06-27T05:14:01.708035544Z [2024-06-27T05:14:01.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5be0969e-2eda-4128-8143-8535d36ec7b7 2024-06-27T05:14:01.708372779Z [2024-06-27T05:14:01.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6f0db71-5132-466d-9ca9-6f86e2483e7a 2024-06-27T05:14:01.708782868Z [2024-06-27T05:14:01.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f263dae-709e-4af1-bd0a-4de909f59e23 2024-06-27T05:14:01.709191275Z [2024-06-27T05:14:01.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4c67bc1-dd8c-442b-9c5d-e4ede8a13cb9 2024-06-27T05:14:03.053795456Z [2024-06-27T05:14:03.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:14:03.054067028Z [2024-06-27T05:14:03.053+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:13:00+00:00, run_id=scheduled__2024-06-27T05:13:00+00:00, run_start_date=2024-06-27 05:14:01.068581+00:00, run_end_date=2024-06-27 05:14:03.053762+00:00, run_duration=1.985181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:13:00+00:00, data_interval_end=2024-06-27 05:14:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:14:03.066637948Z [2024-06-27T05:14:03.066+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:14:00+00:00, run_after=2024-06-27T05:15:00+00:00 2024-06-27T05:14:04.206866352Z [2024-06-27T05:14:04.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:14:04.207255899Z [2024-06-27T05:14:04.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:12:00+00:00, run_id=scheduled__2024-06-27T05:12:00+00:00, run_start_date=2024-06-27 05:14:01.066943+00:00, run_end_date=2024-06-27 05:14:04.206904+00:00, run_duration=3.139961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:12:00+00:00, data_interval_end=2024-06-27 05:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:14:04.223125914Z [2024-06-27T05:14:04.222+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:14:00+00:00, run_after=2024-06-27T05:16:00+00:00 2024-06-27T05:14:04.275914045Z [2024-06-27T05:14:04.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:12:00+00:00 exited with status success for try_number 1 2024-06-27T05:14:04.275980334Z [2024-06-27T05:14:04.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:13:00+00:00 exited with status success for try_number 1 2024-06-27T05:14:04.281753807Z [2024-06-27T05:14:04.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:12:00+00:00, map_index=-1, run_start_date=2024-06-27 05:14:02.376993+00:00, run_end_date=2024-06-27 05:14:03.001233+00:00, run_duration=0.62424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:14:01.206569+00:00, queued_by_job_id=2, pid=12350 2024-06-27T05:14:04.281874264Z [2024-06-27T05:14:04.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:13:00+00:00, map_index=-1, run_start_date=2024-06-27 05:14:02.406221+00:00, run_end_date=2024-06-27 05:14:03.032770+00:00, run_duration=0.626549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:14:01.206569+00:00, queued_by_job_id=2, pid=12351 2024-06-27T05:14:06.433146902Z [2024-06-27T05:14:06.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:14:06.433175696Z [2024-06-27T05:14:06.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:13:00+00:00, run_id=scheduled__2024-06-27T05:13:00+00:00, run_start_date=2024-06-27 05:14:01.071362+00:00, run_end_date=2024-06-27 05:14:06.432132+00:00, run_duration=5.36077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:13:00+00:00, data_interval_end=2024-06-27 05:14:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:14:06.444431325Z [2024-06-27T05:14:06.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:14:00+00:00, run_after=2024-06-27T05:15:00+00:00 2024-06-27T05:14:06.452900346Z [2024-06-27T05:14:06.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:14:06.452925345Z [2024-06-27T05:14:06.451+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:13:00+00:00, run_id=scheduled__2024-06-27T05:13:00+00:00, run_start_date=2024-06-27 05:14:01.070144+00:00, run_end_date=2024-06-27 05:14:06.451502+00:00, run_duration=5.381358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:13:00+00:00, data_interval_end=2024-06-27 05:14:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:14:06.476645971Z [2024-06-27T05:14:06.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:14:00+00:00, run_after=2024-06-27T05:15:00+00:00 2024-06-27T05:14:06.519803509Z [2024-06-27T05:14:06.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:13:00+00:00 exited with status success for try_number 1 2024-06-27T05:14:06.520429397Z [2024-06-27T05:14:06.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:13:00+00:00 exited with status success for try_number 1 2024-06-27T05:14:06.532021349Z [2024-06-27T05:14:06.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:13:00+00:00, map_index=-1, run_start_date=2024-06-27 05:14:03.799767+00:00, run_end_date=2024-06-27 05:14:05.463696+00:00, run_duration=1.663929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:14:01.206569+00:00, queued_by_job_id=2, pid=12390 2024-06-27T05:14:06.532518716Z [2024-06-27T05:14:06.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:13:00+00:00, map_index=-1, run_start_date=2024-06-27 05:14:03.855492+00:00, run_end_date=2024-06-27 05:14:05.762948+00:00, run_duration=1.907456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:14:01.206569+00:00, queued_by_job_id=2, pid=12391 2024-06-27T05:15:00.046191420Z [2024-06-27T05:15:00.045+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:15:00+00:00, run_after=2024-06-27T05:16:00+00:00 2024-06-27T05:15:00.066333666Z [2024-06-27T05:15:00.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:15:00+00:00, run_after=2024-06-27T05:16:00+00:00 2024-06-27T05:15:00.084269160Z [2024-06-27T05:15:00.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:15:00+00:00, run_after=2024-06-27T05:20:00+00:00 2024-06-27T05:15:00.096907045Z [2024-06-27T05:15:00.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:15:00.213114187Z [2024-06-27T05:15:00.212+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:15:00.213146900Z 2024-06-27T05:15:00.213191262Z 2024-06-27T05:15:00.213199142Z 2024-06-27T05:15:00.213204872Z 2024-06-27T05:15:00.213323732Z [2024-06-27T05:15:00.212+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:15:00.213396918Z [2024-06-27T05:15:00.213+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:15:00.213438486Z [2024-06-27T05:15:00.213+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:15:00.213663444Z [2024-06-27T05:15:00.213+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:15:00.214343440Z [2024-06-27T05:15:00.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:15:00.214355755Z 2024-06-27T05:15:00.214361700Z 2024-06-27T05:15:00.214367332Z 2024-06-27T05:15:00.214372604Z 2024-06-27T05:15:00.218843714Z [2024-06-27T05:15:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T05:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T05:15:00.218876995Z [2024-06-27T05:15:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T05:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:15:00.219130492Z [2024-06-27T05:15:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:15:00.219148684Z [2024-06-27T05:15:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:15:00.219437391Z [2024-06-27T05:15:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:15:00.219528529Z [2024-06-27T05:15:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:15:00.219764756Z [2024-06-27T05:15:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:15:00.219795369Z [2024-06-27T05:15:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:15:00.504500648Z [2024-06-27T05:15:00.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status queued for try_number 1 2024-06-27T05:15:00.504940313Z [2024-06-27T05:15:00.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:14:00+00:00 exited with status queued for try_number 1 2024-06-27T05:15:00.505185538Z [2024-06-27T05:15:00.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:14:00+00:00 exited with status queued for try_number 1 2024-06-27T05:15:00.505350188Z [2024-06-27T05:15:00.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:14:00+00:00 exited with status queued for try_number 1 2024-06-27T05:15:00.519345053Z [2024-06-27T05:15:00.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to f71e94e9-cfcc-4876-bf26-f2a9fa88affc 2024-06-27T05:15:00.521195947Z [2024-06-27T05:15:00.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9a2e305-edc5-4ee4-b37a-d5f985341d8f 2024-06-27T05:15:00.521815224Z [2024-06-27T05:15:00.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e6db27e-f9e3-4197-aa5c-e47614bcaf2d 2024-06-27T05:15:00.522188359Z [2024-06-27T05:15:00.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to bffc5a6f-a88e-43be-ab9e-18afec708af2 2024-06-27T05:15:02.951953948Z [2024-06-27T05:15:02.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:15:02.952550122Z [2024-06-27T05:15:02.952+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:14:00+00:00, run_id=scheduled__2024-06-27T05:14:00+00:00, run_start_date=2024-06-27 05:15:00.114740+00:00, run_end_date=2024-06-27 05:15:02.952086+00:00, run_duration=2.837346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:14:00+00:00, data_interval_end=2024-06-27 05:15:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:15:02.968901981Z [2024-06-27T05:15:02.968+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:15:00+00:00, run_after=2024-06-27T05:16:00+00:00 2024-06-27T05:15:03.080602658Z [2024-06-27T05:15:03.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:14:00+00:00 exited with status success for try_number 1 2024-06-27T05:15:03.087740086Z [2024-06-27T05:15:03.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:14:00+00:00, map_index=-1, run_start_date=2024-06-27 05:15:01.266129+00:00, run_end_date=2024-06-27 05:15:01.828561+00:00, run_duration=0.562432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:15:00.215249+00:00, queued_by_job_id=2, pid=12436 2024-06-27T05:15:04.054039388Z [2024-06-27T05:15:04.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:15:04.054271009Z [2024-06-27T05:15:04.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:14:00+00:00, run_id=scheduled__2024-06-27T05:14:00+00:00, run_start_date=2024-06-27 05:15:00.115704+00:00, run_end_date=2024-06-27 05:15:04.053995+00:00, run_duration=3.938291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:14:00+00:00, data_interval_end=2024-06-27 05:15:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:15:04.065265386Z [2024-06-27T05:15:04.064+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:15:00+00:00, run_after=2024-06-27T05:16:00+00:00 2024-06-27T05:15:04.092505423Z [2024-06-27T05:15:04.091+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:15:04.092557567Z 2024-06-27T05:15:04.092591875Z [2024-06-27T05:15:04.092+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:15:04.093372962Z [2024-06-27T05:15:04.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:15:04.093409792Z 2024-06-27T05:15:04.095828666Z [2024-06-27T05:15:04.095+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T05:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T05:15:04.095979805Z [2024-06-27T05:15:04.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T05:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:15:04.177627321Z [2024-06-27T05:15:04.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status queued for try_number 1 2024-06-27T05:15:04.178371603Z [2024-06-27T05:15:04.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status success for try_number 1 2024-06-27T05:15:04.178543597Z [2024-06-27T05:15:04.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:14:00+00:00 exited with status success for try_number 1 2024-06-27T05:15:04.190442771Z [2024-06-27T05:15:04.190+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ac2b971-43fe-4e50-a6d0-78edb9fe6908 2024-06-27T05:15:04.190782528Z [2024-06-27T05:15:04.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T05:10:00+00:00, map_index=-1, run_start_date=2024-06-27 05:15:02.542482+00:00, run_end_date=2024-06-27 05:15:03.088264+00:00, run_duration=0.545782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:15:00.215249+00:00, queued_by_job_id=2, pid=12486 2024-06-27T05:15:04.192119817Z [2024-06-27T05:15:04.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:14:00+00:00, map_index=-1, run_start_date=2024-06-27 05:15:02.176059+00:00, run_end_date=2024-06-27 05:15:03.555181+00:00, run_duration=1.379122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:15:00.215249+00:00, queued_by_job_id=2, pid=12458 2024-06-27T05:15:05.359007857Z [2024-06-27T05:15:05.358+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:15:05.359187239Z [2024-06-27T05:15:05.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:14:00+00:00, run_id=scheduled__2024-06-27T05:14:00+00:00, run_start_date=2024-06-27 05:15:00.116605+00:00, run_end_date=2024-06-27 05:15:05.358927+00:00, run_duration=5.242322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:14:00+00:00, data_interval_end=2024-06-27 05:15:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:15:05.369530069Z [2024-06-27T05:15:05.369+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:15:00+00:00, run_after=2024-06-27T05:16:00+00:00 2024-06-27T05:15:05.425802349Z [2024-06-27T05:15:05.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:14:00+00:00 exited with status success for try_number 1 2024-06-27T05:15:05.453300289Z [2024-06-27T05:15:05.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:14:00+00:00, map_index=-1, run_start_date=2024-06-27 05:15:02.623332+00:00, run_end_date=2024-06-27 05:15:04.333472+00:00, run_duration=1.71014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:15:00.215249+00:00, queued_by_job_id=2, pid=12487 2024-06-27T05:15:06.539487166Z [2024-06-27T05:15:06.539+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:15:06.539525876Z 2024-06-27T05:15:06.539976430Z [2024-06-27T05:15:06.539+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:15:06.540714760Z [2024-06-27T05:15:06.540+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:15:06.540733091Z 2024-06-27T05:15:06.546257744Z [2024-06-27T05:15:06.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T05:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T05:15:06.546414440Z [2024-06-27T05:15:06.546+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T05:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T05:15:06.606936330Z [2024-06-27T05:15:06.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status queued for try_number 1 2024-06-27T05:15:06.606979698Z [2024-06-27T05:15:06.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status success for try_number 1 2024-06-27T05:15:06.613379995Z [2024-06-27T05:15:06.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e674917-0218-42d3-91af-c41970e078a1 2024-06-27T05:15:06.613545085Z [2024-06-27T05:15:06.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T05:10:00+00:00, map_index=-1, run_start_date=2024-06-27 05:15:05.788459+00:00, run_end_date=2024-06-27 05:15:06.178243+00:00, run_duration=0.389784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:15:04.093613+00:00, queued_by_job_id=2, pid=12517 2024-06-27T05:15:07.092578488Z [2024-06-27T05:15:07.092+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T05:15:10.371174050Z [2024-06-27T05:15:10.370+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:15:10.371232967Z 2024-06-27T05:15:10.371241172Z [2024-06-27T05:15:10.370+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:15:10.371623832Z [2024-06-27T05:15:10.371+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:15:10.371634021Z 2024-06-27T05:15:10.373867572Z [2024-06-27T05:15:10.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T05:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:15:10.373923037Z [2024-06-27T05:15:10.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T05:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:15:10.429135626Z [2024-06-27T05:15:10.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status queued for try_number 1 2024-06-27T05:15:10.429467930Z [2024-06-27T05:15:10.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status success for try_number 1 2024-06-27T05:15:10.435685371Z [2024-06-27T05:15:10.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69e2c0b3-b0a4-4568-a5d5-7ef9373f7922 2024-06-27T05:15:10.436110001Z [2024-06-27T05:15:10.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T05:10:00+00:00, map_index=0, run_start_date=2024-06-27 05:15:08.253065+00:00, run_end_date=2024-06-27 05:15:09.412086+00:00, run_duration=1.159021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:15:06.541200+00:00, queued_by_job_id=2, pid=12529 2024-06-27T05:15:12.716387946Z [2024-06-27T05:15:12.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:15:12.718050971Z [2024-06-27T05:15:12.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:10:00+00:00, run_id=scheduled__2024-06-27T05:10:00+00:00, run_start_date=2024-06-27 05:15:00.113400+00:00, run_end_date=2024-06-27 05:15:12.716340+00:00, run_duration=12.60294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:10:00+00:00, data_interval_end=2024-06-27 05:15:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T05:15:12.728912656Z [2024-06-27T05:15:12.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:15:00+00:00, run_after=2024-06-27T05:20:00+00:00 2024-06-27T05:15:12.833968277Z [2024-06-27T05:15:12.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:10:00+00:00 exited with status success for try_number 1 2024-06-27T05:15:12.842655574Z [2024-06-27T05:15:12.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T05:10:00+00:00, map_index=-1, run_start_date=2024-06-27 05:15:12.091010+00:00, run_end_date=2024-06-27 05:15:12.459131+00:00, run_duration=0.368121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:15:10.371853+00:00, queued_by_job_id=2, pid=12550 2024-06-27T05:16:00.045785092Z [2024-06-27T05:16:00.045+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:16:00.058651920Z [2024-06-27T05:16:00.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:16:00+00:00, run_after=2024-06-27T05:17:00+00:00 2024-06-27T05:16:00.074672712Z [2024-06-27T05:16:00.074+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:16:00+00:00, run_after=2024-06-27T05:17:00+00:00 2024-06-27T05:16:00.081664628Z [2024-06-27T05:16:00.081+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:16:00.160441651Z [2024-06-27T05:16:00.160+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:16:00.160462977Z 2024-06-27T05:16:00.160466982Z 2024-06-27T05:16:00.160470211Z 2024-06-27T05:16:00.160473563Z 2024-06-27T05:16:00.160633174Z [2024-06-27T05:16:00.160+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:16:00.160907456Z [2024-06-27T05:16:00.160+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:16:00.161154098Z [2024-06-27T05:16:00.160+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:16:00.161324250Z [2024-06-27T05:16:00.161+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:16:00.162028047Z [2024-06-27T05:16:00.161+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:16:00.162039128Z 2024-06-27T05:16:00.162043048Z 2024-06-27T05:16:00.162046239Z 2024-06-27T05:16:00.162049694Z 2024-06-27T05:16:00.165478579Z [2024-06-27T05:16:00.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:16:00.165683446Z [2024-06-27T05:16:00.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:16:00.166067800Z [2024-06-27T05:16:00.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:16:00.166264609Z [2024-06-27T05:16:00.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:16:00.166591978Z [2024-06-27T05:16:00.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:16:00.166767942Z [2024-06-27T05:16:00.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:16:00.167070087Z [2024-06-27T05:16:00.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:16:00.167237456Z [2024-06-27T05:16:00.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:16:00.487626279Z [2024-06-27T05:16:00.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:14:00+00:00 exited with status queued for try_number 1 2024-06-27T05:16:00.487895754Z [2024-06-27T05:16:00.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status queued for try_number 1 2024-06-27T05:16:00.488064851Z [2024-06-27T05:16:00.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status queued for try_number 1 2024-06-27T05:16:00.488179507Z [2024-06-27T05:16:00.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status queued for try_number 1 2024-06-27T05:16:00.496700076Z [2024-06-27T05:16:00.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81ee9961-fdbd-4bd4-ac67-2f2a5a4faec6 2024-06-27T05:16:00.497139237Z [2024-06-27T05:16:00.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 987c27ac-2838-4e0e-9d52-1523d89086c0 2024-06-27T05:16:00.497379881Z [2024-06-27T05:16:00.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 124082d8-9c93-4f23-a107-0aada00941f1 2024-06-27T05:16:00.497563382Z [2024-06-27T05:16:00.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3888e394-0f79-4dbf-b116-f4f472b2baa4 2024-06-27T05:16:02.025297358Z [2024-06-27T05:16:02.024+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:16:02.025779065Z [2024-06-27T05:16:02.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:14:00+00:00, run_id=scheduled__2024-06-27T05:14:00+00:00, run_start_date=2024-06-27 05:16:00.095081+00:00, run_end_date=2024-06-27 05:16:02.025209+00:00, run_duration=1.930128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:14:00+00:00, data_interval_end=2024-06-27 05:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:16:02.034274907Z [2024-06-27T05:16:02.033+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:16:00+00:00, run_after=2024-06-27T05:18:00+00:00 2024-06-27T05:16:02.053651847Z [2024-06-27T05:16:02.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:16:02.055145540Z [2024-06-27T05:16:02.053+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:15:00+00:00, run_id=scheduled__2024-06-27T05:15:00+00:00, run_start_date=2024-06-27 05:16:00.096505+00:00, run_end_date=2024-06-27 05:16:02.053555+00:00, run_duration=1.95705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:15:00+00:00, data_interval_end=2024-06-27 05:16:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:16:02.066750648Z [2024-06-27T05:16:02.066+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:16:00+00:00, run_after=2024-06-27T05:17:00+00:00 2024-06-27T05:16:02.101749265Z [2024-06-27T05:16:02.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:14:00+00:00 exited with status success for try_number 1 2024-06-27T05:16:02.101917023Z [2024-06-27T05:16:02.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status success for try_number 1 2024-06-27T05:16:02.108289776Z [2024-06-27T05:16:02.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:14:00+00:00, map_index=-1, run_start_date=2024-06-27 05:16:01.018976+00:00, run_end_date=2024-06-27 05:16:01.511770+00:00, run_duration=0.492794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:16:00.163106+00:00, queued_by_job_id=2, pid=12578 2024-06-27T05:16:02.108598866Z [2024-06-27T05:16:02.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:15:00+00:00, map_index=-1, run_start_date=2024-06-27 05:16:01.214512+00:00, run_end_date=2024-06-27 05:16:01.590723+00:00, run_duration=0.376211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:16:00.163106+00:00, queued_by_job_id=2, pid=12579 2024-06-27T05:16:04.269273744Z [2024-06-27T05:16:04.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:16:04.269691744Z [2024-06-27T05:16:04.269+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:15:00+00:00, run_id=scheduled__2024-06-27T05:15:00+00:00, run_start_date=2024-06-27 05:16:00.098692+00:00, run_end_date=2024-06-27 05:16:04.269350+00:00, run_duration=4.170658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:15:00+00:00, data_interval_end=2024-06-27 05:16:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:16:04.278113632Z [2024-06-27T05:16:04.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:16:00+00:00, run_after=2024-06-27T05:17:00+00:00 2024-06-27T05:16:04.285542164Z [2024-06-27T05:16:04.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:16:04.285803790Z [2024-06-27T05:16:04.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:15:00+00:00, run_id=scheduled__2024-06-27T05:15:00+00:00, run_start_date=2024-06-27 05:16:00.097658+00:00, run_end_date=2024-06-27 05:16:04.285462+00:00, run_duration=4.187804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:15:00+00:00, data_interval_end=2024-06-27 05:16:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:16:04.295374478Z [2024-06-27T05:16:04.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:16:00+00:00, run_after=2024-06-27T05:17:00+00:00 2024-06-27T05:16:04.341420998Z [2024-06-27T05:16:04.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status success for try_number 1 2024-06-27T05:16:04.341895879Z [2024-06-27T05:16:04.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status success for try_number 1 2024-06-27T05:16:04.354376875Z [2024-06-27T05:16:04.353+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:15:00+00:00, map_index=-1, run_start_date=2024-06-27 05:16:02.126649+00:00, run_end_date=2024-06-27 05:16:03.759363+00:00, run_duration=1.632714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:16:00.163106+00:00, queued_by_job_id=2, pid=12617 2024-06-27T05:16:04.354928946Z [2024-06-27T05:16:04.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:15:00+00:00, map_index=-1, run_start_date=2024-06-27 05:16:02.295382+00:00, run_end_date=2024-06-27 05:16:03.588334+00:00, run_duration=1.292952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:16:00.163106+00:00, queued_by_job_id=2, pid=12618 2024-06-27T05:16:37.137588192Z [2024-06-27T05:16:37.137+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:16:37.137626763Z 2024-06-27T05:16:37.137933078Z [2024-06-27T05:16:37.137+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-06-27T05:16:37.138942257Z [2024-06-27T05:16:37.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:16:37.138957368Z 2024-06-27T05:16:37.143461542Z [2024-06-27T05:16:37.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240627051636_677658', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:16:37.143839523Z [2024-06-27T05:16:37.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240627051636_677658', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-06-27T05:16:37.217703759Z [2024-06-27T05:16:37.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240627051636_677658 exited with status queued for try_number 1 2024-06-27T05:16:37.222842922Z [2024-06-27T05:16:37.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd51d3ae-7916-40e5-8647-59772b259d0c 2024-06-27T05:16:39.151376903Z [2024-06-27T05:16:39.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:16:39.151745186Z [2024-06-27T05:16:39.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-06-27 05:16:36.907626+00:00, run_id=vdu_alarm_20240627051636_677658, run_start_date=2024-06-27 05:16:37.089687+00:00, run_end_date=2024-06-27 05:16:39.151258+00:00, run_duration=2.061571, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-27 05:16:36.907626+00:00, data_interval_end=2024-06-27 05:16:36.907626+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-06-27T05:16:39.156999017Z [2024-06-27T05:16:39.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-06-27T05:16:39.202343343Z [2024-06-27T05:16:39.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240627051636_677658 exited with status success for try_number 1 2024-06-27T05:16:39.209877172Z [2024-06-27T05:16:39.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240627051636_677658, map_index=-1, run_start_date=2024-06-27 05:16:37.828515+00:00, run_end_date=2024-06-27 05:16:38.260175+00:00, run_duration=0.43166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:16:37.139627+00:00, queued_by_job_id=2, pid=12651 2024-06-27T05:17:00.359693700Z [2024-06-27T05:17:00.356+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:17:00.370852316Z [2024-06-27T05:17:00.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:17:00+00:00, run_after=2024-06-27T05:18:00+00:00 2024-06-27T05:17:00.384360691Z [2024-06-27T05:17:00.384+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:17:00+00:00, run_after=2024-06-27T05:18:00+00:00 2024-06-27T05:17:00.467521946Z [2024-06-27T05:17:00.467+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:17:00.467554467Z 2024-06-27T05:17:00.467558535Z 2024-06-27T05:17:00.467561564Z 2024-06-27T05:17:00.467616418Z [2024-06-27T05:17:00.467+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:17:00.467767676Z [2024-06-27T05:17:00.467+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:17:00.467779418Z [2024-06-27T05:17:00.467+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:17:00.468360417Z [2024-06-27T05:17:00.468+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:17:00.468372632Z 2024-06-27T05:17:00.468375914Z 2024-06-27T05:17:00.468379304Z 2024-06-27T05:17:00.473146570Z [2024-06-27T05:17:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:17:00.473247204Z [2024-06-27T05:17:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:17:00.473258927Z [2024-06-27T05:17:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:17:00.473267902Z [2024-06-27T05:17:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:17:00.473359614Z [2024-06-27T05:17:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:17:00.473457470Z [2024-06-27T05:17:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:17:00.757917525Z [2024-06-27T05:17:00.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:16:00+00:00 exited with status queued for try_number 1 2024-06-27T05:17:00.757996433Z [2024-06-27T05:17:00.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:16:00+00:00 exited with status queued for try_number 1 2024-06-27T05:17:00.758001487Z [2024-06-27T05:17:00.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:16:00+00:00 exited with status queued for try_number 1 2024-06-27T05:17:00.781451297Z [2024-06-27T05:17:00.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14f78725-1ac5-42f0-aef5-d979da65ecdb 2024-06-27T05:17:00.781528576Z [2024-06-27T05:17:00.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to b90d16cc-b822-4a2f-a3d6-c79de10e1fbd 2024-06-27T05:17:00.781554894Z [2024-06-27T05:17:00.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a212c79-27de-4358-9ee3-1d79397d9fb2 2024-06-27T05:17:02.431856172Z [2024-06-27T05:17:02.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:17:02.432392916Z [2024-06-27T05:17:02.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:16:00+00:00, run_id=scheduled__2024-06-27T05:16:00+00:00, run_start_date=2024-06-27 05:17:00.397327+00:00, run_end_date=2024-06-27 05:17:02.431810+00:00, run_duration=2.034483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:16:00+00:00, data_interval_end=2024-06-27 05:17:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:17:02.445313173Z [2024-06-27T05:17:02.444+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:17:00+00:00, run_after=2024-06-27T05:18:00+00:00 2024-06-27T05:17:02.521785820Z [2024-06-27T05:17:02.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:16:00+00:00 exited with status success for try_number 1 2024-06-27T05:17:02.541966468Z [2024-06-27T05:17:02.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:16:00+00:00, map_index=-1, run_start_date=2024-06-27 05:17:01.451414+00:00, run_end_date=2024-06-27 05:17:01.887612+00:00, run_duration=0.436198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:17:00.469295+00:00, queued_by_job_id=2, pid=12673 2024-06-27T05:17:04.758147841Z [2024-06-27T05:17:04.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:17:04.758739214Z [2024-06-27T05:17:04.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:16:00+00:00, run_id=scheduled__2024-06-27T05:16:00+00:00, run_start_date=2024-06-27 05:17:00.398541+00:00, run_end_date=2024-06-27 05:17:04.758255+00:00, run_duration=4.359714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:16:00+00:00, data_interval_end=2024-06-27 05:17:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:17:04.769607824Z [2024-06-27T05:17:04.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:17:00+00:00, run_after=2024-06-27T05:18:00+00:00 2024-06-27T05:17:04.778155985Z [2024-06-27T05:17:04.777+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:17:04.778491397Z [2024-06-27T05:17:04.778+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:16:00+00:00, run_id=scheduled__2024-06-27T05:16:00+00:00, run_start_date=2024-06-27 05:17:00.399577+00:00, run_end_date=2024-06-27 05:17:04.778102+00:00, run_duration=4.378525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:16:00+00:00, data_interval_end=2024-06-27 05:17:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:17:04.788251527Z [2024-06-27T05:17:04.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:17:00+00:00, run_after=2024-06-27T05:18:00+00:00 2024-06-27T05:17:04.833884392Z [2024-06-27T05:17:04.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:16:00+00:00 exited with status success for try_number 1 2024-06-27T05:17:04.835046998Z [2024-06-27T05:17:04.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:16:00+00:00 exited with status success for try_number 1 2024-06-27T05:17:04.849750408Z [2024-06-27T05:17:04.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:16:00+00:00, map_index=-1, run_start_date=2024-06-27 05:17:02.478907+00:00, run_end_date=2024-06-27 05:17:03.896963+00:00, run_duration=1.418056, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:17:00.469295+00:00, queued_by_job_id=2, pid=12704 2024-06-27T05:17:04.850236307Z [2024-06-27T05:17:04.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:16:00+00:00, map_index=-1, run_start_date=2024-06-27 05:17:02.467124+00:00, run_end_date=2024-06-27 05:17:04.209279+00:00, run_duration=1.742155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:17:00.469295+00:00, queued_by_job_id=2, pid=12703 2024-06-27T05:18:00.906335335Z [2024-06-27T05:18:00.905+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:18:00.919012695Z [2024-06-27T05:18:00.918+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:18:00.932472042Z [2024-06-27T05:18:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:18:00+00:00, run_after=2024-06-27T05:19:00+00:00 2024-06-27T05:18:00.951079290Z [2024-06-27T05:18:00.950+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:18:00+00:00, run_after=2024-06-27T05:19:00+00:00 2024-06-27T05:18:01.030553134Z [2024-06-27T05:18:01.030+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:18:01.030601958Z 2024-06-27T05:18:01.030613214Z 2024-06-27T05:18:01.030621992Z 2024-06-27T05:18:01.030630632Z 2024-06-27T05:18:01.030640159Z [2024-06-27T05:18:01.030+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:18:01.030664821Z [2024-06-27T05:18:01.030+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:18:01.030686498Z [2024-06-27T05:18:01.030+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:18:01.030782389Z [2024-06-27T05:18:01.030+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:18:01.031346618Z [2024-06-27T05:18:01.031+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:18:01.031371017Z 2024-06-27T05:18:01.031380318Z 2024-06-27T05:18:01.031388122Z 2024-06-27T05:18:01.031396030Z 2024-06-27T05:18:01.035861184Z [2024-06-27T05:18:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:18:01.035893350Z [2024-06-27T05:18:01.035+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:18:01.036110903Z [2024-06-27T05:18:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:18:01.036134806Z [2024-06-27T05:18:01.035+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:18:01.036379437Z [2024-06-27T05:18:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:18:01.036440043Z [2024-06-27T05:18:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:18:01.036666173Z [2024-06-27T05:18:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:18:01.036687561Z [2024-06-27T05:18:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:18:01.369175966Z [2024-06-27T05:18:01.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:16:00+00:00 exited with status queued for try_number 1 2024-06-27T05:18:01.369618238Z [2024-06-27T05:18:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:17:00+00:00 exited with status queued for try_number 1 2024-06-27T05:18:01.370161646Z [2024-06-27T05:18:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:17:00+00:00 exited with status queued for try_number 1 2024-06-27T05:18:01.370483299Z [2024-06-27T05:18:01.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:17:00+00:00 exited with status queued for try_number 1 2024-06-27T05:18:01.386981818Z [2024-06-27T05:18:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4976f569-5a3c-4f05-aa10-60393ab79ab3 2024-06-27T05:18:01.391386544Z [2024-06-27T05:18:01.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e65a6fa-a894-4b8e-9327-eebba2730a48 2024-06-27T05:18:01.391827480Z [2024-06-27T05:18:01.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fa49a93-7322-47a2-bf46-38362d6724ac 2024-06-27T05:18:01.392102633Z [2024-06-27T05:18:01.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9725fb20-6b62-485b-9446-e763308a6a20 2024-06-27T05:18:02.271215294Z [2024-06-27T05:18:02.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:18:02.271888057Z [2024-06-27T05:18:02.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:16:00+00:00, run_id=scheduled__2024-06-27T05:16:00+00:00, run_start_date=2024-06-27 05:18:00.961191+00:00, run_end_date=2024-06-27 05:18:02.271139+00:00, run_duration=1.309948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:16:00+00:00, data_interval_end=2024-06-27 05:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:18:02.280817578Z [2024-06-27T05:18:02.278+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:18:00+00:00, run_after=2024-06-27T05:20:00+00:00 2024-06-27T05:18:02.354012108Z [2024-06-27T05:18:02.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:16:00+00:00 exited with status success for try_number 1 2024-06-27T05:18:02.361700917Z [2024-06-27T05:18:02.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:16:00+00:00, map_index=-1, run_start_date=2024-06-27 05:18:01.762817+00:00, run_end_date=2024-06-27 05:18:02.151841+00:00, run_duration=0.389024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:18:01.032285+00:00, queued_by_job_id=2, pid=12749 2024-06-27T05:18:03.424723443Z [2024-06-27T05:18:03.424+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:18:03.426000643Z [2024-06-27T05:18:03.425+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:17:00+00:00, run_id=scheduled__2024-06-27T05:17:00+00:00, run_start_date=2024-06-27 05:18:00.962553+00:00, run_end_date=2024-06-27 05:18:03.424645+00:00, run_duration=2.462092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:17:00+00:00, data_interval_end=2024-06-27 05:18:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:18:03.439332214Z [2024-06-27T05:18:03.439+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:18:00+00:00, run_after=2024-06-27T05:19:00+00:00 2024-06-27T05:18:03.524580489Z [2024-06-27T05:18:03.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:17:00+00:00 exited with status success for try_number 1 2024-06-27T05:18:03.534260542Z [2024-06-27T05:18:03.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:17:00+00:00, map_index=-1, run_start_date=2024-06-27 05:18:01.922684+00:00, run_end_date=2024-06-27 05:18:02.333228+00:00, run_duration=0.410544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:18:01.032285+00:00, queued_by_job_id=2, pid=12750 2024-06-27T05:18:05.741026754Z [2024-06-27T05:18:05.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:18:05.741473903Z [2024-06-27T05:18:05.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:17:00+00:00, run_id=scheduled__2024-06-27T05:17:00+00:00, run_start_date=2024-06-27 05:18:00.964521+00:00, run_end_date=2024-06-27 05:18:05.740726+00:00, run_duration=4.776205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:17:00+00:00, data_interval_end=2024-06-27 05:18:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:18:05.753581617Z [2024-06-27T05:18:05.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:18:00+00:00, run_after=2024-06-27T05:19:00+00:00 2024-06-27T05:18:05.761821681Z [2024-06-27T05:18:05.761+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:18:05.762022529Z [2024-06-27T05:18:05.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:17:00+00:00, run_id=scheduled__2024-06-27T05:17:00+00:00, run_start_date=2024-06-27 05:18:00.963567+00:00, run_end_date=2024-06-27 05:18:05.761629+00:00, run_duration=4.798062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:17:00+00:00, data_interval_end=2024-06-27 05:18:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:18:05.772444538Z [2024-06-27T05:18:05.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:18:00+00:00, run_after=2024-06-27T05:19:00+00:00 2024-06-27T05:18:05.806200738Z [2024-06-27T05:18:05.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:17:00+00:00 exited with status success for try_number 1 2024-06-27T05:18:05.806240457Z [2024-06-27T05:18:05.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:17:00+00:00 exited with status success for try_number 1 2024-06-27T05:18:05.812655756Z [2024-06-27T05:18:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:17:00+00:00, map_index=-1, run_start_date=2024-06-27 05:18:03.225143+00:00, run_end_date=2024-06-27 05:18:05.281988+00:00, run_duration=2.056845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:18:01.032285+00:00, queued_by_job_id=2, pid=12789 2024-06-27T05:18:05.812854592Z [2024-06-27T05:18:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:17:00+00:00, map_index=-1, run_start_date=2024-06-27 05:18:03.348948+00:00, run_end_date=2024-06-27 05:18:05.004226+00:00, run_duration=1.655278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:18:01.032285+00:00, queued_by_job_id=2, pid=12790 2024-06-27T05:19:00.329781546Z [2024-06-27T05:19:00.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:19:00+00:00, run_after=2024-06-27T05:20:00+00:00 2024-06-27T05:19:00.342979005Z [2024-06-27T05:19:00.341+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:19:00.364948507Z [2024-06-27T05:19:00.360+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:19:00+00:00, run_after=2024-06-27T05:20:00+00:00 2024-06-27T05:19:00.443253423Z [2024-06-27T05:19:00.442+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:19:00.443323400Z 2024-06-27T05:19:00.443331937Z 2024-06-27T05:19:00.443339604Z 2024-06-27T05:19:00.443710748Z [2024-06-27T05:19:00.443+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:19:00.444001924Z [2024-06-27T05:19:00.443+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:19:00.444250635Z [2024-06-27T05:19:00.444+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:19:00.445517858Z [2024-06-27T05:19:00.445+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:19:00.445525531Z 2024-06-27T05:19:00.445528702Z 2024-06-27T05:19:00.445531748Z 2024-06-27T05:19:00.449512117Z [2024-06-27T05:19:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:19:00.450052874Z [2024-06-27T05:19:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:19:00.450542857Z [2024-06-27T05:19:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:19:00.450829675Z [2024-06-27T05:19:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:19:00.451104167Z [2024-06-27T05:19:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:19:00.451270984Z [2024-06-27T05:19:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:19:00.772048914Z [2024-06-27T05:19:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:18:00+00:00 exited with status queued for try_number 1 2024-06-27T05:19:00.772077788Z [2024-06-27T05:19:00.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:18:00+00:00 exited with status queued for try_number 1 2024-06-27T05:19:00.772081100Z [2024-06-27T05:19:00.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:18:00+00:00 exited with status queued for try_number 1 2024-06-27T05:19:00.782734392Z [2024-06-27T05:19:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to af92a445-f953-412a-a72f-2974c1683584 2024-06-27T05:19:00.782795044Z [2024-06-27T05:19:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0ab42a8-106a-4f1f-bc75-75aabe8599d1 2024-06-27T05:19:00.782872096Z [2024-06-27T05:19:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ca7e578-9c3f-4076-97bd-0829e0a98be0 2024-06-27T05:19:03.099811984Z [2024-06-27T05:19:03.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:19:03.100567051Z [2024-06-27T05:19:03.099+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:18:00+00:00, run_id=scheduled__2024-06-27T05:18:00+00:00, run_start_date=2024-06-27 05:19:00.374203+00:00, run_end_date=2024-06-27 05:19:03.099764+00:00, run_duration=2.725561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:18:00+00:00, data_interval_end=2024-06-27 05:19:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:19:03.109895043Z [2024-06-27T05:19:03.109+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:19:00+00:00, run_after=2024-06-27T05:20:00+00:00 2024-06-27T05:19:03.205707364Z [2024-06-27T05:19:03.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:18:00+00:00 exited with status success for try_number 1 2024-06-27T05:19:03.214230289Z [2024-06-27T05:19:03.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:18:00+00:00, map_index=-1, run_start_date=2024-06-27 05:19:01.561395+00:00, run_end_date=2024-06-27 05:19:02.143738+00:00, run_duration=0.582343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:19:00.446370+00:00, queued_by_job_id=2, pid=12834 2024-06-27T05:19:05.641386716Z [2024-06-27T05:19:05.637+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:19:05.641433882Z [2024-06-27T05:19:05.638+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:18:00+00:00, run_id=scheduled__2024-06-27T05:18:00+00:00, run_start_date=2024-06-27 05:19:00.378301+00:00, run_end_date=2024-06-27 05:19:05.638005+00:00, run_duration=5.259704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:18:00+00:00, data_interval_end=2024-06-27 05:19:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:19:05.648882509Z [2024-06-27T05:19:05.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:19:00+00:00, run_after=2024-06-27T05:20:00+00:00 2024-06-27T05:19:05.654920019Z [2024-06-27T05:19:05.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:19:05.654937737Z [2024-06-27T05:19:05.653+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:18:00+00:00, run_id=scheduled__2024-06-27T05:18:00+00:00, run_start_date=2024-06-27 05:19:00.379365+00:00, run_end_date=2024-06-27 05:19:05.653837+00:00, run_duration=5.274472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:18:00+00:00, data_interval_end=2024-06-27 05:19:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:19:05.674591638Z [2024-06-27T05:19:05.673+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:19:00+00:00, run_after=2024-06-27T05:20:00+00:00 2024-06-27T05:19:05.710976478Z [2024-06-27T05:19:05.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:18:00+00:00 exited with status success for try_number 1 2024-06-27T05:19:05.711111186Z [2024-06-27T05:19:05.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:18:00+00:00 exited with status success for try_number 1 2024-06-27T05:19:05.719058053Z [2024-06-27T05:19:05.718+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:18:00+00:00, map_index=-1, run_start_date=2024-06-27 05:19:02.646651+00:00, run_end_date=2024-06-27 05:19:04.395450+00:00, run_duration=1.748799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:19:00.446370+00:00, queued_by_job_id=2, pid=12865 2024-06-27T05:19:05.719408810Z [2024-06-27T05:19:05.719+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:18:00+00:00, map_index=-1, run_start_date=2024-06-27 05:19:02.561690+00:00, run_end_date=2024-06-27 05:19:04.672592+00:00, run_duration=2.110902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:19:00.446370+00:00, queued_by_job_id=2, pid=12864 2024-06-27T05:20:00.349787101Z [2024-06-27T05:20:00.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:20:00+00:00, run_after=2024-06-27T05:25:00+00:00 2024-06-27T05:20:00.362406476Z [2024-06-27T05:20:00.361+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:20:00.370710499Z [2024-06-27T05:20:00.370+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:20:00.384300665Z [2024-06-27T05:20:00.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:20:00+00:00, run_after=2024-06-27T05:21:00+00:00 2024-06-27T05:20:00.397153274Z [2024-06-27T05:20:00.396+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:20:00+00:00, run_after=2024-06-27T05:21:00+00:00 2024-06-27T05:20:00.505713187Z [2024-06-27T05:20:00.505+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T05:20:00.505765407Z 2024-06-27T05:20:00.505774785Z 2024-06-27T05:20:00.505782681Z 2024-06-27T05:20:00.505790224Z 2024-06-27T05:20:00.505797365Z 2024-06-27T05:20:00.505997480Z [2024-06-27T05:20:00.505+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:20:00.506076871Z [2024-06-27T05:20:00.505+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:20:00.506090094Z [2024-06-27T05:20:00.505+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:20:00.506178972Z [2024-06-27T05:20:00.505+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:20:00.506192385Z [2024-06-27T05:20:00.505+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:20:00.506681591Z [2024-06-27T05:20:00.506+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:20:00.506699403Z 2024-06-27T05:20:00.506707897Z 2024-06-27T05:20:00.506715871Z 2024-06-27T05:20:00.506722943Z 2024-06-27T05:20:00.506730125Z 2024-06-27T05:20:00.511905196Z [2024-06-27T05:20:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T05:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T05:20:00.511976130Z [2024-06-27T05:20:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T05:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:20:00.512134712Z [2024-06-27T05:20:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:20:00.512215028Z [2024-06-27T05:20:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:20:00.512381166Z [2024-06-27T05:20:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:20:00.512479433Z [2024-06-27T05:20:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:20:00.512690419Z [2024-06-27T05:20:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:20:00.512706400Z [2024-06-27T05:20:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:20:00.512951655Z [2024-06-27T05:20:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:20:00.513077338Z [2024-06-27T05:20:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:20:01.013974025Z [2024-06-27T05:20:01.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status queued for try_number 1 2024-06-27T05:20:01.016045780Z [2024-06-27T05:20:01.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:18:00+00:00 exited with status queued for try_number 1 2024-06-27T05:20:01.016135136Z [2024-06-27T05:20:01.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:19:00+00:00 exited with status queued for try_number 1 2024-06-27T05:20:01.016248624Z [2024-06-27T05:20:01.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:19:00+00:00 exited with status queued for try_number 1 2024-06-27T05:20:01.016308699Z [2024-06-27T05:20:01.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:19:00+00:00 exited with status queued for try_number 1 2024-06-27T05:20:01.027000698Z [2024-06-27T05:20:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1302ad6d-4ecd-439e-9db2-e1d4cdcd2ed2 2024-06-27T05:20:01.027163490Z [2024-06-27T05:20:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e956001-7f89-44aa-b9f9-156fb4b3751b 2024-06-27T05:20:01.027281276Z [2024-06-27T05:20:01.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a5e9ef4-cec4-4ffb-b5f8-9809f17d3c8e 2024-06-27T05:20:01.027418456Z [2024-06-27T05:20:01.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37179a07-0a05-4672-99ff-24d54182d4a9 2024-06-27T05:20:01.027572737Z [2024-06-27T05:20:01.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90f842ee-1d83-45b4-8315-24e5b9c71f7d 2024-06-27T05:20:02.262732857Z [2024-06-27T05:20:02.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:20:02.263187527Z [2024-06-27T05:20:02.262+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:18:00+00:00, run_id=scheduled__2024-06-27T05:18:00+00:00, run_start_date=2024-06-27 05:20:00.411999+00:00, run_end_date=2024-06-27 05:20:02.262829+00:00, run_duration=1.85083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:18:00+00:00, data_interval_end=2024-06-27 05:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:20:02.270868203Z [2024-06-27T05:20:02.270+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:20:00+00:00, run_after=2024-06-27T05:22:00+00:00 2024-06-27T05:20:02.279738606Z [2024-06-27T05:20:02.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:20:02.280079077Z [2024-06-27T05:20:02.279+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:19:00+00:00, run_id=scheduled__2024-06-27T05:19:00+00:00, run_start_date=2024-06-27 05:20:00.413497+00:00, run_end_date=2024-06-27 05:20:02.279803+00:00, run_duration=1.866306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:19:00+00:00, data_interval_end=2024-06-27 05:20:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:20:02.289499621Z [2024-06-27T05:20:02.289+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:20:00+00:00, run_after=2024-06-27T05:21:00+00:00 2024-06-27T05:20:02.337933636Z [2024-06-27T05:20:02.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:19:00+00:00 exited with status success for try_number 1 2024-06-27T05:20:02.345868889Z [2024-06-27T05:20:02.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:19:00+00:00, map_index=-1, run_start_date=2024-06-27 05:20:01.548321+00:00, run_end_date=2024-06-27 05:20:01.976191+00:00, run_duration=0.42787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:20:00.507614+00:00, queued_by_job_id=2, pid=12911 2024-06-27T05:20:03.501448299Z [2024-06-27T05:20:03.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:18:00+00:00 exited with status success for try_number 1 2024-06-27T05:20:03.506864687Z [2024-06-27T05:20:03.506+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:18:00+00:00, map_index=-1, run_start_date=2024-06-27 05:20:01.752833+00:00, run_end_date=2024-06-27 05:20:02.216702+00:00, run_duration=0.463869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:20:00.507614+00:00, queued_by_job_id=2, pid=12912 2024-06-27T05:20:04.400550261Z [2024-06-27T05:20:04.400+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:20:04.400587976Z 2024-06-27T05:20:04.400655845Z [2024-06-27T05:20:04.400+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:20:04.401639435Z [2024-06-27T05:20:04.401+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:20:04.401657259Z 2024-06-27T05:20:04.405195504Z [2024-06-27T05:20:04.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T05:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T05:20:04.405405335Z [2024-06-27T05:20:04.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T05:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:20:04.506741985Z [2024-06-27T05:20:04.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status queued for try_number 1 2024-06-27T05:20:04.506822199Z [2024-06-27T05:20:04.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status success for try_number 1 2024-06-27T05:20:04.516108751Z [2024-06-27T05:20:04.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cba68eb-6ddf-4257-9aef-f3f8f09ddf92 2024-06-27T05:20:04.516189741Z [2024-06-27T05:20:04.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T05:15:00+00:00, map_index=-1, run_start_date=2024-06-27 05:20:03.258735+00:00, run_end_date=2024-06-27 05:20:03.702366+00:00, run_duration=0.443631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:20:00.507614+00:00, queued_by_job_id=2, pid=12963 2024-06-27T05:20:05.708613590Z [2024-06-27T05:20:05.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:20:05.709345060Z [2024-06-27T05:20:05.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:19:00+00:00, run_id=scheduled__2024-06-27T05:19:00+00:00, run_start_date=2024-06-27 05:20:00.414655+00:00, run_end_date=2024-06-27 05:20:05.708723+00:00, run_duration=5.294068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:19:00+00:00, data_interval_end=2024-06-27 05:20:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:20:05.727771873Z [2024-06-27T05:20:05.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:20:00+00:00, run_after=2024-06-27T05:21:00+00:00 2024-06-27T05:20:05.795623718Z [2024-06-27T05:20:05.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:19:00+00:00 exited with status success for try_number 1 2024-06-27T05:20:05.804916430Z [2024-06-27T05:20:05.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:19:00+00:00, map_index=-1, run_start_date=2024-06-27 05:20:03.132572+00:00, run_end_date=2024-06-27 05:20:04.589184+00:00, run_duration=1.456612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:20:00.507614+00:00, queued_by_job_id=2, pid=12962 2024-06-27T05:20:06.843756201Z [2024-06-27T05:20:06.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:20:06.844867212Z [2024-06-27T05:20:06.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:19:00+00:00, run_id=scheduled__2024-06-27T05:19:00+00:00, run_start_date=2024-06-27 05:20:00.415974+00:00, run_end_date=2024-06-27 05:20:06.843751+00:00, run_duration=6.427777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:19:00+00:00, data_interval_end=2024-06-27 05:20:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:20:06.853130222Z [2024-06-27T05:20:06.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:20:00+00:00, run_after=2024-06-27T05:21:00+00:00 2024-06-27T05:20:06.885932891Z [2024-06-27T05:20:06.885+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:20:06.886004530Z 2024-06-27T05:20:06.886119111Z [2024-06-27T05:20:06.885+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:20:06.886764666Z [2024-06-27T05:20:06.886+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:20:06.886774506Z 2024-06-27T05:20:06.889725144Z [2024-06-27T05:20:06.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T05:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T05:20:06.889990859Z [2024-06-27T05:20:06.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T05:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T05:20:06.949225939Z [2024-06-27T05:20:06.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status queued for try_number 1 2024-06-27T05:20:06.949485936Z [2024-06-27T05:20:06.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:19:00+00:00 exited with status success for try_number 1 2024-06-27T05:20:06.949633440Z [2024-06-27T05:20:06.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status success for try_number 1 2024-06-27T05:20:06.958250269Z [2024-06-27T05:20:06.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T05:15:00+00:00, map_index=-1, run_start_date=2024-06-27 05:20:06.224482+00:00, run_end_date=2024-06-27 05:20:06.565227+00:00, run_duration=0.340745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:20:04.402058+00:00, queued_by_job_id=2, pid=13002 2024-06-27T05:20:06.958847593Z [2024-06-27T05:20:06.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to 011a33f4-77d1-4e4f-be2e-60b561bd0f53 2024-06-27T05:20:06.959249866Z [2024-06-27T05:20:06.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:19:00+00:00, map_index=-1, run_start_date=2024-06-27 05:20:03.115914+00:00, run_end_date=2024-06-27 05:20:05.675983+00:00, run_duration=2.560069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:20:00.507614+00:00, queued_by_job_id=2, pid=12961 2024-06-27T05:20:07.228684344Z [2024-06-27T05:20:07.228+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T05:20:09.388105544Z [2024-06-27T05:20:09.387+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:20:09.388286361Z 2024-06-27T05:20:09.388432824Z [2024-06-27T05:20:09.387+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:20:09.388494090Z [2024-06-27T05:20:09.388+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:20:09.388504663Z 2024-06-27T05:20:09.392723456Z [2024-06-27T05:20:09.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T05:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:20:09.392840876Z [2024-06-27T05:20:09.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T05:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:20:09.461908463Z [2024-06-27T05:20:09.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status queued for try_number 1 2024-06-27T05:20:09.461940656Z [2024-06-27T05:20:09.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status success for try_number 1 2024-06-27T05:20:09.467112517Z [2024-06-27T05:20:09.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9915462-f100-473d-a34b-42a3c96b3021 2024-06-27T05:20:09.467250906Z [2024-06-27T05:20:09.467+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T05:15:00+00:00, map_index=0, run_start_date=2024-06-27 05:20:08.680394+00:00, run_end_date=2024-06-27 05:20:09.100114+00:00, run_duration=0.41972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:20:06.887166+00:00, queued_by_job_id=2, pid=13014 2024-06-27T05:20:12.345056448Z [2024-06-27T05:20:12.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:20:12.345580556Z [2024-06-27T05:20:12.345+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:15:00+00:00, run_id=scheduled__2024-06-27T05:15:00+00:00, run_start_date=2024-06-27 05:20:00.410587+00:00, run_end_date=2024-06-27 05:20:12.345178+00:00, run_duration=11.934591, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:15:00+00:00, data_interval_end=2024-06-27 05:20:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T05:20:12.351272656Z [2024-06-27T05:20:12.351+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:20:00+00:00, run_after=2024-06-27T05:25:00+00:00 2024-06-27T05:20:12.377844503Z [2024-06-27T05:20:12.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:15:00+00:00 exited with status success for try_number 1 2024-06-27T05:20:12.382608158Z [2024-06-27T05:20:12.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T05:15:00+00:00, map_index=-1, run_start_date=2024-06-27 05:20:10.983988+00:00, run_end_date=2024-06-27 05:20:11.342959+00:00, run_duration=0.358971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:20:09.388621+00:00, queued_by_job_id=2, pid=13026 2024-06-27T05:20:37.142660121Z [2024-06-27T05:20:37.141+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:20:37.142691675Z 2024-06-27T05:20:37.142736311Z [2024-06-27T05:20:37.142+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-06-27T05:20:37.143916921Z [2024-06-27T05:20:37.143+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:20:37.143928348Z 2024-06-27T05:20:37.147612685Z [2024-06-27T05:20:37.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240627052036_161620', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:20:37.147784593Z [2024-06-27T05:20:37.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240627052036_161620', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-06-27T05:20:37.214433326Z [2024-06-27T05:20:37.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240627052036_161620 exited with status queued for try_number 1 2024-06-27T05:20:37.221081818Z [2024-06-27T05:20:37.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0133f4a8-d4e8-4b89-a022-e0eb743da162 2024-06-27T05:20:38.347717593Z [2024-06-27T05:20:38.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:20:38.348007252Z [2024-06-27T05:20:38.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-06-27 05:20:36.926598+00:00, run_id=vdu_alarm_20240627052036_161620, run_start_date=2024-06-27 05:20:37.087568+00:00, run_end_date=2024-06-27 05:20:38.347606+00:00, run_duration=1.260038, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-27 05:20:36.926598+00:00, data_interval_end=2024-06-27 05:20:36.926598+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-06-27T05:20:38.351153329Z [2024-06-27T05:20:38.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-06-27T05:20:38.387450695Z [2024-06-27T05:20:38.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240627052036_161620 exited with status success for try_number 1 2024-06-27T05:20:38.393168402Z [2024-06-27T05:20:38.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240627052036_161620, map_index=-1, run_start_date=2024-06-27 05:20:37.790230+00:00, run_end_date=2024-06-27 05:20:38.179064+00:00, run_duration=0.388834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:20:37.144443+00:00, queued_by_job_id=2, pid=13041 2024-06-27T05:21:00.345025917Z [2024-06-27T05:21:00.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:21:00+00:00, run_after=2024-06-27T05:22:00+00:00 2024-06-27T05:21:00.360666446Z [2024-06-27T05:21:00.360+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:21:00+00:00, run_after=2024-06-27T05:22:00+00:00 2024-06-27T05:21:00.367346191Z [2024-06-27T05:21:00.367+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:21:00.449733792Z [2024-06-27T05:21:00.449+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:21:00.449759028Z 2024-06-27T05:21:00.449763135Z 2024-06-27T05:21:00.449766786Z 2024-06-27T05:21:00.450025999Z [2024-06-27T05:21:00.449+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:21:00.450218091Z [2024-06-27T05:21:00.450+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:21:00.450417860Z [2024-06-27T05:21:00.450+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:21:00.451257280Z [2024-06-27T05:21:00.451+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:21:00.451268583Z 2024-06-27T05:21:00.451272114Z 2024-06-27T05:21:00.451275263Z 2024-06-27T05:21:00.454484657Z [2024-06-27T05:21:00.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:21:00.454798290Z [2024-06-27T05:21:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:21:00.455113705Z [2024-06-27T05:21:00.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:21:00.455320995Z [2024-06-27T05:21:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:21:00.455678346Z [2024-06-27T05:21:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:21:00.456027050Z [2024-06-27T05:21:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:21:00.663570773Z [2024-06-27T05:21:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status queued for try_number 1 2024-06-27T05:21:00.663675726Z [2024-06-27T05:21:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status queued for try_number 1 2024-06-27T05:21:00.663818391Z [2024-06-27T05:21:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status queued for try_number 1 2024-06-27T05:21:00.673196227Z [2024-06-27T05:21:00.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to a89a7f9b-a9dc-4892-b2e2-f57c8b16937a 2024-06-27T05:21:00.673361612Z [2024-06-27T05:21:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b352652-1aa9-4336-bd3e-6e01ebb32264 2024-06-27T05:21:00.673536749Z [2024-06-27T05:21:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 711edb1f-fb88-4d30-8904-2fdcde3436c8 2024-06-27T05:21:02.611468233Z [2024-06-27T05:21:02.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:21:02.611577268Z [2024-06-27T05:21:02.611+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:20:00+00:00, run_id=scheduled__2024-06-27T05:20:00+00:00, run_start_date=2024-06-27 05:21:00.381512+00:00, run_end_date=2024-06-27 05:21:02.611259+00:00, run_duration=2.229747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:20:00+00:00, data_interval_end=2024-06-27 05:21:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:21:02.621509492Z [2024-06-27T05:21:02.621+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:21:00+00:00, run_after=2024-06-27T05:22:00+00:00 2024-06-27T05:21:02.682616236Z [2024-06-27T05:21:02.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status success for try_number 1 2024-06-27T05:21:02.688498672Z [2024-06-27T05:21:02.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:20:00+00:00, map_index=-1, run_start_date=2024-06-27 05:21:01.467446+00:00, run_end_date=2024-06-27 05:21:01.842185+00:00, run_duration=0.374739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:21:00.451962+00:00, queued_by_job_id=2, pid=13063 2024-06-27T05:21:04.896603332Z [2024-06-27T05:21:04.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:21:04.896672337Z [2024-06-27T05:21:04.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:20:00+00:00, run_id=scheduled__2024-06-27T05:20:00+00:00, run_start_date=2024-06-27 05:21:00.382938+00:00, run_end_date=2024-06-27 05:21:04.896368+00:00, run_duration=4.51343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:20:00+00:00, data_interval_end=2024-06-27 05:21:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:21:04.916914190Z [2024-06-27T05:21:04.916+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:21:00+00:00, run_after=2024-06-27T05:22:00+00:00 2024-06-27T05:21:04.930578255Z [2024-06-27T05:21:04.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:21:04.931007082Z [2024-06-27T05:21:04.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:20:00+00:00, run_id=scheduled__2024-06-27T05:20:00+00:00, run_start_date=2024-06-27 05:21:00.384201+00:00, run_end_date=2024-06-27 05:21:04.930387+00:00, run_duration=4.546186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:20:00+00:00, data_interval_end=2024-06-27 05:21:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:21:04.952575684Z [2024-06-27T05:21:04.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:21:00+00:00, run_after=2024-06-27T05:22:00+00:00 2024-06-27T05:21:04.998832996Z [2024-06-27T05:21:04.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status success for try_number 1 2024-06-27T05:21:04.999157701Z [2024-06-27T05:21:04.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status success for try_number 1 2024-06-27T05:21:05.013459429Z [2024-06-27T05:21:05.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:20:00+00:00, map_index=-1, run_start_date=2024-06-27 05:21:02.414728+00:00, run_end_date=2024-06-27 05:21:03.943544+00:00, run_duration=1.528816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:21:00.451962+00:00, queued_by_job_id=2, pid=13093 2024-06-27T05:21:05.013729849Z [2024-06-27T05:21:05.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:20:00+00:00, map_index=-1, run_start_date=2024-06-27 05:21:02.548329+00:00, run_end_date=2024-06-27 05:21:04.329005+00:00, run_duration=1.780676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:21:00.451962+00:00, queued_by_job_id=2, pid=13094 2024-06-27T05:22:00.752424350Z [2024-06-27T05:22:00.752+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:22:00+00:00, run_after=2024-06-27T05:23:00+00:00 2024-06-27T05:22:00.761215874Z [2024-06-27T05:22:00.760+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:22:00.773514301Z [2024-06-27T05:22:00.772+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:22:00+00:00, run_after=2024-06-27T05:23:00+00:00 2024-06-27T05:22:00.782502555Z [2024-06-27T05:22:00.781+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:22:00.897454398Z [2024-06-27T05:22:00.897+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:22:00.897483182Z 2024-06-27T05:22:00.897487121Z 2024-06-27T05:22:00.897490370Z 2024-06-27T05:22:00.897493412Z 2024-06-27T05:22:00.897867303Z [2024-06-27T05:22:00.897+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:22:00.898098038Z [2024-06-27T05:22:00.897+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:22:00.898283353Z [2024-06-27T05:22:00.898+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:22:00.898489218Z [2024-06-27T05:22:00.898+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:22:00.899187204Z [2024-06-27T05:22:00.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:22:00.899199333Z 2024-06-27T05:22:00.899203059Z 2024-06-27T05:22:00.899206510Z 2024-06-27T05:22:00.899209751Z 2024-06-27T05:22:00.904117729Z [2024-06-27T05:22:00.903+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:22:00.904377461Z [2024-06-27T05:22:00.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:22:00.904859479Z [2024-06-27T05:22:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:22:00.905100518Z [2024-06-27T05:22:00.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:22:00.905404570Z [2024-06-27T05:22:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:22:00.905611984Z [2024-06-27T05:22:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:22:00.905895960Z [2024-06-27T05:22:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:22:00.906914339Z [2024-06-27T05:22:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:22:01.397073978Z [2024-06-27T05:22:01.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status queued for try_number 1 2024-06-27T05:22:01.400161416Z [2024-06-27T05:22:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:21:00+00:00 exited with status queued for try_number 1 2024-06-27T05:22:01.400422456Z [2024-06-27T05:22:01.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:21:00+00:00 exited with status queued for try_number 1 2024-06-27T05:22:01.400632003Z [2024-06-27T05:22:01.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:21:00+00:00 exited with status queued for try_number 1 2024-06-27T05:22:01.414189129Z [2024-06-27T05:22:01.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05e345d9-4220-46a0-a7b3-016f25ce8016 2024-06-27T05:22:01.414912183Z [2024-06-27T05:22:01.414+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98d3c56c-2722-4dd0-949a-18e8a8c9c7c3 2024-06-27T05:22:01.415176729Z [2024-06-27T05:22:01.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to 956b49f9-6914-40c2-8cab-d92650d1adfc 2024-06-27T05:22:01.415423963Z [2024-06-27T05:22:01.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f150769-88a4-4052-8e71-11bcdd572f1d 2024-06-27T05:22:03.010371600Z [2024-06-27T05:22:03.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:22:03.010691446Z [2024-06-27T05:22:03.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:21:00+00:00, run_id=scheduled__2024-06-27T05:21:00+00:00, run_start_date=2024-06-27 05:22:00.798478+00:00, run_end_date=2024-06-27 05:22:03.010379+00:00, run_duration=2.211901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:21:00+00:00, data_interval_end=2024-06-27 05:22:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:22:03.021888620Z [2024-06-27T05:22:03.021+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:22:00+00:00, run_after=2024-06-27T05:23:00+00:00 2024-06-27T05:22:03.029451639Z [2024-06-27T05:22:03.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:22:03.029795532Z [2024-06-27T05:22:03.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:20:00+00:00, run_id=scheduled__2024-06-27T05:20:00+00:00, run_start_date=2024-06-27 05:22:00.796955+00:00, run_end_date=2024-06-27 05:22:03.029439+00:00, run_duration=2.232484, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:20:00+00:00, data_interval_end=2024-06-27 05:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:22:03.051908864Z [2024-06-27T05:22:03.051+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:22:00+00:00, run_after=2024-06-27T05:24:00+00:00 2024-06-27T05:22:03.132896808Z [2024-06-27T05:22:03.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status success for try_number 1 2024-06-27T05:22:03.133044034Z [2024-06-27T05:22:03.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:21:00+00:00 exited with status success for try_number 1 2024-06-27T05:22:03.141418095Z [2024-06-27T05:22:03.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:20:00+00:00, map_index=-1, run_start_date=2024-06-27 05:22:01.741901+00:00, run_end_date=2024-06-27 05:22:02.130851+00:00, run_duration=0.38895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:22:00.900422+00:00, queued_by_job_id=2, pid=13131 2024-06-27T05:22:03.142291532Z [2024-06-27T05:22:03.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:21:00+00:00, map_index=-1, run_start_date=2024-06-27 05:22:02.115824+00:00, run_end_date=2024-06-27 05:22:02.608645+00:00, run_duration=0.492821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:22:00.900422+00:00, queued_by_job_id=2, pid=13150 2024-06-27T05:22:05.320785954Z [2024-06-27T05:22:05.320+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:22:05.321030173Z [2024-06-27T05:22:05.320+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:21:00+00:00, run_id=scheduled__2024-06-27T05:21:00+00:00, run_start_date=2024-06-27 05:22:00.800047+00:00, run_end_date=2024-06-27 05:22:05.320639+00:00, run_duration=4.520592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:21:00+00:00, data_interval_end=2024-06-27 05:22:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:22:05.329177207Z [2024-06-27T05:22:05.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:22:00+00:00, run_after=2024-06-27T05:23:00+00:00 2024-06-27T05:22:05.335254446Z [2024-06-27T05:22:05.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:22:05.335429034Z [2024-06-27T05:22:05.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:21:00+00:00, run_id=scheduled__2024-06-27T05:21:00+00:00, run_start_date=2024-06-27 05:22:00.801540+00:00, run_end_date=2024-06-27 05:22:05.335191+00:00, run_duration=4.533651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:21:00+00:00, data_interval_end=2024-06-27 05:22:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:22:05.343912457Z [2024-06-27T05:22:05.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:22:00+00:00, run_after=2024-06-27T05:23:00+00:00 2024-06-27T05:22:05.379494089Z [2024-06-27T05:22:05.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:21:00+00:00 exited with status success for try_number 1 2024-06-27T05:22:05.379828783Z [2024-06-27T05:22:05.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:21:00+00:00 exited with status success for try_number 1 2024-06-27T05:22:05.386891308Z [2024-06-27T05:22:05.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:21:00+00:00, map_index=-1, run_start_date=2024-06-27 05:22:03.091596+00:00, run_end_date=2024-06-27 05:22:04.817095+00:00, run_duration=1.725499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:22:00.900422+00:00, queued_by_job_id=2, pid=13180 2024-06-27T05:22:05.387511918Z [2024-06-27T05:22:05.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:21:00+00:00, map_index=-1, run_start_date=2024-06-27 05:22:03.178628+00:00, run_end_date=2024-06-27 05:22:04.548546+00:00, run_duration=1.369918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:22:00.900422+00:00, queued_by_job_id=2, pid=13181 2024-06-27T05:23:00.619821487Z [2024-06-27T05:23:00.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:23:00+00:00, run_after=2024-06-27T05:24:00+00:00 2024-06-27T05:23:00.639159014Z [2024-06-27T05:23:00.638+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:23:00+00:00, run_after=2024-06-27T05:24:00+00:00 2024-06-27T05:23:00.651688664Z [2024-06-27T05:23:00.650+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:23:00.767962887Z [2024-06-27T05:23:00.767+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:23:00.768004790Z 2024-06-27T05:23:00.768014323Z 2024-06-27T05:23:00.768022391Z 2024-06-27T05:23:00.768549462Z [2024-06-27T05:23:00.768+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:23:00.768900077Z [2024-06-27T05:23:00.768+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:23:00.769115382Z [2024-06-27T05:23:00.768+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:23:00.770101290Z [2024-06-27T05:23:00.769+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:23:00.770121705Z 2024-06-27T05:23:00.770135894Z 2024-06-27T05:23:00.770173774Z 2024-06-27T05:23:00.776391144Z [2024-06-27T05:23:00.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:23:00.776685619Z [2024-06-27T05:23:00.776+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:23:00.779152696Z [2024-06-27T05:23:00.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:23:00.779183657Z [2024-06-27T05:23:00.778+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:23:00.779192919Z [2024-06-27T05:23:00.778+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:23:00.779269038Z [2024-06-27T05:23:00.779+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:23:01.210540181Z [2024-06-27T05:23:01.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:22:00+00:00 exited with status queued for try_number 1 2024-06-27T05:23:01.210759825Z [2024-06-27T05:23:01.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:22:00+00:00 exited with status queued for try_number 1 2024-06-27T05:23:01.210913260Z [2024-06-27T05:23:01.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:22:00+00:00 exited with status queued for try_number 1 2024-06-27T05:23:01.219403687Z [2024-06-27T05:23:01.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae74d4b9-6d21-4b46-86b1-4055a7e41834 2024-06-27T05:23:01.219934877Z [2024-06-27T05:23:01.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to c575e213-a469-4555-808f-78757240c132 2024-06-27T05:23:01.220243237Z [2024-06-27T05:23:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f518c3a-dd68-489a-b127-16b9b0dd4c76 2024-06-27T05:23:02.373815886Z [2024-06-27T05:23:02.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:23:02.374782067Z [2024-06-27T05:23:02.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:22:00+00:00, run_id=scheduled__2024-06-27T05:22:00+00:00, run_start_date=2024-06-27 05:23:00.667005+00:00, run_end_date=2024-06-27 05:23:02.374061+00:00, run_duration=1.707056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:22:00+00:00, data_interval_end=2024-06-27 05:23:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:23:02.392865042Z [2024-06-27T05:23:02.391+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:23:00+00:00, run_after=2024-06-27T05:24:00+00:00 2024-06-27T05:23:02.443324601Z [2024-06-27T05:23:02.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:22:00+00:00 exited with status success for try_number 1 2024-06-27T05:23:02.457381413Z [2024-06-27T05:23:02.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:22:00+00:00, map_index=-1, run_start_date=2024-06-27 05:23:01.661599+00:00, run_end_date=2024-06-27 05:23:02.118038+00:00, run_duration=0.456439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:23:00.771157+00:00, queued_by_job_id=2, pid=13225 2024-06-27T05:23:05.624291105Z [2024-06-27T05:23:05.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:23:05.624629468Z [2024-06-27T05:23:05.624+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:22:00+00:00, run_id=scheduled__2024-06-27T05:22:00+00:00, run_start_date=2024-06-27 05:23:00.669867+00:00, run_end_date=2024-06-27 05:23:05.624268+00:00, run_duration=4.954401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:22:00+00:00, data_interval_end=2024-06-27 05:23:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:23:05.632989989Z [2024-06-27T05:23:05.632+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:23:00+00:00, run_after=2024-06-27T05:24:00+00:00 2024-06-27T05:23:05.703422271Z [2024-06-27T05:23:05.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:22:00+00:00 exited with status success for try_number 1 2024-06-27T05:23:05.712789081Z [2024-06-27T05:23:05.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:22:00+00:00, map_index=-1, run_start_date=2024-06-27 05:23:03.058969+00:00, run_end_date=2024-06-27 05:23:04.885478+00:00, run_duration=1.826509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:23:00.771157+00:00, queued_by_job_id=2, pid=13255 2024-06-27T05:23:06.786475111Z [2024-06-27T05:23:06.785+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:23:06.787044359Z [2024-06-27T05:23:06.786+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:22:00+00:00, run_id=scheduled__2024-06-27T05:22:00+00:00, run_start_date=2024-06-27 05:23:00.672320+00:00, run_end_date=2024-06-27 05:23:06.786504+00:00, run_duration=6.114184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:22:00+00:00, data_interval_end=2024-06-27 05:23:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:23:06.802747848Z [2024-06-27T05:23:06.802+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:23:00+00:00, run_after=2024-06-27T05:24:00+00:00 2024-06-27T05:23:06.836954439Z [2024-06-27T05:23:06.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:22:00+00:00 exited with status success for try_number 1 2024-06-27T05:23:06.844166487Z [2024-06-27T05:23:06.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:22:00+00:00, map_index=-1, run_start_date=2024-06-27 05:23:03.105400+00:00, run_end_date=2024-06-27 05:23:05.609046+00:00, run_duration=2.503646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:23:00.771157+00:00, queued_by_job_id=2, pid=13256 2024-06-27T05:24:00.630393011Z [2024-06-27T05:24:00.629+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:24:00+00:00, run_after=2024-06-27T05:25:00+00:00 2024-06-27T05:24:00.642054603Z [2024-06-27T05:24:00.641+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:24:00.657262846Z [2024-06-27T05:24:00.656+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:24:00+00:00, run_after=2024-06-27T05:25:00+00:00 2024-06-27T05:24:00.666431763Z [2024-06-27T05:24:00.665+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:24:00.776113792Z [2024-06-27T05:24:00.775+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:24:00.776192398Z 2024-06-27T05:24:00.776204811Z 2024-06-27T05:24:00.776213762Z 2024-06-27T05:24:00.776222479Z 2024-06-27T05:24:00.776746570Z [2024-06-27T05:24:00.776+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:24:00.777338388Z [2024-06-27T05:24:00.776+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:24:00.777785949Z [2024-06-27T05:24:00.777+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:24:00.779302477Z [2024-06-27T05:24:00.777+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:24:00.780427038Z [2024-06-27T05:24:00.779+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:24:00.780475425Z 2024-06-27T05:24:00.780486003Z 2024-06-27T05:24:00.780494598Z 2024-06-27T05:24:00.780502999Z 2024-06-27T05:24:00.789492360Z [2024-06-27T05:24:00.788+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:24:00.789852923Z [2024-06-27T05:24:00.789+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:24:00.790319968Z [2024-06-27T05:24:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:24:00.790693817Z [2024-06-27T05:24:00.790+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:24:00.791181252Z [2024-06-27T05:24:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:24:00.791487007Z [2024-06-27T05:24:00.791+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:24:00.791966432Z [2024-06-27T05:24:00.791+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:24:00.792338093Z [2024-06-27T05:24:00.791+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:24:01.097289063Z [2024-06-27T05:24:01.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:22:00+00:00 exited with status queued for try_number 1 2024-06-27T05:24:01.097314324Z [2024-06-27T05:24:01.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:23:00+00:00 exited with status queued for try_number 1 2024-06-27T05:24:01.097317781Z [2024-06-27T05:24:01.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:23:00+00:00 exited with status queued for try_number 1 2024-06-27T05:24:01.097332981Z [2024-06-27T05:24:01.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:23:00+00:00 exited with status queued for try_number 1 2024-06-27T05:24:01.113250990Z [2024-06-27T05:24:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfc383b2-8d3a-448e-867d-5ce3c1614a3a 2024-06-27T05:24:01.113272723Z [2024-06-27T05:24:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to 495413ee-0eaf-49a7-87be-debf8c55f717 2024-06-27T05:24:01.113276369Z [2024-06-27T05:24:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb32f70a-2167-49c5-85ed-c8801385aad6 2024-06-27T05:24:01.113279529Z [2024-06-27T05:24:01.112+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a700f6f-b81f-4622-8106-f74f7d977985 2024-06-27T05:24:02.313877490Z [2024-06-27T05:24:02.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:24:02.313906522Z [2024-06-27T05:24:02.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:22:00+00:00, run_id=scheduled__2024-06-27T05:22:00+00:00, run_start_date=2024-06-27 05:24:00.683321+00:00, run_end_date=2024-06-27 05:24:02.313500+00:00, run_duration=1.630179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:22:00+00:00, data_interval_end=2024-06-27 05:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:24:02.321923739Z [2024-06-27T05:24:02.321+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:24:00+00:00, run_after=2024-06-27T05:26:00+00:00 2024-06-27T05:24:02.329926795Z [2024-06-27T05:24:02.329+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:24:02.330061977Z [2024-06-27T05:24:02.329+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:23:00+00:00, run_id=scheduled__2024-06-27T05:23:00+00:00, run_start_date=2024-06-27 05:24:00.684889+00:00, run_end_date=2024-06-27 05:24:02.329837+00:00, run_duration=1.644948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:23:00+00:00, data_interval_end=2024-06-27 05:24:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:24:02.341200240Z [2024-06-27T05:24:02.340+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:24:00+00:00, run_after=2024-06-27T05:25:00+00:00 2024-06-27T05:24:02.391820940Z [2024-06-27T05:24:02.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:22:00+00:00 exited with status success for try_number 1 2024-06-27T05:24:02.391904616Z [2024-06-27T05:24:02.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:23:00+00:00 exited with status success for try_number 1 2024-06-27T05:24:02.400579157Z [2024-06-27T05:24:02.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:23:00+00:00, map_index=-1, run_start_date=2024-06-27 05:24:01.753026+00:00, run_end_date=2024-06-27 05:24:02.213655+00:00, run_duration=0.460629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=613, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:24:00.782651+00:00, queued_by_job_id=2, pid=13302 2024-06-27T05:24:02.400653410Z [2024-06-27T05:24:02.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:22:00+00:00, map_index=-1, run_start_date=2024-06-27 05:24:01.671447+00:00, run_end_date=2024-06-27 05:24:02.123423+00:00, run_duration=0.451976, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:24:00.782651+00:00, queued_by_job_id=2, pid=13301 2024-06-27T05:24:04.706985783Z [2024-06-27T05:24:04.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:24:04.707321109Z [2024-06-27T05:24:04.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:23:00+00:00, run_id=scheduled__2024-06-27T05:23:00+00:00, run_start_date=2024-06-27 05:24:00.686028+00:00, run_end_date=2024-06-27 05:24:04.706860+00:00, run_duration=4.020832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:23:00+00:00, data_interval_end=2024-06-27 05:24:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:24:04.718369765Z [2024-06-27T05:24:04.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:24:00+00:00, run_after=2024-06-27T05:25:00+00:00 2024-06-27T05:24:04.726880777Z [2024-06-27T05:24:04.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:24:04.727333215Z [2024-06-27T05:24:04.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:23:00+00:00, run_id=scheduled__2024-06-27T05:23:00+00:00, run_start_date=2024-06-27 05:24:00.687097+00:00, run_end_date=2024-06-27 05:24:04.726831+00:00, run_duration=4.039734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:23:00+00:00, data_interval_end=2024-06-27 05:24:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:24:04.742279710Z [2024-06-27T05:24:04.741+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:24:00+00:00, run_after=2024-06-27T05:25:00+00:00 2024-06-27T05:24:04.787948497Z [2024-06-27T05:24:04.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:23:00+00:00 exited with status success for try_number 1 2024-06-27T05:24:04.788221264Z [2024-06-27T05:24:04.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:23:00+00:00 exited with status success for try_number 1 2024-06-27T05:24:04.798192825Z [2024-06-27T05:24:04.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:23:00+00:00, map_index=-1, run_start_date=2024-06-27 05:24:03.065924+00:00, run_end_date=2024-06-27 05:24:04.501258+00:00, run_duration=1.435334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=615, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:24:00.782651+00:00, queued_by_job_id=2, pid=13342 2024-06-27T05:24:04.798630231Z [2024-06-27T05:24:04.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:23:00+00:00, map_index=-1, run_start_date=2024-06-27 05:24:02.904146+00:00, run_end_date=2024-06-27 05:24:04.505575+00:00, run_duration=1.601429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=614, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:24:00.782651+00:00, queued_by_job_id=2, pid=13341 2024-06-27T05:25:00.652357978Z [2024-06-27T05:25:00.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:25:00+00:00, run_after=2024-06-27T05:26:00+00:00 2024-06-27T05:25:00.669533539Z [2024-06-27T05:25:00.668+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:25:00+00:00, run_after=2024-06-27T05:30:00+00:00 2024-06-27T05:25:00.690281498Z [2024-06-27T05:25:00.689+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:25:00+00:00, run_after=2024-06-27T05:26:00+00:00 2024-06-27T05:25:00.699318853Z [2024-06-27T05:25:00.698+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:25:00.832047740Z [2024-06-27T05:25:00.831+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:25:00.832128018Z 2024-06-27T05:25:00.832134757Z 2024-06-27T05:25:00.832139447Z 2024-06-27T05:25:00.832144061Z 2024-06-27T05:25:00.832402147Z [2024-06-27T05:25:00.831+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:25:00.832698116Z [2024-06-27T05:25:00.832+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:25:00.833008224Z [2024-06-27T05:25:00.832+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:25:00.833286897Z [2024-06-27T05:25:00.833+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:25:00.834305112Z [2024-06-27T05:25:00.833+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:25:00.834320719Z 2024-06-27T05:25:00.834325697Z 2024-06-27T05:25:00.834329900Z 2024-06-27T05:25:00.834334215Z 2024-06-27T05:25:00.840656572Z [2024-06-27T05:25:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T05:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T05:25:00.840918286Z [2024-06-27T05:25:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T05:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:25:00.841348726Z [2024-06-27T05:25:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:25:00.841545861Z [2024-06-27T05:25:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:25:00.841867877Z [2024-06-27T05:25:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:25:00.842074169Z [2024-06-27T05:25:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:25:00.842370266Z [2024-06-27T05:25:00.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:25:00.842559242Z [2024-06-27T05:25:00.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:25:01.403775143Z [2024-06-27T05:25:01.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status queued for try_number 1 2024-06-27T05:25:01.404788827Z [2024-06-27T05:25:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:24:00+00:00 exited with status queued for try_number 1 2024-06-27T05:25:01.405294397Z [2024-06-27T05:25:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:24:00+00:00 exited with status queued for try_number 1 2024-06-27T05:25:01.405820685Z [2024-06-27T05:25:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:24:00+00:00 exited with status queued for try_number 1 2024-06-27T05:25:01.435659416Z [2024-06-27T05:25:01.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to 414a6fa2-dcda-4cf1-b64c-77b7fe7c5469 2024-06-27T05:25:01.436373547Z [2024-06-27T05:25:01.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a91a68a-0faf-409f-9302-982d1e58aa08 2024-06-27T05:25:01.436548368Z [2024-06-27T05:25:01.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79c8238a-c650-4d43-bf9a-bb7bba23fd50 2024-06-27T05:25:01.437372226Z [2024-06-27T05:25:01.437+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb736c2f-7f5e-48c7-8bdb-4bdb37daeae1 2024-06-27T05:25:02.632926288Z [2024-06-27T05:25:02.632+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:25:02.633378879Z [2024-06-27T05:25:02.633+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:24:00+00:00, run_id=scheduled__2024-06-27T05:24:00+00:00, run_start_date=2024-06-27 05:25:00.723068+00:00, run_end_date=2024-06-27 05:25:02.633023+00:00, run_duration=1.909955, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:24:00+00:00, data_interval_end=2024-06-27 05:25:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:25:02.643255306Z [2024-06-27T05:25:02.642+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:25:00+00:00, run_after=2024-06-27T05:26:00+00:00 2024-06-27T05:25:02.694471268Z [2024-06-27T05:25:02.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:24:00+00:00 exited with status success for try_number 1 2024-06-27T05:25:02.700814370Z [2024-06-27T05:25:02.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:24:00+00:00, map_index=-1, run_start_date=2024-06-27 05:25:01.873260+00:00, run_end_date=2024-06-27 05:25:02.365396+00:00, run_duration=0.492136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=616, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:25:00.836364+00:00, queued_by_job_id=2, pid=13387 2024-06-27T05:25:03.982457624Z [2024-06-27T05:25:03.981+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:25:03.982488124Z 2024-06-27T05:25:03.982499612Z [2024-06-27T05:25:03.982+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:25:03.983003364Z [2024-06-27T05:25:03.982+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:25:03.983024012Z 2024-06-27T05:25:03.986712651Z [2024-06-27T05:25:03.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T05:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T05:25:03.986825842Z [2024-06-27T05:25:03.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T05:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:25:04.094362051Z [2024-06-27T05:25:04.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status queued for try_number 1 2024-06-27T05:25:04.094509783Z [2024-06-27T05:25:04.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status success for try_number 1 2024-06-27T05:25:04.106764586Z [2024-06-27T05:25:04.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58cd72a6-1206-4fe7-aa71-53636f43e7a3 2024-06-27T05:25:04.107169933Z [2024-06-27T05:25:04.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T05:20:00+00:00, map_index=-1, run_start_date=2024-06-27 05:25:03.385062+00:00, run_end_date=2024-06-27 05:25:03.815442+00:00, run_duration=0.43038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=619, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:25:00.836364+00:00, queued_by_job_id=2, pid=13428 2024-06-27T05:25:04.726825201Z [2024-06-27T05:25:04.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:24:00+00:00 exited with status success for try_number 1 2024-06-27T05:25:04.733527731Z [2024-06-27T05:25:04.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:24:00+00:00, map_index=-1, run_start_date=2024-06-27 05:25:03.182805+00:00, run_end_date=2024-06-27 05:25:04.508988+00:00, run_duration=1.326183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=617, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:25:00.836364+00:00, queued_by_job_id=2, pid=13422 2024-06-27T05:25:05.819223110Z [2024-06-27T05:25:05.818+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:25:05.819641038Z [2024-06-27T05:25:05.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:24:00+00:00, run_id=scheduled__2024-06-27T05:24:00+00:00, run_start_date=2024-06-27 05:25:00.724516+00:00, run_end_date=2024-06-27 05:25:05.819142+00:00, run_duration=5.094626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:24:00+00:00, data_interval_end=2024-06-27 05:25:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:25:05.829981318Z [2024-06-27T05:25:05.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:25:00+00:00, run_after=2024-06-27T05:26:00+00:00 2024-06-27T05:25:05.836964044Z [2024-06-27T05:25:05.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:25:05.837715056Z [2024-06-27T05:25:05.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:24:00+00:00, run_id=scheduled__2024-06-27T05:24:00+00:00, run_start_date=2024-06-27 05:25:00.725841+00:00, run_end_date=2024-06-27 05:25:05.837360+00:00, run_duration=5.111519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:24:00+00:00, data_interval_end=2024-06-27 05:25:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:25:05.847401551Z [2024-06-27T05:25:05.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:25:00+00:00, run_after=2024-06-27T05:26:00+00:00 2024-06-27T05:25:05.902041813Z [2024-06-27T05:25:05.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:24:00+00:00 exited with status success for try_number 1 2024-06-27T05:25:05.911613557Z [2024-06-27T05:25:05.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:24:00+00:00, map_index=-1, run_start_date=2024-06-27 05:25:03.403814+00:00, run_end_date=2024-06-27 05:25:05.302096+00:00, run_duration=1.898282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=618, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:25:00.836364+00:00, queued_by_job_id=2, pid=13429 2024-06-27T05:25:07.008478257Z [2024-06-27T05:25:07.007+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:25:07.008526685Z 2024-06-27T05:25:07.008684337Z [2024-06-27T05:25:07.008+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:25:07.009737136Z [2024-06-27T05:25:07.009+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:25:07.009762858Z 2024-06-27T05:25:07.013034571Z [2024-06-27T05:25:07.012+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T05:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T05:25:07.013151537Z [2024-06-27T05:25:07.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T05:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T05:25:07.073488966Z [2024-06-27T05:25:07.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status queued for try_number 1 2024-06-27T05:25:07.074847592Z [2024-06-27T05:25:07.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status success for try_number 1 2024-06-27T05:25:07.086395014Z [2024-06-27T05:25:07.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d18a0d0-52b4-4554-bf84-163096195979 2024-06-27T05:25:07.087051823Z [2024-06-27T05:25:07.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T05:20:00+00:00, map_index=-1, run_start_date=2024-06-27 05:25:05.876966+00:00, run_end_date=2024-06-27 05:25:06.296589+00:00, run_duration=0.419623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=620, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:25:03.983387+00:00, queued_by_job_id=2, pid=13468 2024-06-27T05:25:07.331678456Z [2024-06-27T05:25:07.331+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T05:25:09.592433209Z [2024-06-27T05:25:09.592+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:25:09.592469589Z 2024-06-27T05:25:09.592480065Z [2024-06-27T05:25:09.592+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:25:09.592999363Z [2024-06-27T05:25:09.592+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:25:09.593011354Z 2024-06-27T05:25:09.597581070Z [2024-06-27T05:25:09.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T05:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:25:09.597615890Z [2024-06-27T05:25:09.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T05:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:25:09.700583267Z [2024-06-27T05:25:09.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status queued for try_number 1 2024-06-27T05:25:09.700655476Z [2024-06-27T05:25:09.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status success for try_number 1 2024-06-27T05:25:09.724869326Z [2024-06-27T05:25:09.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to 835bd6ec-d2bb-4c75-addb-4fc15bfffe8e 2024-06-27T05:25:09.727335243Z [2024-06-27T05:25:09.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T05:20:00+00:00, map_index=0, run_start_date=2024-06-27 05:25:08.771153+00:00, run_end_date=2024-06-27 05:25:09.160586+00:00, run_duration=0.389433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=621, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:25:07.010392+00:00, queued_by_job_id=2, pid=13480 2024-06-27T05:25:12.117960198Z [2024-06-27T05:25:12.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:25:12.118722188Z [2024-06-27T05:25:12.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:20:00+00:00, run_id=scheduled__2024-06-27T05:20:00+00:00, run_start_date=2024-06-27 05:25:00.721233+00:00, run_end_date=2024-06-27 05:25:12.118089+00:00, run_duration=11.396856, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:20:00+00:00, data_interval_end=2024-06-27 05:25:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T05:25:12.130412090Z [2024-06-27T05:25:12.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:25:00+00:00, run_after=2024-06-27T05:30:00+00:00 2024-06-27T05:25:12.172192183Z [2024-06-27T05:25:12.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:20:00+00:00 exited with status success for try_number 1 2024-06-27T05:25:12.178477254Z [2024-06-27T05:25:12.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T05:20:00+00:00, map_index=-1, run_start_date=2024-06-27 05:25:11.595499+00:00, run_end_date=2024-06-27 05:25:12.025161+00:00, run_duration=0.429662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=622, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:25:09.593364+00:00, queued_by_job_id=2, pid=13492 2024-06-27T05:26:00.531510071Z [2024-06-27T05:26:00.530+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:26:00.547095713Z [2024-06-27T05:26:00.546+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:26:00+00:00, run_after=2024-06-27T05:27:00+00:00 2024-06-27T05:26:00.565037023Z [2024-06-27T05:26:00.564+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:26:00+00:00, run_after=2024-06-27T05:27:00+00:00 2024-06-27T05:26:00.578142888Z [2024-06-27T05:26:00.577+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:26:00.683211573Z [2024-06-27T05:26:00.681+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:26:00.683260351Z 2024-06-27T05:26:00.683265255Z 2024-06-27T05:26:00.683268891Z 2024-06-27T05:26:00.683272735Z 2024-06-27T05:26:00.683607194Z [2024-06-27T05:26:00.683+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:26:00.684009740Z [2024-06-27T05:26:00.683+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:26:00.684187247Z [2024-06-27T05:26:00.683+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:26:00.684487352Z [2024-06-27T05:26:00.684+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:26:00.685846272Z [2024-06-27T05:26:00.685+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:26:00.685864383Z 2024-06-27T05:26:00.685869923Z 2024-06-27T05:26:00.685874745Z 2024-06-27T05:26:00.685879740Z 2024-06-27T05:26:00.693129812Z [2024-06-27T05:26:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:26:00.693451662Z [2024-06-27T05:26:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:26:00.694330756Z [2024-06-27T05:26:00.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:26:00.694505780Z [2024-06-27T05:26:00.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:26:00.694925125Z [2024-06-27T05:26:00.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:26:00.695162116Z [2024-06-27T05:26:00.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:26:00.695589549Z [2024-06-27T05:26:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:26:00.695788827Z [2024-06-27T05:26:00.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:26:00.962295253Z [2024-06-27T05:26:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:24:00+00:00 exited with status queued for try_number 1 2024-06-27T05:26:00.964892064Z [2024-06-27T05:26:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status queued for try_number 1 2024-06-27T05:26:00.965016849Z [2024-06-27T05:26:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status queued for try_number 1 2024-06-27T05:26:00.965170317Z [2024-06-27T05:26:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status queued for try_number 1 2024-06-27T05:26:00.975028426Z [2024-06-27T05:26:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 784b5c7b-1e06-4e19-8591-6183eed166ab 2024-06-27T05:26:00.975162395Z [2024-06-27T05:26:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to abd72dd5-cb5d-4f41-b4a5-7004aee08339 2024-06-27T05:26:00.975345474Z [2024-06-27T05:26:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2a55018-dc19-4d1a-8b60-dd3b28bdc1b2 2024-06-27T05:26:00.975602483Z [2024-06-27T05:26:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4dfa960-86b6-4c0a-839a-506bab01079a 2024-06-27T05:26:02.297141026Z [2024-06-27T05:26:02.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:26:02.297659576Z [2024-06-27T05:26:02.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:24:00+00:00, run_id=scheduled__2024-06-27T05:24:00+00:00, run_start_date=2024-06-27 05:26:00.595510+00:00, run_end_date=2024-06-27 05:26:02.297320+00:00, run_duration=1.70181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:24:00+00:00, data_interval_end=2024-06-27 05:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:26:02.310008075Z [2024-06-27T05:26:02.309+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:26:00+00:00, run_after=2024-06-27T05:28:00+00:00 2024-06-27T05:26:02.424448605Z [2024-06-27T05:26:02.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:24:00+00:00 exited with status success for try_number 1 2024-06-27T05:26:02.431044613Z [2024-06-27T05:26:02.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:24:00+00:00, map_index=-1, run_start_date=2024-06-27 05:26:01.699574+00:00, run_end_date=2024-06-27 05:26:02.264357+00:00, run_duration=0.564783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=623, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:26:00.687956+00:00, queued_by_job_id=2, pid=13519 2024-06-27T05:26:03.481699729Z [2024-06-27T05:26:03.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:26:03.481951210Z [2024-06-27T05:26:03.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:25:00+00:00, run_id=scheduled__2024-06-27T05:25:00+00:00, run_start_date=2024-06-27 05:26:00.597195+00:00, run_end_date=2024-06-27 05:26:03.481642+00:00, run_duration=2.884447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:25:00+00:00, data_interval_end=2024-06-27 05:26:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:26:03.490832081Z [2024-06-27T05:26:03.490+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:26:00+00:00, run_after=2024-06-27T05:27:00+00:00 2024-06-27T05:26:03.534505158Z [2024-06-27T05:26:03.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status success for try_number 1 2024-06-27T05:26:03.541238521Z [2024-06-27T05:26:03.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:25:00+00:00, map_index=-1, run_start_date=2024-06-27 05:26:01.927517+00:00, run_end_date=2024-06-27 05:26:02.421888+00:00, run_duration=0.494371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=624, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:26:00.687956+00:00, queued_by_job_id=2, pid=13520 2024-06-27T05:26:05.502095656Z [2024-06-27T05:26:05.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:26:05.502553791Z [2024-06-27T05:26:05.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:25:00+00:00, run_id=scheduled__2024-06-27T05:25:00+00:00, run_start_date=2024-06-27 05:26:00.598265+00:00, run_end_date=2024-06-27 05:26:05.501945+00:00, run_duration=4.90368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:25:00+00:00, data_interval_end=2024-06-27 05:26:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:26:05.516482428Z [2024-06-27T05:26:05.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:26:00+00:00, run_after=2024-06-27T05:27:00+00:00 2024-06-27T05:26:05.534470725Z [2024-06-27T05:26:05.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:26:05.534517777Z [2024-06-27T05:26:05.533+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:25:00+00:00, run_id=scheduled__2024-06-27T05:25:00+00:00, run_start_date=2024-06-27 05:26:00.599238+00:00, run_end_date=2024-06-27 05:26:05.533735+00:00, run_duration=4.934497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:25:00+00:00, data_interval_end=2024-06-27 05:26:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:26:05.545023266Z [2024-06-27T05:26:05.544+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:26:00+00:00, run_after=2024-06-27T05:27:00+00:00 2024-06-27T05:26:05.579947111Z [2024-06-27T05:26:05.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status success for try_number 1 2024-06-27T05:26:05.580018635Z [2024-06-27T05:26:05.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status success for try_number 1 2024-06-27T05:26:05.586807087Z [2024-06-27T05:26:05.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:25:00+00:00, map_index=-1, run_start_date=2024-06-27 05:26:03.116275+00:00, run_end_date=2024-06-27 05:26:04.988215+00:00, run_duration=1.87194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=626, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:26:00.687956+00:00, queued_by_job_id=2, pid=13559 2024-06-27T05:26:05.586859632Z [2024-06-27T05:26:05.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:25:00+00:00, map_index=-1, run_start_date=2024-06-27 05:26:03.033628+00:00, run_end_date=2024-06-27 05:26:05.318214+00:00, run_duration=2.284586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=625, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:26:00.687956+00:00, queued_by_job_id=2, pid=13558 2024-06-27T05:27:01.080977403Z [2024-06-27T05:27:01.078+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:27:01.097185131Z [2024-06-27T05:27:01.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:27:00+00:00, run_after=2024-06-27T05:28:00+00:00 2024-06-27T05:27:01.105691264Z [2024-06-27T05:27:01.103+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:27:00+00:00, run_after=2024-06-27T05:28:00+00:00 2024-06-27T05:27:01.173396106Z [2024-06-27T05:27:01.172+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:27:01.173435029Z 2024-06-27T05:27:01.173466170Z 2024-06-27T05:27:01.173470901Z 2024-06-27T05:27:01.173674700Z [2024-06-27T05:27:01.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:27:01.173912080Z [2024-06-27T05:27:01.173+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:27:01.174166321Z [2024-06-27T05:27:01.174+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:27:01.175027133Z [2024-06-27T05:27:01.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:27:01.175041333Z 2024-06-27T05:27:01.175045772Z 2024-06-27T05:27:01.175075162Z 2024-06-27T05:27:01.179979229Z [2024-06-27T05:27:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:27:01.180242782Z [2024-06-27T05:27:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:27:01.180747620Z [2024-06-27T05:27:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:27:01.180877625Z [2024-06-27T05:27:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:27:01.181495230Z [2024-06-27T05:27:01.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:27:01.181741479Z [2024-06-27T05:27:01.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:27:01.688657650Z [2024-06-27T05:27:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:26:00+00:00 exited with status queued for try_number 1 2024-06-27T05:27:01.688956892Z [2024-06-27T05:27:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:26:00+00:00 exited with status queued for try_number 1 2024-06-27T05:27:01.689178456Z [2024-06-27T05:27:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:26:00+00:00 exited with status queued for try_number 1 2024-06-27T05:27:01.697547891Z [2024-06-27T05:27:01.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c8e7e33-49c6-46a6-8712-87730a6284da 2024-06-27T05:27:01.697576348Z [2024-06-27T05:27:01.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to be5475cf-81aa-4560-9b6c-d3f1a5eed2f1 2024-06-27T05:27:01.697680710Z [2024-06-27T05:27:01.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5a43f7e-17d8-433a-8d75-76dcf72d3a00 2024-06-27T05:27:03.051387360Z [2024-06-27T05:27:03.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:27:03.051695872Z [2024-06-27T05:27:03.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:26:00+00:00, run_id=scheduled__2024-06-27T05:26:00+00:00, run_start_date=2024-06-27 05:27:01.116016+00:00, run_end_date=2024-06-27 05:27:03.051322+00:00, run_duration=1.935306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:26:00+00:00, data_interval_end=2024-06-27 05:27:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:27:03.082677729Z [2024-06-27T05:27:03.076+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:27:00+00:00, run_after=2024-06-27T05:28:00+00:00 2024-06-27T05:27:03.157361705Z [2024-06-27T05:27:03.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:26:00+00:00 exited with status success for try_number 1 2024-06-27T05:27:03.171703587Z [2024-06-27T05:27:03.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:26:00+00:00, map_index=-1, run_start_date=2024-06-27 05:27:02.075409+00:00, run_end_date=2024-06-27 05:27:02.526572+00:00, run_duration=0.451163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=627, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:27:01.176268+00:00, queued_by_job_id=2, pid=13604 2024-06-27T05:27:05.763608540Z [2024-06-27T05:27:05.763+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:27:05.763964365Z [2024-06-27T05:27:05.763+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:26:00+00:00, run_id=scheduled__2024-06-27T05:26:00+00:00, run_start_date=2024-06-27 05:27:01.117550+00:00, run_end_date=2024-06-27 05:27:05.763500+00:00, run_duration=4.64595, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:26:00+00:00, data_interval_end=2024-06-27 05:27:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:27:05.771870309Z [2024-06-27T05:27:05.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:27:00+00:00, run_after=2024-06-27T05:28:00+00:00 2024-06-27T05:27:05.806854228Z [2024-06-27T05:27:05.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:26:00+00:00 exited with status success for try_number 1 2024-06-27T05:27:05.813156147Z [2024-06-27T05:27:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:26:00+00:00, map_index=-1, run_start_date=2024-06-27 05:27:03.493867+00:00, run_end_date=2024-06-27 05:27:05.385286+00:00, run_duration=1.891419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=629, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:27:01.176268+00:00, queued_by_job_id=2, pid=13635 2024-06-27T05:27:06.862456370Z [2024-06-27T05:27:06.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:27:06.862937059Z [2024-06-27T05:27:06.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:26:00+00:00, run_id=scheduled__2024-06-27T05:26:00+00:00, run_start_date=2024-06-27 05:27:01.119298+00:00, run_end_date=2024-06-27 05:27:06.862524+00:00, run_duration=5.743226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:26:00+00:00, data_interval_end=2024-06-27 05:27:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:27:06.880808496Z [2024-06-27T05:27:06.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:27:00+00:00, run_after=2024-06-27T05:28:00+00:00 2024-06-27T05:27:06.943750397Z [2024-06-27T05:27:06.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:26:00+00:00 exited with status success for try_number 1 2024-06-27T05:27:06.955087986Z [2024-06-27T05:27:06.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:26:00+00:00, map_index=-1, run_start_date=2024-06-27 05:27:03.349548+00:00, run_end_date=2024-06-27 05:27:05.750572+00:00, run_duration=2.401024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=628, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:27:01.176268+00:00, queued_by_job_id=2, pid=13634 2024-06-27T05:28:00.956869491Z [2024-06-27T05:28:00.956+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:28:00+00:00, run_after=2024-06-27T05:29:00+00:00 2024-06-27T05:28:00.966031545Z [2024-06-27T05:28:00.965+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:28:00.975153233Z [2024-06-27T05:28:00.974+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:28:00.988923655Z [2024-06-27T05:28:00.988+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:28:00+00:00, run_after=2024-06-27T05:29:00+00:00 2024-06-27T05:28:01.096359361Z [2024-06-27T05:28:01.089+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:28:01.096387072Z 2024-06-27T05:28:01.096391802Z 2024-06-27T05:28:01.096395428Z 2024-06-27T05:28:01.096399264Z 2024-06-27T05:28:01.096403194Z [2024-06-27T05:28:01.089+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:28:01.096406449Z [2024-06-27T05:28:01.089+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:28:01.096409963Z [2024-06-27T05:28:01.089+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:28:01.096413235Z [2024-06-27T05:28:01.089+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:28:01.096416411Z [2024-06-27T05:28:01.090+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:28:01.096419561Z 2024-06-27T05:28:01.096422735Z 2024-06-27T05:28:01.096425847Z 2024-06-27T05:28:01.096428959Z 2024-06-27T05:28:01.096433746Z [2024-06-27T05:28:01.094+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:28:01.096439663Z [2024-06-27T05:28:01.094+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:28:01.096603489Z [2024-06-27T05:28:01.094+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:28:01.096609635Z [2024-06-27T05:28:01.094+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:28:01.096638846Z [2024-06-27T05:28:01.094+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:28:01.096642347Z [2024-06-27T05:28:01.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:28:01.096645358Z [2024-06-27T05:28:01.095+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:28:01.096648305Z [2024-06-27T05:28:01.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:28:01.555229104Z [2024-06-27T05:28:01.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:26:00+00:00 exited with status queued for try_number 1 2024-06-27T05:28:01.557004896Z [2024-06-27T05:28:01.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:27:00+00:00 exited with status queued for try_number 1 2024-06-27T05:28:01.557191306Z [2024-06-27T05:28:01.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:27:00+00:00 exited with status queued for try_number 1 2024-06-27T05:28:01.557296996Z [2024-06-27T05:28:01.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:27:00+00:00 exited with status queued for try_number 1 2024-06-27T05:28:01.573114003Z [2024-06-27T05:28:01.572+0000] {scheduler_job.py:635} INFO - Setting external_id for to 284b6779-134e-4548-82f2-9c47da421913 2024-06-27T05:28:01.574097897Z [2024-06-27T05:28:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to c69b5573-8800-4a23-b335-48629338a66a 2024-06-27T05:28:01.574340016Z [2024-06-27T05:28:01.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15355fe5-26fc-4d63-8b24-1d0e5afb7b04 2024-06-27T05:28:01.574502492Z [2024-06-27T05:28:01.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43bab48b-95ba-4109-8387-fa4e2184c46e 2024-06-27T05:28:02.929066885Z [2024-06-27T05:28:02.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:28:02.929319300Z [2024-06-27T05:28:02.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:26:00+00:00, run_id=scheduled__2024-06-27T05:26:00+00:00, run_start_date=2024-06-27 05:28:01.004049+00:00, run_end_date=2024-06-27 05:28:02.929001+00:00, run_duration=1.924952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:26:00+00:00, data_interval_end=2024-06-27 05:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:28:02.939990135Z [2024-06-27T05:28:02.939+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:28:00+00:00, run_after=2024-06-27T05:30:00+00:00 2024-06-27T05:28:02.946488867Z [2024-06-27T05:28:02.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:28:02.946643189Z [2024-06-27T05:28:02.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:27:00+00:00, run_id=scheduled__2024-06-27T05:27:00+00:00, run_start_date=2024-06-27 05:28:01.005897+00:00, run_end_date=2024-06-27 05:28:02.946410+00:00, run_duration=1.940513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:27:00+00:00, data_interval_end=2024-06-27 05:28:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:28:02.955905273Z [2024-06-27T05:28:02.955+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:28:00+00:00, run_after=2024-06-27T05:29:00+00:00 2024-06-27T05:28:03.005511884Z [2024-06-27T05:28:03.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:26:00+00:00 exited with status success for try_number 1 2024-06-27T05:28:03.005700548Z [2024-06-27T05:28:03.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:27:00+00:00 exited with status success for try_number 1 2024-06-27T05:28:03.012574783Z [2024-06-27T05:28:03.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:26:00+00:00, map_index=-1, run_start_date=2024-06-27 05:28:02.037500+00:00, run_end_date=2024-06-27 05:28:02.369311+00:00, run_duration=0.331811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=630, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:28:01.091501+00:00, queued_by_job_id=2, pid=13680 2024-06-27T05:28:03.012816049Z [2024-06-27T05:28:03.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:27:00+00:00, map_index=-1, run_start_date=2024-06-27 05:28:02.164491+00:00, run_end_date=2024-06-27 05:28:02.584256+00:00, run_duration=0.419765, state=success, executor_state=success, try_number=1, max_tries=1, job_id=631, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:28:01.091501+00:00, queued_by_job_id=2, pid=13681 2024-06-27T05:28:05.991142503Z [2024-06-27T05:28:05.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:28:05.991872335Z [2024-06-27T05:28:05.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:27:00+00:00, run_id=scheduled__2024-06-27T05:27:00+00:00, run_start_date=2024-06-27 05:28:01.007130+00:00, run_end_date=2024-06-27 05:28:05.991373+00:00, run_duration=4.984243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:27:00+00:00, data_interval_end=2024-06-27 05:28:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:28:06.006244847Z [2024-06-27T05:28:06.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:28:00+00:00, run_after=2024-06-27T05:29:00+00:00 2024-06-27T05:28:06.018067536Z [2024-06-27T05:28:06.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:28:06.018322252Z [2024-06-27T05:28:06.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:27:00+00:00, run_id=scheduled__2024-06-27T05:27:00+00:00, run_start_date=2024-06-27 05:28:01.008230+00:00, run_end_date=2024-06-27 05:28:06.018025+00:00, run_duration=5.009795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:27:00+00:00, data_interval_end=2024-06-27 05:28:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:28:06.028600561Z [2024-06-27T05:28:06.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:28:00+00:00, run_after=2024-06-27T05:29:00+00:00 2024-06-27T05:28:06.064147817Z [2024-06-27T05:28:06.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:27:00+00:00 exited with status success for try_number 1 2024-06-27T05:28:06.064401730Z [2024-06-27T05:28:06.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:27:00+00:00 exited with status success for try_number 1 2024-06-27T05:28:06.073202846Z [2024-06-27T05:28:06.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:27:00+00:00, map_index=-1, run_start_date=2024-06-27 05:28:03.489747+00:00, run_end_date=2024-06-27 05:28:04.933387+00:00, run_duration=1.44364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=633, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:28:01.091501+00:00, queued_by_job_id=2, pid=13721 2024-06-27T05:28:06.073535312Z [2024-06-27T05:28:06.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:27:00+00:00, map_index=-1, run_start_date=2024-06-27 05:28:03.250065+00:00, run_end_date=2024-06-27 05:28:05.237703+00:00, run_duration=1.987638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=632, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:28:01.091501+00:00, queued_by_job_id=2, pid=13720 2024-06-27T05:29:01.066866244Z [2024-06-27T05:29:01.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:29:00+00:00, run_after=2024-06-27T05:30:00+00:00 2024-06-27T05:29:01.073985939Z [2024-06-27T05:29:01.073+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:29:01.085857134Z [2024-06-27T05:29:01.085+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:29:00+00:00, run_after=2024-06-27T05:30:00+00:00 2024-06-27T05:29:01.176305820Z [2024-06-27T05:29:01.175+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:29:01.176340331Z 2024-06-27T05:29:01.176345213Z 2024-06-27T05:29:01.176349611Z 2024-06-27T05:29:01.176353631Z [2024-06-27T05:29:01.176+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:29:01.176700371Z [2024-06-27T05:29:01.176+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:29:01.176851908Z [2024-06-27T05:29:01.176+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:29:01.177629737Z [2024-06-27T05:29:01.177+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:29:01.177644252Z 2024-06-27T05:29:01.177648603Z 2024-06-27T05:29:01.177662968Z 2024-06-27T05:29:01.183038110Z [2024-06-27T05:29:01.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:29:01.183250068Z [2024-06-27T05:29:01.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:29:01.183678110Z [2024-06-27T05:29:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:29:01.183970346Z [2024-06-27T05:29:01.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:29:01.184337154Z [2024-06-27T05:29:01.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:29:01.184574024Z [2024-06-27T05:29:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:29:01.432957183Z [2024-06-27T05:29:01.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:28:00+00:00 exited with status queued for try_number 1 2024-06-27T05:29:01.433091298Z [2024-06-27T05:29:01.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:28:00+00:00 exited with status queued for try_number 1 2024-06-27T05:29:01.433215952Z [2024-06-27T05:29:01.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:28:00+00:00 exited with status queued for try_number 1 2024-06-27T05:29:01.441610535Z [2024-06-27T05:29:01.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to c57a0dd1-36ad-42b7-8433-aed67816583f 2024-06-27T05:29:01.441738919Z [2024-06-27T05:29:01.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1feb3470-2eca-4cba-b3b7-8eb199d6ad56 2024-06-27T05:29:01.441853858Z [2024-06-27T05:29:01.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd5dcec1-9748-403a-a8d4-4b9c0cc0b558 2024-06-27T05:29:02.584937267Z [2024-06-27T05:29:02.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:29:02.585465453Z [2024-06-27T05:29:02.585+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:28:00+00:00, run_id=scheduled__2024-06-27T05:28:00+00:00, run_start_date=2024-06-27 05:29:01.104772+00:00, run_end_date=2024-06-27 05:29:02.584740+00:00, run_duration=1.479968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:28:00+00:00, data_interval_end=2024-06-27 05:29:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:29:02.594998082Z [2024-06-27T05:29:02.594+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:29:00+00:00, run_after=2024-06-27T05:30:00+00:00 2024-06-27T05:29:02.661752439Z [2024-06-27T05:29:02.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:28:00+00:00 exited with status success for try_number 1 2024-06-27T05:29:02.676999902Z [2024-06-27T05:29:02.665+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:28:00+00:00, map_index=-1, run_start_date=2024-06-27 05:29:01.936707+00:00, run_end_date=2024-06-27 05:29:02.333536+00:00, run_duration=0.396829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=634, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:29:01.178493+00:00, queued_by_job_id=2, pid=13765 2024-06-27T05:29:05.119436952Z [2024-06-27T05:29:05.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:29:05.119783924Z [2024-06-27T05:29:05.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:28:00+00:00, run_id=scheduled__2024-06-27T05:28:00+00:00, run_start_date=2024-06-27 05:29:01.109583+00:00, run_end_date=2024-06-27 05:29:05.119290+00:00, run_duration=4.009707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:28:00+00:00, data_interval_end=2024-06-27 05:29:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:29:05.132197645Z [2024-06-27T05:29:05.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:29:00+00:00, run_after=2024-06-27T05:30:00+00:00 2024-06-27T05:29:05.191326757Z [2024-06-27T05:29:05.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:28:00+00:00 exited with status success for try_number 1 2024-06-27T05:29:05.201473625Z [2024-06-27T05:29:05.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:28:00+00:00, map_index=-1, run_start_date=2024-06-27 05:29:03.188950+00:00, run_end_date=2024-06-27 05:29:04.760346+00:00, run_duration=1.571396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=636, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:29:01.178493+00:00, queued_by_job_id=2, pid=13795 2024-06-27T05:29:06.423426560Z [2024-06-27T05:29:06.422+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:29:06.423451907Z [2024-06-27T05:29:06.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:28:00+00:00, run_id=scheduled__2024-06-27T05:28:00+00:00, run_start_date=2024-06-27 05:29:01.111084+00:00, run_end_date=2024-06-27 05:29:06.422784+00:00, run_duration=5.3117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:28:00+00:00, data_interval_end=2024-06-27 05:29:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:29:06.432876363Z [2024-06-27T05:29:06.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:29:00+00:00, run_after=2024-06-27T05:30:00+00:00 2024-06-27T05:29:06.471935348Z [2024-06-27T05:29:06.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:28:00+00:00 exited with status success for try_number 1 2024-06-27T05:29:06.480308631Z [2024-06-27T05:29:06.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:28:00+00:00, map_index=-1, run_start_date=2024-06-27 05:29:03.121587+00:00, run_end_date=2024-06-27 05:29:05.362289+00:00, run_duration=2.240702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=635, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:29:01.178493+00:00, queued_by_job_id=2, pid=13794 2024-06-27T05:30:00.992997875Z [2024-06-27T05:30:00.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:30:00+00:00, run_after=2024-06-27T05:31:00+00:00 2024-06-27T05:30:01.001099889Z [2024-06-27T05:30:00.999+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:30:01.031862885Z [2024-06-27T05:30:01.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:30:00+00:00, run_after=2024-06-27T05:35:00+00:00 2024-06-27T05:30:01.044279228Z [2024-06-27T05:30:01.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:30:00+00:00, run_after=2024-06-27T05:31:00+00:00 2024-06-27T05:30:01.053047928Z [2024-06-27T05:30:01.052+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:30:01.186441664Z [2024-06-27T05:30:01.186+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T05:30:01.186474531Z 2024-06-27T05:30:01.186480498Z 2024-06-27T05:30:01.186486264Z 2024-06-27T05:30:01.186491396Z 2024-06-27T05:30:01.186496682Z 2024-06-27T05:30:01.186658787Z [2024-06-27T05:30:01.186+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:30:01.186880522Z [2024-06-27T05:30:01.186+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:30:01.187072601Z [2024-06-27T05:30:01.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:30:01.187278687Z [2024-06-27T05:30:01.187+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:30:01.187495478Z [2024-06-27T05:30:01.187+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:30:01.188301561Z [2024-06-27T05:30:01.188+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:30:01.188322649Z 2024-06-27T05:30:01.188332577Z 2024-06-27T05:30:01.188342317Z 2024-06-27T05:30:01.188375362Z 2024-06-27T05:30:01.188384429Z 2024-06-27T05:30:01.197046087Z [2024-06-27T05:30:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T05:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T05:30:01.198431499Z [2024-06-27T05:30:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T05:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:30:01.198851428Z [2024-06-27T05:30:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:30:01.199040976Z [2024-06-27T05:30:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:30:01.199372554Z [2024-06-27T05:30:01.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:30:01.199565385Z [2024-06-27T05:30:01.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:30:01.199875585Z [2024-06-27T05:30:01.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:30:01.200035881Z [2024-06-27T05:30:01.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:30:01.200485825Z [2024-06-27T05:30:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:30:01.200986957Z [2024-06-27T05:30:01.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:30:01.618090288Z [2024-06-27T05:30:01.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status queued for try_number 1 2024-06-27T05:30:01.618251882Z [2024-06-27T05:30:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:28:00+00:00 exited with status queued for try_number 1 2024-06-27T05:30:01.618374386Z [2024-06-27T05:30:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:29:00+00:00 exited with status queued for try_number 1 2024-06-27T05:30:01.618483211Z [2024-06-27T05:30:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:29:00+00:00 exited with status queued for try_number 1 2024-06-27T05:30:01.618652179Z [2024-06-27T05:30:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:29:00+00:00 exited with status queued for try_number 1 2024-06-27T05:30:01.643346385Z [2024-06-27T05:30:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 778689e6-cd97-48e6-9f67-739e5c1beec2 2024-06-27T05:30:01.643481302Z [2024-06-27T05:30:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e536825-b49b-4265-948d-fce48b1d086e 2024-06-27T05:30:01.643646408Z [2024-06-27T05:30:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e67e2a1-cee6-4393-80f8-6d2ec2023eb8 2024-06-27T05:30:01.643824847Z [2024-06-27T05:30:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86156fdd-7464-4582-9d66-22048c5dea64 2024-06-27T05:30:01.643968722Z [2024-06-27T05:30:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05604fa8-2f24-40eb-9f36-d0abbf56e429 2024-06-27T05:30:03.000972066Z [2024-06-27T05:30:03.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:30:03.001418249Z [2024-06-27T05:30:03.001+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:28:00+00:00, run_id=scheduled__2024-06-27T05:28:00+00:00, run_start_date=2024-06-27 05:30:01.094993+00:00, run_end_date=2024-06-27 05:30:03.001078+00:00, run_duration=1.906085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:28:00+00:00, data_interval_end=2024-06-27 05:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:30:03.016706901Z [2024-06-27T05:30:03.016+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:30:00+00:00, run_after=2024-06-27T05:32:00+00:00 2024-06-27T05:30:03.105336162Z [2024-06-27T05:30:03.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:28:00+00:00 exited with status success for try_number 1 2024-06-27T05:30:03.119557173Z [2024-06-27T05:30:03.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:28:00+00:00, map_index=-1, run_start_date=2024-06-27 05:30:02.214386+00:00, run_end_date=2024-06-27 05:30:02.803632+00:00, run_duration=0.589246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=637, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:30:01.190125+00:00, queued_by_job_id=2, pid=13836 2024-06-27T05:30:04.188309501Z [2024-06-27T05:30:04.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:30:04.190293851Z [2024-06-27T05:30:04.189+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:29:00+00:00, run_id=scheduled__2024-06-27T05:29:00+00:00, run_start_date=2024-06-27 05:30:01.096176+00:00, run_end_date=2024-06-27 05:30:04.189778+00:00, run_duration=3.093602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:29:00+00:00, data_interval_end=2024-06-27 05:30:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:30:04.205858248Z [2024-06-27T05:30:04.205+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:30:00+00:00, run_after=2024-06-27T05:31:00+00:00 2024-06-27T05:30:04.312421152Z [2024-06-27T05:30:04.312+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:30:04.312455397Z 2024-06-27T05:30:04.312831824Z [2024-06-27T05:30:04.312+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:30:04.313679438Z [2024-06-27T05:30:04.313+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:30:04.313692653Z 2024-06-27T05:30:04.318396104Z [2024-06-27T05:30:04.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T05:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T05:30:04.318686045Z [2024-06-27T05:30:04.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T05:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:30:04.443216682Z [2024-06-27T05:30:04.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status queued for try_number 1 2024-06-27T05:30:04.443255499Z [2024-06-27T05:30:04.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status success for try_number 1 2024-06-27T05:30:04.443268835Z [2024-06-27T05:30:04.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:29:00+00:00 exited with status success for try_number 1 2024-06-27T05:30:04.454219029Z [2024-06-27T05:30:04.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T05:25:00+00:00, map_index=-1, run_start_date=2024-06-27 05:30:03.691350+00:00, run_end_date=2024-06-27 05:30:04.138738+00:00, run_duration=0.447388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=639, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:30:01.190125+00:00, queued_by_job_id=2, pid=13882 2024-06-27T05:30:04.454366264Z [2024-06-27T05:30:04.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29974846-913b-4f4b-b4bd-aa65d3f2010a 2024-06-27T05:30:04.454494520Z [2024-06-27T05:30:04.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:29:00+00:00, map_index=-1, run_start_date=2024-06-27 05:30:02.479633+00:00, run_end_date=2024-06-27 05:30:03.111094+00:00, run_duration=0.631461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=638, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:30:01.190125+00:00, queued_by_job_id=2, pid=13842 2024-06-27T05:30:05.727958910Z [2024-06-27T05:30:05.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:30:05.728155171Z [2024-06-27T05:30:05.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:29:00+00:00, run_id=scheduled__2024-06-27T05:29:00+00:00, run_start_date=2024-06-27 05:30:01.097311+00:00, run_end_date=2024-06-27 05:30:05.727900+00:00, run_duration=4.630589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:29:00+00:00, data_interval_end=2024-06-27 05:30:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:30:05.737396404Z [2024-06-27T05:30:05.736+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:30:00+00:00, run_after=2024-06-27T05:31:00+00:00 2024-06-27T05:30:05.745913020Z [2024-06-27T05:30:05.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:30:05.746033415Z [2024-06-27T05:30:05.745+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:29:00+00:00, run_id=scheduled__2024-06-27T05:29:00+00:00, run_start_date=2024-06-27 05:30:01.098425+00:00, run_end_date=2024-06-27 05:30:05.745819+00:00, run_duration=4.647394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:29:00+00:00, data_interval_end=2024-06-27 05:30:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:30:05.755582749Z [2024-06-27T05:30:05.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:30:00+00:00, run_after=2024-06-27T05:31:00+00:00 2024-06-27T05:30:05.819248729Z [2024-06-27T05:30:05.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:29:00+00:00 exited with status success for try_number 1 2024-06-27T05:30:05.824551371Z [2024-06-27T05:30:05.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:29:00+00:00, map_index=-1, run_start_date=2024-06-27 05:30:04.060665+00:00, run_end_date=2024-06-27 05:30:05.487111+00:00, run_duration=1.426446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=641, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:30:01.190125+00:00, queued_by_job_id=2, pid=13902 2024-06-27T05:30:06.924692058Z [2024-06-27T05:30:06.924+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:30:06.924804892Z 2024-06-27T05:30:06.924928452Z [2024-06-27T05:30:06.924+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:30:06.925693879Z [2024-06-27T05:30:06.925+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:30:06.925716086Z 2024-06-27T05:30:06.928229072Z [2024-06-27T05:30:06.927+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T05:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T05:30:06.928472172Z [2024-06-27T05:30:06.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T05:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T05:30:06.982708354Z [2024-06-27T05:30:06.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status queued for try_number 1 2024-06-27T05:30:06.982822072Z [2024-06-27T05:30:06.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:29:00+00:00 exited with status success for try_number 1 2024-06-27T05:30:06.982833236Z [2024-06-27T05:30:06.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status success for try_number 1 2024-06-27T05:30:06.991431406Z [2024-06-27T05:30:06.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T05:25:00+00:00, map_index=-1, run_start_date=2024-06-27 05:30:06.261780+00:00, run_end_date=2024-06-27 05:30:06.641678+00:00, run_duration=0.379898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=642, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:30:04.314290+00:00, queued_by_job_id=2, pid=13932 2024-06-27T05:30:06.991709804Z [2024-06-27T05:30:06.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:29:00+00:00, map_index=-1, run_start_date=2024-06-27 05:30:03.727025+00:00, run_end_date=2024-06-27 05:30:05.654150+00:00, run_duration=1.927125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=640, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:30:01.190125+00:00, queued_by_job_id=2, pid=13887 2024-06-27T05:30:06.991884267Z [2024-06-27T05:30:06.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4be056b5-137f-4c2c-8a58-5ef5685a1a98 2024-06-27T05:30:07.442159696Z [2024-06-27T05:30:07.441+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T05:30:09.628640388Z [2024-06-27T05:30:09.628+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:30:09.628684327Z 2024-06-27T05:30:09.628846190Z [2024-06-27T05:30:09.628+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:30:09.629627568Z [2024-06-27T05:30:09.629+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:30:09.629661253Z 2024-06-27T05:30:09.632929846Z [2024-06-27T05:30:09.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T05:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:30:09.633232605Z [2024-06-27T05:30:09.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T05:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:30:09.694671336Z [2024-06-27T05:30:09.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status queued for try_number 1 2024-06-27T05:30:09.695009667Z [2024-06-27T05:30:09.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status success for try_number 1 2024-06-27T05:30:09.702166643Z [2024-06-27T05:30:09.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ce3f9b4-864d-4df4-a101-b993bd821eb3 2024-06-27T05:30:09.702489882Z [2024-06-27T05:30:09.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T05:25:00+00:00, map_index=0, run_start_date=2024-06-27 05:30:08.570781+00:00, run_end_date=2024-06-27 05:30:08.891575+00:00, run_duration=0.320794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=643, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:30:06.926121+00:00, queued_by_job_id=2, pid=13944 2024-06-27T05:30:12.331645954Z [2024-06-27T05:30:12.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:30:12.332096041Z [2024-06-27T05:30:12.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:25:00+00:00, run_id=scheduled__2024-06-27T05:25:00+00:00, run_start_date=2024-06-27 05:30:01.093262+00:00, run_end_date=2024-06-27 05:30:12.331495+00:00, run_duration=11.238233, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:25:00+00:00, data_interval_end=2024-06-27 05:30:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T05:30:12.339804095Z [2024-06-27T05:30:12.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:30:00+00:00, run_after=2024-06-27T05:35:00+00:00 2024-06-27T05:30:12.380854100Z [2024-06-27T05:30:12.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:25:00+00:00 exited with status success for try_number 1 2024-06-27T05:30:12.390756047Z [2024-06-27T05:30:12.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T05:25:00+00:00, map_index=-1, run_start_date=2024-06-27 05:30:11.318135+00:00, run_end_date=2024-06-27 05:30:11.743224+00:00, run_duration=0.425089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=644, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:30:09.630223+00:00, queued_by_job_id=2, pid=13956 2024-06-27T05:31:00.358855159Z [2024-06-27T05:31:00.358+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:31:00.385646910Z [2024-06-27T05:31:00.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:31:00+00:00, run_after=2024-06-27T05:32:00+00:00 2024-06-27T05:31:00.405848531Z [2024-06-27T05:31:00.405+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:31:00+00:00, run_after=2024-06-27T05:32:00+00:00 2024-06-27T05:31:00.475289762Z [2024-06-27T05:31:00.474+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:31:00.475319781Z 2024-06-27T05:31:00.475323987Z 2024-06-27T05:31:00.475327731Z 2024-06-27T05:31:00.475492409Z [2024-06-27T05:31:00.475+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:31:00.475781030Z [2024-06-27T05:31:00.475+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:31:00.476019656Z [2024-06-27T05:31:00.475+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:31:00.476962729Z [2024-06-27T05:31:00.476+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:31:00.476976496Z 2024-06-27T05:31:00.476979896Z 2024-06-27T05:31:00.476983074Z 2024-06-27T05:31:00.480302483Z [2024-06-27T05:31:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:31:00.480537737Z [2024-06-27T05:31:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:31:00.480927290Z [2024-06-27T05:31:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:31:00.481176727Z [2024-06-27T05:31:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:31:00.481477929Z [2024-06-27T05:31:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:31:00.481698933Z [2024-06-27T05:31:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:31:00.709167465Z [2024-06-27T05:31:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status queued for try_number 1 2024-06-27T05:31:00.709490720Z [2024-06-27T05:31:00.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status queued for try_number 1 2024-06-27T05:31:00.709684709Z [2024-06-27T05:31:00.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status queued for try_number 1 2024-06-27T05:31:00.718549972Z [2024-06-27T05:31:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2567250-905a-4868-a70d-50da6200e332 2024-06-27T05:31:00.718924906Z [2024-06-27T05:31:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a61a1ce-19b1-4e3c-8b6c-80621156e654 2024-06-27T05:31:00.719174484Z [2024-06-27T05:31:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 919cff94-7740-4712-9709-1e24671e69ec 2024-06-27T05:31:02.172464257Z [2024-06-27T05:31:02.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:31:02.173178719Z [2024-06-27T05:31:02.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:30:00+00:00, run_id=scheduled__2024-06-27T05:30:00+00:00, run_start_date=2024-06-27 05:31:00.420702+00:00, run_end_date=2024-06-27 05:31:02.172605+00:00, run_duration=1.751903, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:30:00+00:00, data_interval_end=2024-06-27 05:31:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:31:02.188388825Z [2024-06-27T05:31:02.187+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:31:00+00:00, run_after=2024-06-27T05:32:00+00:00 2024-06-27T05:31:03.403112734Z [2024-06-27T05:31:03.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status success for try_number 1 2024-06-27T05:31:03.408810859Z [2024-06-27T05:31:03.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:30:00+00:00, map_index=-1, run_start_date=2024-06-27 05:31:01.667973+00:00, run_end_date=2024-06-27 05:31:02.115489+00:00, run_duration=0.447516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=645, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:31:00.478076+00:00, queued_by_job_id=2, pid=13982 2024-06-27T05:31:04.469505745Z [2024-06-27T05:31:04.468+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:31:04.469916745Z [2024-06-27T05:31:04.469+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:30:00+00:00, run_id=scheduled__2024-06-27T05:30:00+00:00, run_start_date=2024-06-27 05:31:00.422366+00:00, run_end_date=2024-06-27 05:31:04.469386+00:00, run_duration=4.04702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:30:00+00:00, data_interval_end=2024-06-27 05:31:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:31:04.487695460Z [2024-06-27T05:31:04.486+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:31:00+00:00, run_after=2024-06-27T05:32:00+00:00 2024-06-27T05:31:04.495040378Z [2024-06-27T05:31:04.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:31:04.495142250Z [2024-06-27T05:31:04.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:30:00+00:00, run_id=scheduled__2024-06-27T05:30:00+00:00, run_start_date=2024-06-27 05:31:00.423495+00:00, run_end_date=2024-06-27 05:31:04.494888+00:00, run_duration=4.071393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:30:00+00:00, data_interval_end=2024-06-27 05:31:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:31:04.505778187Z [2024-06-27T05:31:04.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:31:00+00:00, run_after=2024-06-27T05:32:00+00:00 2024-06-27T05:31:04.548708170Z [2024-06-27T05:31:04.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status success for try_number 1 2024-06-27T05:31:04.548795496Z [2024-06-27T05:31:04.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status success for try_number 1 2024-06-27T05:31:04.566886003Z [2024-06-27T05:31:04.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:30:00+00:00, map_index=-1, run_start_date=2024-06-27 05:31:02.710448+00:00, run_end_date=2024-06-27 05:31:04.076516+00:00, run_duration=1.366068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=647, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:31:00.478076+00:00, queued_by_job_id=2, pid=14013 2024-06-27T05:31:04.567453400Z [2024-06-27T05:31:04.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:30:00+00:00, map_index=-1, run_start_date=2024-06-27 05:31:02.660691+00:00, run_end_date=2024-06-27 05:31:04.277852+00:00, run_duration=1.617161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=646, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:31:00.478076+00:00, queued_by_job_id=2, pid=14012 2024-06-27T05:32:00.151447940Z [2024-06-27T05:32:00.150+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:32:00.167362620Z [2024-06-27T05:32:00.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:32:00+00:00, run_after=2024-06-27T05:33:00+00:00 2024-06-27T05:32:00.174884836Z [2024-06-27T05:32:00.174+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:32:00.191536687Z [2024-06-27T05:32:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:32:00+00:00, run_after=2024-06-27T05:33:00+00:00 2024-06-27T05:32:00.270333931Z [2024-06-27T05:32:00.269+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:32:00.270360251Z 2024-06-27T05:32:00.270366975Z 2024-06-27T05:32:00.270370453Z 2024-06-27T05:32:00.270373664Z 2024-06-27T05:32:00.270385070Z [2024-06-27T05:32:00.270+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:32:00.270551827Z [2024-06-27T05:32:00.270+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:32:00.272335599Z [2024-06-27T05:32:00.270+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:32:00.272349834Z [2024-06-27T05:32:00.270+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:32:00.272399764Z [2024-06-27T05:32:00.271+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:32:00.272404933Z 2024-06-27T05:32:00.272408128Z 2024-06-27T05:32:00.272411231Z 2024-06-27T05:32:00.272414219Z 2024-06-27T05:32:00.277349900Z [2024-06-27T05:32:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:32:00.277542470Z [2024-06-27T05:32:00.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:32:00.277810901Z [2024-06-27T05:32:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:32:00.277907126Z [2024-06-27T05:32:00.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:32:00.278247823Z [2024-06-27T05:32:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:32:00.278406240Z [2024-06-27T05:32:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:32:00.278695045Z [2024-06-27T05:32:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:32:00.278997081Z [2024-06-27T05:32:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:32:00.597427502Z [2024-06-27T05:32:00.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status queued for try_number 1 2024-06-27T05:32:00.597578286Z [2024-06-27T05:32:00.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:31:00+00:00 exited with status queued for try_number 1 2024-06-27T05:32:00.597782678Z [2024-06-27T05:32:00.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:31:00+00:00 exited with status queued for try_number 1 2024-06-27T05:32:00.597981431Z [2024-06-27T05:32:00.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:31:00+00:00 exited with status queued for try_number 1 2024-06-27T05:32:00.606114361Z [2024-06-27T05:32:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34a3f77b-fce6-4796-9ce4-bfe6c433e376 2024-06-27T05:32:00.606339099Z [2024-06-27T05:32:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd37e9f8-63c1-43b3-bb27-e3b02ff79ca3 2024-06-27T05:32:00.606576189Z [2024-06-27T05:32:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9befdc7e-1765-4788-9fce-dd5d16405af7 2024-06-27T05:32:00.606876737Z [2024-06-27T05:32:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a3b0fef-c9db-403a-85fe-0a3590621c9d 2024-06-27T05:32:02.022431638Z [2024-06-27T05:32:02.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:32:02.022960650Z [2024-06-27T05:32:02.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:30:00+00:00, run_id=scheduled__2024-06-27T05:30:00+00:00, run_start_date=2024-06-27 05:32:00.202034+00:00, run_end_date=2024-06-27 05:32:02.022308+00:00, run_duration=1.820274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:30:00+00:00, data_interval_end=2024-06-27 05:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:32:02.031155345Z [2024-06-27T05:32:02.030+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:32:00+00:00, run_after=2024-06-27T05:34:00+00:00 2024-06-27T05:32:02.040132294Z [2024-06-27T05:32:02.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:32:02.040604657Z [2024-06-27T05:32:02.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:31:00+00:00, run_id=scheduled__2024-06-27T05:31:00+00:00, run_start_date=2024-06-27 05:32:00.203307+00:00, run_end_date=2024-06-27 05:32:02.040034+00:00, run_duration=1.836727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:31:00+00:00, data_interval_end=2024-06-27 05:32:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:32:02.051372296Z [2024-06-27T05:32:02.051+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:32:00+00:00, run_after=2024-06-27T05:33:00+00:00 2024-06-27T05:32:02.103474135Z [2024-06-27T05:32:02.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status success for try_number 1 2024-06-27T05:32:02.103710218Z [2024-06-27T05:32:02.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:31:00+00:00 exited with status success for try_number 1 2024-06-27T05:32:02.109675528Z [2024-06-27T05:32:02.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:30:00+00:00, map_index=-1, run_start_date=2024-06-27 05:32:01.406404+00:00, run_end_date=2024-06-27 05:32:01.874487+00:00, run_duration=0.468083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=649, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:32:00.273906+00:00, queued_by_job_id=2, pid=14060 2024-06-27T05:32:02.110019665Z [2024-06-27T05:32:02.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:31:00+00:00, map_index=-1, run_start_date=2024-06-27 05:32:01.345201+00:00, run_end_date=2024-06-27 05:32:01.918284+00:00, run_duration=0.573083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=648, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:32:00.273906+00:00, queued_by_job_id=2, pid=14059 2024-06-27T05:32:05.432400584Z [2024-06-27T05:32:05.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:32:05.432586095Z [2024-06-27T05:32:05.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:31:00+00:00, run_id=scheduled__2024-06-27T05:31:00+00:00, run_start_date=2024-06-27 05:32:00.204276+00:00, run_end_date=2024-06-27 05:32:05.432218+00:00, run_duration=5.227942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:31:00+00:00, data_interval_end=2024-06-27 05:32:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:32:05.443957664Z [2024-06-27T05:32:05.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:32:00+00:00, run_after=2024-06-27T05:33:00+00:00 2024-06-27T05:32:05.455057936Z [2024-06-27T05:32:05.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:32:05.455243183Z [2024-06-27T05:32:05.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:31:00+00:00, run_id=scheduled__2024-06-27T05:31:00+00:00, run_start_date=2024-06-27 05:32:00.205225+00:00, run_end_date=2024-06-27 05:32:05.454971+00:00, run_duration=5.249746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:31:00+00:00, data_interval_end=2024-06-27 05:32:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:32:05.468096503Z [2024-06-27T05:32:05.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:32:00+00:00, run_after=2024-06-27T05:33:00+00:00 2024-06-27T05:32:05.507294599Z [2024-06-27T05:32:05.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:31:00+00:00 exited with status success for try_number 1 2024-06-27T05:32:05.507331340Z [2024-06-27T05:32:05.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:31:00+00:00 exited with status success for try_number 1 2024-06-27T05:32:05.517091448Z [2024-06-27T05:32:05.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:31:00+00:00, map_index=-1, run_start_date=2024-06-27 05:32:02.836040+00:00, run_end_date=2024-06-27 05:32:04.300388+00:00, run_duration=1.464348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=651, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:32:00.273906+00:00, queued_by_job_id=2, pid=14100 2024-06-27T05:32:05.517421669Z [2024-06-27T05:32:05.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:31:00+00:00, map_index=-1, run_start_date=2024-06-27 05:32:02.615627+00:00, run_end_date=2024-06-27 05:32:04.330349+00:00, run_duration=1.714722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=650, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:32:00.273906+00:00, queued_by_job_id=2, pid=14099 2024-06-27T05:33:00.175636410Z [2024-06-27T05:33:00.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:33:00+00:00, run_after=2024-06-27T05:34:00+00:00 2024-06-27T05:33:00.197801351Z [2024-06-27T05:33:00.197+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:33:00+00:00, run_after=2024-06-27T05:34:00+00:00 2024-06-27T05:33:00.205202114Z [2024-06-27T05:33:00.204+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:33:00.291967618Z [2024-06-27T05:33:00.291+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:33:00.292013262Z 2024-06-27T05:33:00.292023786Z 2024-06-27T05:33:00.292033155Z 2024-06-27T05:33:00.292042011Z [2024-06-27T05:33:00.291+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:33:00.292078434Z [2024-06-27T05:33:00.291+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:33:00.292137916Z [2024-06-27T05:33:00.291+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:33:00.292880644Z [2024-06-27T05:33:00.292+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:33:00.292896599Z 2024-06-27T05:33:00.292901464Z 2024-06-27T05:33:00.292905399Z 2024-06-27T05:33:00.296827180Z [2024-06-27T05:33:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:33:00.297099276Z [2024-06-27T05:33:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:33:00.297547157Z [2024-06-27T05:33:00.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:33:00.297598754Z [2024-06-27T05:33:00.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:33:00.297930777Z [2024-06-27T05:33:00.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:33:00.298128337Z [2024-06-27T05:33:00.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:33:00.527512966Z [2024-06-27T05:33:00.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:32:00+00:00 exited with status queued for try_number 1 2024-06-27T05:33:00.527785558Z [2024-06-27T05:33:00.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:32:00+00:00 exited with status queued for try_number 1 2024-06-27T05:33:00.527959891Z [2024-06-27T05:33:00.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:32:00+00:00 exited with status queued for try_number 1 2024-06-27T05:33:00.543362817Z [2024-06-27T05:33:00.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to c73a91ea-4af8-40f5-88ff-a3e074674ef1 2024-06-27T05:33:00.543744633Z [2024-06-27T05:33:00.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd7af9ba-9bdf-4dfa-b9af-bce10fd85c88 2024-06-27T05:33:00.544081907Z [2024-06-27T05:33:00.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to efb5b577-7f4b-48d9-ae25-b35c2e92d9b9 2024-06-27T05:33:01.674160312Z [2024-06-27T05:33:01.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:33:01.674450790Z [2024-06-27T05:33:01.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:32:00+00:00, run_id=scheduled__2024-06-27T05:32:00+00:00, run_start_date=2024-06-27 05:33:00.214264+00:00, run_end_date=2024-06-27 05:33:01.674074+00:00, run_duration=1.45981, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:32:00+00:00, data_interval_end=2024-06-27 05:33:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:33:01.685786095Z [2024-06-27T05:33:01.685+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:33:00+00:00, run_after=2024-06-27T05:34:00+00:00 2024-06-27T05:33:01.771914645Z [2024-06-27T05:33:01.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:32:00+00:00 exited with status success for try_number 1 2024-06-27T05:33:01.781400250Z [2024-06-27T05:33:01.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:32:00+00:00, map_index=-1, run_start_date=2024-06-27 05:33:01.104216+00:00, run_end_date=2024-06-27 05:33:01.537571+00:00, run_duration=0.433355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=652, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:33:00.293714+00:00, queued_by_job_id=2, pid=14144 2024-06-27T05:33:04.267392037Z [2024-06-27T05:33:04.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:33:04.267783162Z [2024-06-27T05:33:04.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:32:00+00:00, run_id=scheduled__2024-06-27T05:32:00+00:00, run_start_date=2024-06-27 05:33:00.215479+00:00, run_end_date=2024-06-27 05:33:04.267120+00:00, run_duration=4.051641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:32:00+00:00, data_interval_end=2024-06-27 05:33:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:33:04.281662529Z [2024-06-27T05:33:04.281+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:33:00+00:00, run_after=2024-06-27T05:34:00+00:00 2024-06-27T05:33:04.290404770Z [2024-06-27T05:33:04.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:33:04.290491310Z [2024-06-27T05:33:04.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:32:00+00:00, run_id=scheduled__2024-06-27T05:32:00+00:00, run_start_date=2024-06-27 05:33:00.216487+00:00, run_end_date=2024-06-27 05:33:04.290259+00:00, run_duration=4.073772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:32:00+00:00, data_interval_end=2024-06-27 05:33:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:33:04.306640486Z [2024-06-27T05:33:04.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:33:00+00:00, run_after=2024-06-27T05:34:00+00:00 2024-06-27T05:33:04.365466473Z [2024-06-27T05:33:04.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:32:00+00:00 exited with status success for try_number 1 2024-06-27T05:33:04.365649953Z [2024-06-27T05:33:04.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:32:00+00:00 exited with status success for try_number 1 2024-06-27T05:33:04.372016998Z [2024-06-27T05:33:04.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:32:00+00:00, map_index=-1, run_start_date=2024-06-27 05:33:02.194328+00:00, run_end_date=2024-06-27 05:33:03.762708+00:00, run_duration=1.56838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=654, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:33:00.293714+00:00, queued_by_job_id=2, pid=14175 2024-06-27T05:33:04.372602765Z [2024-06-27T05:33:04.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:32:00+00:00, map_index=-1, run_start_date=2024-06-27 05:33:02.075889+00:00, run_end_date=2024-06-27 05:33:03.361552+00:00, run_duration=1.285663, state=success, executor_state=success, try_number=1, max_tries=1, job_id=653, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:33:00.293714+00:00, queued_by_job_id=2, pid=14174 2024-06-27T05:34:00.135685068Z [2024-06-27T05:34:00.135+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:34:00.155050486Z [2024-06-27T05:34:00.154+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:34:00+00:00, run_after=2024-06-27T05:35:00+00:00 2024-06-27T05:34:00.167849635Z [2024-06-27T05:34:00.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:34:00+00:00, run_after=2024-06-27T05:35:00+00:00 2024-06-27T05:34:00.176860490Z [2024-06-27T05:34:00.176+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:34:00.249433331Z [2024-06-27T05:34:00.249+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:34:00.249466172Z 2024-06-27T05:34:00.249470813Z 2024-06-27T05:34:00.249474347Z 2024-06-27T05:34:00.249497221Z 2024-06-27T05:34:00.249509275Z [2024-06-27T05:34:00.249+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:34:00.249678711Z [2024-06-27T05:34:00.249+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:34:00.249760606Z [2024-06-27T05:34:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:34:00.249934087Z [2024-06-27T05:34:00.249+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:34:00.250589698Z [2024-06-27T05:34:00.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:34:00.250595489Z 2024-06-27T05:34:00.250598839Z 2024-06-27T05:34:00.250609110Z 2024-06-27T05:34:00.250612751Z 2024-06-27T05:34:00.253808895Z [2024-06-27T05:34:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:34:00.253995100Z [2024-06-27T05:34:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:34:00.254267008Z [2024-06-27T05:34:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:34:00.254382265Z [2024-06-27T05:34:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:34:00.254658969Z [2024-06-27T05:34:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:34:00.254837172Z [2024-06-27T05:34:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:34:00.255057522Z [2024-06-27T05:34:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:34:00.255195861Z [2024-06-27T05:34:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:34:00.500098129Z [2024-06-27T05:34:00.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:32:00+00:00 exited with status queued for try_number 1 2024-06-27T05:34:00.500213132Z [2024-06-27T05:34:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:33:00+00:00 exited with status queued for try_number 1 2024-06-27T05:34:00.500401160Z [2024-06-27T05:34:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:33:00+00:00 exited with status queued for try_number 1 2024-06-27T05:34:00.500536290Z [2024-06-27T05:34:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:33:00+00:00 exited with status queued for try_number 1 2024-06-27T05:34:00.510634248Z [2024-06-27T05:34:00.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to d264357e-257b-41e0-a3df-16aa2097d0fa 2024-06-27T05:34:00.510859196Z [2024-06-27T05:34:00.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b7b4c15-bd79-4f36-be1d-84be816c468e 2024-06-27T05:34:00.511554105Z [2024-06-27T05:34:00.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff942c51-2293-40b3-be09-0f65cd343eb5 2024-06-27T05:34:00.511704668Z [2024-06-27T05:34:00.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb98e544-6d58-408b-9591-24c9bb3ec321 2024-06-27T05:34:01.813513354Z [2024-06-27T05:34:01.813+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:34:01.813696454Z [2024-06-27T05:34:01.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:33:00+00:00, run_id=scheduled__2024-06-27T05:33:00+00:00, run_start_date=2024-06-27 05:34:00.188415+00:00, run_end_date=2024-06-27 05:34:01.813378+00:00, run_duration=1.624963, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:33:00+00:00, data_interval_end=2024-06-27 05:34:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:34:01.834018412Z [2024-06-27T05:34:01.833+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:34:00+00:00, run_after=2024-06-27T05:35:00+00:00 2024-06-27T05:34:01.927183173Z [2024-06-27T05:34:01.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:33:00+00:00 exited with status success for try_number 1 2024-06-27T05:34:01.935582204Z [2024-06-27T05:34:01.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:33:00+00:00, map_index=-1, run_start_date=2024-06-27 05:34:01.104868+00:00, run_end_date=2024-06-27 05:34:01.533299+00:00, run_duration=0.428431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=655, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:34:00.251337+00:00, queued_by_job_id=2, pid=14220 2024-06-27T05:34:02.994011017Z [2024-06-27T05:34:02.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:34:02.996084480Z [2024-06-27T05:34:02.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:32:00+00:00, run_id=scheduled__2024-06-27T05:32:00+00:00, run_start_date=2024-06-27 05:34:00.187184+00:00, run_end_date=2024-06-27 05:34:02.993833+00:00, run_duration=2.806649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:32:00+00:00, data_interval_end=2024-06-27 05:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:34:03.009655304Z [2024-06-27T05:34:03.009+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:34:00+00:00, run_after=2024-06-27T05:36:00+00:00 2024-06-27T05:34:03.075994715Z [2024-06-27T05:34:03.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:32:00+00:00 exited with status success for try_number 1 2024-06-27T05:34:03.084635160Z [2024-06-27T05:34:03.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:32:00+00:00, map_index=-1, run_start_date=2024-06-27 05:34:01.360997+00:00, run_end_date=2024-06-27 05:34:01.841556+00:00, run_duration=0.480559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=656, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:34:00.251337+00:00, queued_by_job_id=2, pid=14221 2024-06-27T05:34:04.141270371Z [2024-06-27T05:34:04.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:34:04.141301998Z [2024-06-27T05:34:04.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:33:00+00:00, run_id=scheduled__2024-06-27T05:33:00+00:00, run_start_date=2024-06-27 05:34:00.189439+00:00, run_end_date=2024-06-27 05:34:04.139842+00:00, run_duration=3.950403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:33:00+00:00, data_interval_end=2024-06-27 05:34:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:34:04.162662631Z [2024-06-27T05:34:04.160+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:34:00+00:00, run_after=2024-06-27T05:35:00+00:00 2024-06-27T05:34:04.177428252Z [2024-06-27T05:34:04.177+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:34:04.177821213Z [2024-06-27T05:34:04.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:33:00+00:00, run_id=scheduled__2024-06-27T05:33:00+00:00, run_start_date=2024-06-27 05:34:00.190586+00:00, run_end_date=2024-06-27 05:34:04.177403+00:00, run_duration=3.986817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:33:00+00:00, data_interval_end=2024-06-27 05:34:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:34:04.201010312Z [2024-06-27T05:34:04.196+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:34:00+00:00, run_after=2024-06-27T05:35:00+00:00 2024-06-27T05:34:04.239617519Z [2024-06-27T05:34:04.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:33:00+00:00 exited with status success for try_number 1 2024-06-27T05:34:04.239890782Z [2024-06-27T05:34:04.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:33:00+00:00 exited with status success for try_number 1 2024-06-27T05:34:04.247786062Z [2024-06-27T05:34:04.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:33:00+00:00, map_index=-1, run_start_date=2024-06-27 05:34:02.407723+00:00, run_end_date=2024-06-27 05:34:04.000324+00:00, run_duration=1.592601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=658, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:34:00.251337+00:00, queued_by_job_id=2, pid=14261 2024-06-27T05:34:04.248229131Z [2024-06-27T05:34:04.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:33:00+00:00, map_index=-1, run_start_date=2024-06-27 05:34:02.336026+00:00, run_end_date=2024-06-27 05:34:03.681842+00:00, run_duration=1.345816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=657, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:34:00.251337+00:00, queued_by_job_id=2, pid=14260 2024-06-27T05:35:00.095872798Z [2024-06-27T05:35:00.095+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:35:00+00:00, run_after=2024-06-27T05:36:00+00:00 2024-06-27T05:35:00.108583428Z [2024-06-27T05:35:00.108+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:35:00.125319383Z [2024-06-27T05:35:00.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:35:00+00:00, run_after=2024-06-27T05:40:00+00:00 2024-06-27T05:35:00.145332957Z [2024-06-27T05:35:00.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:35:00+00:00, run_after=2024-06-27T05:36:00+00:00 2024-06-27T05:35:00.280718888Z [2024-06-27T05:35:00.280+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:35:00.280823513Z 2024-06-27T05:35:00.280838214Z 2024-06-27T05:35:00.280873503Z 2024-06-27T05:35:00.280891481Z 2024-06-27T05:35:00.280989814Z [2024-06-27T05:35:00.280+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:35:00.281228061Z [2024-06-27T05:35:00.280+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:35:00.281462303Z [2024-06-27T05:35:00.281+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:35:00.281635450Z [2024-06-27T05:35:00.281+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:35:00.282865927Z [2024-06-27T05:35:00.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:35:00.282877267Z 2024-06-27T05:35:00.282880657Z 2024-06-27T05:35:00.282883949Z 2024-06-27T05:35:00.282887133Z 2024-06-27T05:35:00.290121190Z [2024-06-27T05:35:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T05:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T05:35:00.290183127Z [2024-06-27T05:35:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T05:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:35:00.290505181Z [2024-06-27T05:35:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:35:00.290642470Z [2024-06-27T05:35:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:35:00.290966527Z [2024-06-27T05:35:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:35:00.291097608Z [2024-06-27T05:35:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:35:00.291398015Z [2024-06-27T05:35:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:35:00.291510928Z [2024-06-27T05:35:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:35:00.730291601Z [2024-06-27T05:35:00.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status queued for try_number 1 2024-06-27T05:35:00.732975040Z [2024-06-27T05:35:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:34:00+00:00 exited with status queued for try_number 1 2024-06-27T05:35:00.733200300Z [2024-06-27T05:35:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:34:00+00:00 exited with status queued for try_number 1 2024-06-27T05:35:00.733476336Z [2024-06-27T05:35:00.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:34:00+00:00 exited with status queued for try_number 1 2024-06-27T05:35:00.754946193Z [2024-06-27T05:35:00.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f6e8cd3-666d-4f17-af94-cbc8dcc7723c 2024-06-27T05:35:00.756039554Z [2024-06-27T05:35:00.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8a42289-6d65-4f6e-b7f3-966b81d6d390 2024-06-27T05:35:00.756065070Z [2024-06-27T05:35:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0126b3c4-c046-43d9-959c-60f117ced060 2024-06-27T05:35:00.756504212Z [2024-06-27T05:35:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e63823c-d900-4af6-8a3b-08e1a21e655c 2024-06-27T05:35:02.109593094Z [2024-06-27T05:35:02.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:35:02.113273179Z [2024-06-27T05:35:02.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:34:00+00:00, run_id=scheduled__2024-06-27T05:34:00+00:00, run_start_date=2024-06-27 05:35:00.165364+00:00, run_end_date=2024-06-27 05:35:02.109518+00:00, run_duration=1.944154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:34:00+00:00, data_interval_end=2024-06-27 05:35:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:35:02.129537977Z [2024-06-27T05:35:02.129+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:35:00+00:00, run_after=2024-06-27T05:36:00+00:00 2024-06-27T05:35:02.223954946Z [2024-06-27T05:35:02.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:34:00+00:00 exited with status success for try_number 1 2024-06-27T05:35:02.233337208Z [2024-06-27T05:35:02.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:34:00+00:00, map_index=-1, run_start_date=2024-06-27 05:35:01.188690+00:00, run_end_date=2024-06-27 05:35:01.660122+00:00, run_duration=0.471432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=659, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:35:00.285296+00:00, queued_by_job_id=2, pid=14306 2024-06-27T05:35:03.359959869Z [2024-06-27T05:35:03.359+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:35:03.360003912Z 2024-06-27T05:35:03.360144001Z [2024-06-27T05:35:03.359+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:35:03.361973943Z [2024-06-27T05:35:03.360+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:35:03.362017993Z 2024-06-27T05:35:03.366540218Z [2024-06-27T05:35:03.366+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='split_metrics', run_id='scheduled__2024-06-27T05:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T05:35:03.366649623Z [2024-06-27T05:35:03.366+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'split_metrics', 'scheduled__2024-06-27T05:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:35:03.430414106Z [2024-06-27T05:35:03.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status queued for try_number 1 2024-06-27T05:35:03.430594436Z [2024-06-27T05:35:03.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status success for try_number 1 2024-06-27T05:35:03.436883924Z [2024-06-27T05:35:03.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3184fe3-4965-4425-8632-f106a76a53d4 2024-06-27T05:35:03.437024335Z [2024-06-27T05:35:03.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T05:30:00+00:00, map_index=-1, run_start_date=2024-06-27 05:35:02.482672+00:00, run_end_date=2024-06-27 05:35:03.104267+00:00, run_duration=0.621595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=661, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:35:00.285296+00:00, queued_by_job_id=2, pid=14347 2024-06-27T05:35:04.598903292Z [2024-06-27T05:35:04.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:35:04.599419704Z [2024-06-27T05:35:04.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:34:00+00:00, run_id=scheduled__2024-06-27T05:34:00+00:00, run_start_date=2024-06-27 05:35:00.168660+00:00, run_end_date=2024-06-27 05:35:04.598780+00:00, run_duration=4.43012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:34:00+00:00, data_interval_end=2024-06-27 05:35:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:35:04.619417245Z [2024-06-27T05:35:04.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:35:00+00:00, run_after=2024-06-27T05:36:00+00:00 2024-06-27T05:35:04.631872979Z [2024-06-27T05:35:04.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:35:04.632528303Z [2024-06-27T05:35:04.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:34:00+00:00, run_id=scheduled__2024-06-27T05:34:00+00:00, run_start_date=2024-06-27 05:35:00.173194+00:00, run_end_date=2024-06-27 05:35:04.631801+00:00, run_duration=4.458607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:34:00+00:00, data_interval_end=2024-06-27 05:35:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:35:04.649849416Z [2024-06-27T05:35:04.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:35:00+00:00, run_after=2024-06-27T05:36:00+00:00 2024-06-27T05:35:04.709248511Z [2024-06-27T05:35:04.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:34:00+00:00 exited with status success for try_number 1 2024-06-27T05:35:04.709602931Z [2024-06-27T05:35:04.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:34:00+00:00 exited with status success for try_number 1 2024-06-27T05:35:04.724004053Z [2024-06-27T05:35:04.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:34:00+00:00, map_index=-1, run_start_date=2024-06-27 05:35:02.415805+00:00, run_end_date=2024-06-27 05:35:03.939178+00:00, run_duration=1.523373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=660, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:35:00.285296+00:00, queued_by_job_id=2, pid=14346 2024-06-27T05:35:04.724326912Z [2024-06-27T05:35:04.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:34:00+00:00, map_index=-1, run_start_date=2024-06-27 05:35:02.615693+00:00, run_end_date=2024-06-27 05:35:04.320848+00:00, run_duration=1.705155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=662, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:35:00.285296+00:00, queued_by_job_id=2, pid=14348 2024-06-27T05:35:05.809877373Z [2024-06-27T05:35:05.809+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:35:05.809920820Z 2024-06-27T05:35:05.809927525Z [2024-06-27T05:35:05.809+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:35:05.810779478Z [2024-06-27T05:35:05.810+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:35:05.810811840Z 2024-06-27T05:35:05.813547423Z [2024-06-27T05:35:05.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='collect_metrics', run_id='scheduled__2024-06-27T05:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T05:35:05.813791372Z [2024-06-27T05:35:05.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'collect_metrics', 'scheduled__2024-06-27T05:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T05:35:05.869895941Z [2024-06-27T05:35:05.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status queued for try_number 1 2024-06-27T05:35:05.870291213Z [2024-06-27T05:35:05.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.split_metrics run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status success for try_number 1 2024-06-27T05:35:05.875839548Z [2024-06-27T05:35:05.875+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7083d13-ad4c-4528-b6f0-80159933018e 2024-06-27T05:35:05.876125268Z [2024-06-27T05:35:05.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=split_metrics, run_id=scheduled__2024-06-27T05:30:00+00:00, map_index=-1, run_start_date=2024-06-27 05:35:05.190799+00:00, run_end_date=2024-06-27 05:35:05.554554+00:00, run_duration=0.363755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=663, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:35:03.362663+00:00, queued_by_job_id=2, pid=14387 2024-06-27T05:35:07.520638152Z [2024-06-27T05:35:07.520+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T05:35:07.965802183Z [2024-06-27T05:35:07.965+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T05:35:07.965831103Z 2024-06-27T05:35:07.966026746Z [2024-06-27T05:35:07.965+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:35:07.966649263Z [2024-06-27T05:35:07.966+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:35:07.966693101Z 2024-06-27T05:35:07.968842968Z [2024-06-27T05:35:07.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='send_prometheus', run_id='scheduled__2024-06-27T05:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:35:07.969091629Z [2024-06-27T05:35:07.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'send_prometheus', 'scheduled__2024-06-27T05:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T05:35:08.026853218Z [2024-06-27T05:35:08.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status queued for try_number 1 2024-06-27T05:35:08.032155248Z [2024-06-27T05:35:08.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c2b89fe-aea6-4e38-afbb-e0c9c4923052 2024-06-27T05:35:08.179211053Z [2024-06-27T05:35:08.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.collect_metrics run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status success for try_number 1 2024-06-27T05:35:08.193167466Z [2024-06-27T05:35:08.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=collect_metrics, run_id=scheduled__2024-06-27T05:30:00+00:00, map_index=0, run_start_date=2024-06-27 05:35:07.493749+00:00, run_end_date=2024-06-27 05:35:07.853889+00:00, run_duration=0.36014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=664, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:35:05.811238+00:00, queued_by_job_id=2, pid=14399 2024-06-27T05:35:10.373294716Z [2024-06-27T05:35:10.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:35:10.373856620Z [2024-06-27T05:35:10.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:30:00+00:00, run_id=scheduled__2024-06-27T05:30:00+00:00, run_start_date=2024-06-27 05:35:00.160068+00:00, run_end_date=2024-06-27 05:35:10.373360+00:00, run_duration=10.213292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:30:00+00:00, data_interval_end=2024-06-27 05:35:00+00:00, dag_hash=8fb812d041eba49e4cb4a37027b9f3dc 2024-06-27T05:35:10.381194687Z [2024-06-27T05:35:10.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:35:00+00:00, run_after=2024-06-27T05:40:00+00:00 2024-06-27T05:35:10.413633742Z [2024-06-27T05:35:10.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.send_prometheus run_id=scheduled__2024-06-27T05:30:00+00:00 exited with status success for try_number 1 2024-06-27T05:35:10.419628146Z [2024-06-27T05:35:10.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=send_prometheus, run_id=scheduled__2024-06-27T05:30:00+00:00, map_index=-1, run_start_date=2024-06-27 05:35:09.709379+00:00, run_end_date=2024-06-27 05:35:10.049124+00:00, run_duration=0.339745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=665, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:35:07.967066+00:00, queued_by_job_id=2, pid=14411 2024-06-27T05:36:00.520453634Z [2024-06-27T05:36:00.519+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:36:00+00:00, run_after=2024-06-27T05:37:00+00:00 2024-06-27T05:36:00.530283722Z [2024-06-27T05:36:00.529+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:36:00.544024552Z [2024-06-27T05:36:00.543+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:36:00+00:00, run_after=2024-06-27T05:37:00+00:00 2024-06-27T05:36:00.551263878Z [2024-06-27T05:36:00.550+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:36:00.644541793Z [2024-06-27T05:36:00.643+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:36:00.644587154Z 2024-06-27T05:36:00.644597847Z 2024-06-27T05:36:00.644607255Z 2024-06-27T05:36:00.644615904Z 2024-06-27T05:36:00.645153301Z [2024-06-27T05:36:00.644+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:36:00.645704085Z [2024-06-27T05:36:00.645+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:36:00.646134167Z [2024-06-27T05:36:00.645+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:36:00.646572800Z [2024-06-27T05:36:00.646+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:36:00.648069056Z [2024-06-27T05:36:00.647+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:36:00.648113480Z 2024-06-27T05:36:00.648123754Z 2024-06-27T05:36:00.648132405Z 2024-06-27T05:36:00.648141032Z 2024-06-27T05:36:00.658189615Z [2024-06-27T05:36:00.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:36:00.658380147Z [2024-06-27T05:36:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:36:00.658926977Z [2024-06-27T05:36:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:36:00.659176097Z [2024-06-27T05:36:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:36:00.659697336Z [2024-06-27T05:36:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:36:00.659952100Z [2024-06-27T05:36:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:36:00.660393404Z [2024-06-27T05:36:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:36:00.660597123Z [2024-06-27T05:36:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:36:01.068076788Z [2024-06-27T05:36:01.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:34:00+00:00 exited with status queued for try_number 1 2024-06-27T05:36:01.068376747Z [2024-06-27T05:36:01.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:35:00+00:00 exited with status queued for try_number 1 2024-06-27T05:36:01.069280280Z [2024-06-27T05:36:01.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:35:00+00:00 exited with status queued for try_number 1 2024-06-27T05:36:01.069298568Z [2024-06-27T05:36:01.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:35:00+00:00 exited with status queued for try_number 1 2024-06-27T05:36:01.080942232Z [2024-06-27T05:36:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 353eb0ca-3f63-42fa-a840-361ac2a4298f 2024-06-27T05:36:01.080985007Z [2024-06-27T05:36:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5349a200-4297-447d-985b-9b5af08b4727 2024-06-27T05:36:01.080991081Z [2024-06-27T05:36:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3b63804-df59-420e-aa83-763e76044e22 2024-06-27T05:36:01.081012700Z [2024-06-27T05:36:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to c233690a-c3f3-4094-819c-778b9f8d991c 2024-06-27T05:36:02.898571783Z [2024-06-27T05:36:02.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:36:02.899152049Z [2024-06-27T05:36:02.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:34:00+00:00, run_id=scheduled__2024-06-27T05:34:00+00:00, run_start_date=2024-06-27 05:36:00.563679+00:00, run_end_date=2024-06-27 05:36:02.898581+00:00, run_duration=2.334902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:34:00+00:00, data_interval_end=2024-06-27 05:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:36:02.910472930Z [2024-06-27T05:36:02.908+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:36:00+00:00, run_after=2024-06-27T05:38:00+00:00 2024-06-27T05:36:02.917298875Z [2024-06-27T05:36:02.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:36:02.918129454Z [2024-06-27T05:36:02.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:35:00+00:00, run_id=scheduled__2024-06-27T05:35:00+00:00, run_start_date=2024-06-27 05:36:00.564849+00:00, run_end_date=2024-06-27 05:36:02.917807+00:00, run_duration=2.352958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:35:00+00:00, data_interval_end=2024-06-27 05:36:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:36:02.929206857Z [2024-06-27T05:36:02.928+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:36:00+00:00, run_after=2024-06-27T05:37:00+00:00 2024-06-27T05:36:02.986135595Z [2024-06-27T05:36:02.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:34:00+00:00 exited with status success for try_number 1 2024-06-27T05:36:02.986163308Z [2024-06-27T05:36:02.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:35:00+00:00 exited with status success for try_number 1 2024-06-27T05:36:02.996007574Z [2024-06-27T05:36:02.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:34:00+00:00, map_index=-1, run_start_date=2024-06-27 05:36:01.576702+00:00, run_end_date=2024-06-27 05:36:02.012198+00:00, run_duration=0.435496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=667, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:36:00.652616+00:00, queued_by_job_id=2, pid=14438 2024-06-27T05:36:02.996211744Z [2024-06-27T05:36:02.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:35:00+00:00, map_index=-1, run_start_date=2024-06-27 05:36:01.587275+00:00, run_end_date=2024-06-27 05:36:01.979540+00:00, run_duration=0.392265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=666, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:36:00.652616+00:00, queued_by_job_id=2, pid=14439 2024-06-27T05:36:05.140545032Z [2024-06-27T05:36:05.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:36:05.140867455Z [2024-06-27T05:36:05.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:35:00+00:00, run_id=scheduled__2024-06-27T05:35:00+00:00, run_start_date=2024-06-27 05:36:00.565816+00:00, run_end_date=2024-06-27 05:36:05.140369+00:00, run_duration=4.574553, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:35:00+00:00, data_interval_end=2024-06-27 05:36:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:36:05.153811380Z [2024-06-27T05:36:05.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:36:00+00:00, run_after=2024-06-27T05:37:00+00:00 2024-06-27T05:36:05.209297027Z [2024-06-27T05:36:05.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:35:00+00:00 exited with status success for try_number 1 2024-06-27T05:36:05.217853945Z [2024-06-27T05:36:05.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:35:00+00:00, map_index=-1, run_start_date=2024-06-27 05:36:02.772802+00:00, run_end_date=2024-06-27 05:36:04.314881+00:00, run_duration=1.542079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=668, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:36:00.652616+00:00, queued_by_job_id=2, pid=14478 2024-06-27T05:36:06.267130922Z [2024-06-27T05:36:06.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:36:06.267392861Z [2024-06-27T05:36:06.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:35:00+00:00, run_id=scheduled__2024-06-27T05:35:00+00:00, run_start_date=2024-06-27 05:36:00.566697+00:00, run_end_date=2024-06-27 05:36:06.267014+00:00, run_duration=5.700317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:35:00+00:00, data_interval_end=2024-06-27 05:36:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:36:06.278279085Z [2024-06-27T05:36:06.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:36:00+00:00, run_after=2024-06-27T05:37:00+00:00 2024-06-27T05:36:06.315943967Z [2024-06-27T05:36:06.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:35:00+00:00 exited with status success for try_number 1 2024-06-27T05:36:06.322602561Z [2024-06-27T05:36:06.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:35:00+00:00, map_index=-1, run_start_date=2024-06-27 05:36:02.793788+00:00, run_end_date=2024-06-27 05:36:06.078435+00:00, run_duration=3.284647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=669, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:36:00.652616+00:00, queued_by_job_id=2, pid=14479 2024-06-27T05:37:00.913571299Z [2024-06-27T05:37:00.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:37:00+00:00, run_after=2024-06-27T05:38:00+00:00 2024-06-27T05:37:00.927860262Z [2024-06-27T05:37:00.927+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:37:00+00:00, run_after=2024-06-27T05:38:00+00:00 2024-06-27T05:37:00.937084361Z [2024-06-27T05:37:00.936+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:37:01.039872168Z [2024-06-27T05:37:01.039+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T05:37:01.039895614Z 2024-06-27T05:37:01.039899527Z 2024-06-27T05:37:01.039903049Z 2024-06-27T05:37:01.040054575Z [2024-06-27T05:37:01.039+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:37:01.040201504Z [2024-06-27T05:37:01.040+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:37:01.040471379Z [2024-06-27T05:37:01.040+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:37:01.041203998Z [2024-06-27T05:37:01.040+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:37:01.041213955Z 2024-06-27T05:37:01.041217645Z 2024-06-27T05:37:01.041220814Z 2024-06-27T05:37:01.044835521Z [2024-06-27T05:37:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:37:01.045048699Z [2024-06-27T05:37:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:37:01.045315237Z [2024-06-27T05:37:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:37:01.045461514Z [2024-06-27T05:37:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:37:01.045701541Z [2024-06-27T05:37:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:37:01.045847212Z [2024-06-27T05:37:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:37:01.321752360Z [2024-06-27T05:37:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:36:00+00:00 exited with status queued for try_number 1 2024-06-27T05:37:01.322583595Z [2024-06-27T05:37:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:36:00+00:00 exited with status queued for try_number 1 2024-06-27T05:37:01.322826886Z [2024-06-27T05:37:01.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:36:00+00:00 exited with status queued for try_number 1 2024-06-27T05:37:01.335136099Z [2024-06-27T05:37:01.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bc8ce22-f325-4bd5-bd98-1433dc395717 2024-06-27T05:37:01.335410920Z [2024-06-27T05:37:01.335+0000] {scheduler_job.py:635} INFO - Setting external_id for to 232ec569-7a33-4f11-b263-206018d4f952 2024-06-27T05:37:01.335643254Z [2024-06-27T05:37:01.335+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2116627-f152-4c98-ba14-14f27fa02702 2024-06-27T05:37:02.463996467Z [2024-06-27T05:37:02.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:37:02.464455988Z [2024-06-27T05:37:02.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:36:00+00:00, run_id=scheduled__2024-06-27T05:36:00+00:00, run_start_date=2024-06-27 05:37:00.959532+00:00, run_end_date=2024-06-27 05:37:02.464059+00:00, run_duration=1.504527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:36:00+00:00, data_interval_end=2024-06-27 05:37:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:37:02.478875020Z [2024-06-27T05:37:02.478+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:37:00+00:00, run_after=2024-06-27T05:38:00+00:00 2024-06-27T05:37:02.535765504Z [2024-06-27T05:37:02.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:36:00+00:00 exited with status success for try_number 1 2024-06-27T05:37:02.542567120Z [2024-06-27T05:37:02.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:36:00+00:00, map_index=-1, run_start_date=2024-06-27 05:37:01.880530+00:00, run_end_date=2024-06-27 05:37:02.242047+00:00, run_duration=0.361517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=670, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:37:01.041953+00:00, queued_by_job_id=2, pid=14523 2024-06-27T05:37:05.078419648Z [2024-06-27T05:37:05.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:37:05.078555496Z [2024-06-27T05:37:05.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:36:00+00:00, run_id=scheduled__2024-06-27T05:36:00+00:00, run_start_date=2024-06-27 05:37:00.961041+00:00, run_end_date=2024-06-27 05:37:05.078214+00:00, run_duration=4.117173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:36:00+00:00, data_interval_end=2024-06-27 05:37:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:37:05.099349447Z [2024-06-27T05:37:05.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:37:00+00:00, run_after=2024-06-27T05:38:00+00:00 2024-06-27T05:37:05.151417954Z [2024-06-27T05:37:05.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:36:00+00:00 exited with status success for try_number 1 2024-06-27T05:37:05.159092504Z [2024-06-27T05:37:05.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:36:00+00:00, map_index=-1, run_start_date=2024-06-27 05:37:02.998479+00:00, run_end_date=2024-06-27 05:37:04.577111+00:00, run_duration=1.578632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=671, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:37:01.041953+00:00, queued_by_job_id=2, pid=14553 2024-06-27T05:37:06.228254212Z [2024-06-27T05:37:06.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:37:06.229201349Z [2024-06-27T05:37:06.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:36:00+00:00, run_id=scheduled__2024-06-27T05:36:00+00:00, run_start_date=2024-06-27 05:37:00.962188+00:00, run_end_date=2024-06-27 05:37:06.227961+00:00, run_duration=5.265773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:36:00+00:00, data_interval_end=2024-06-27 05:37:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:37:06.247434046Z [2024-06-27T05:37:06.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:37:00+00:00, run_after=2024-06-27T05:38:00+00:00 2024-06-27T05:37:06.311419940Z [2024-06-27T05:37:06.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:36:00+00:00 exited with status success for try_number 1 2024-06-27T05:37:06.318424702Z [2024-06-27T05:37:06.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:36:00+00:00, map_index=-1, run_start_date=2024-06-27 05:37:03.048286+00:00, run_end_date=2024-06-27 05:37:05.401143+00:00, run_duration=2.352857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=672, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:37:01.041953+00:00, queued_by_job_id=2, pid=14554 2024-06-27T05:38:00.296941990Z [2024-06-27T05:38:00.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:38:00+00:00, run_after=2024-06-27T05:39:00+00:00 2024-06-27T05:38:00.304838811Z [2024-06-27T05:38:00.304+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:38:00.311375621Z [2024-06-27T05:38:00.311+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T05:38:00.335715550Z [2024-06-27T05:38:00.335+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:38:00+00:00, run_after=2024-06-27T05:39:00+00:00 2024-06-27T05:38:00.419195161Z [2024-06-27T05:38:00.418+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T05:38:00.419236669Z 2024-06-27T05:38:00.419246547Z 2024-06-27T05:38:00.419254642Z 2024-06-27T05:38:00.419262381Z 2024-06-27T05:38:00.419645640Z [2024-06-27T05:38:00.419+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T05:38:00.420011983Z [2024-06-27T05:38:00.419+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:38:00.420391519Z [2024-06-27T05:38:00.420+0000] {scheduler_job.py:425} INFO - DAG vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 has 0/16 running and queued tasks 2024-06-27T05:38:00.420746010Z [2024-06-27T05:38:00.420+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 has 0/16 running and queued tasks 2024-06-27T05:38:00.422235773Z [2024-06-27T05:38:00.421+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T05:38:00.422247985Z 2024-06-27T05:38:00.422251848Z 2024-06-27T05:38:00.422255264Z 2024-06-27T05:38:00.422258425Z 2024-06-27T05:38:00.428293361Z [2024-06-27T05:38:00.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T05:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:38:00.428615574Z [2024-06-27T05:38:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T05:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T05:38:00.429187309Z [2024-06-27T05:38:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:38:00.429414291Z [2024-06-27T05:38:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T05:38:00.429816940Z [2024-06-27T05:38:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:38:00.430067984Z [2024-06-27T05:38:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T05:38:00.430507311Z [2024-06-27T05:38:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T05:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T05:38:00.430798780Z [2024-06-27T05:38:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T05:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T05:38:00.852825039Z [2024-06-27T05:38:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:36:00+00:00 exited with status queued for try_number 1 2024-06-27T05:38:00.857170135Z [2024-06-27T05:38:00.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:37:00+00:00 exited with status queued for try_number 1 2024-06-27T05:38:00.857414893Z [2024-06-27T05:38:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:37:00+00:00 exited with status queued for try_number 1 2024-06-27T05:38:00.857663855Z [2024-06-27T05:38:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:37:00+00:00 exited with status queued for try_number 1 2024-06-27T05:38:00.871633143Z [2024-06-27T05:38:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c987cec-870d-442e-8cb1-5740bfe8f1d6 2024-06-27T05:38:00.873351293Z [2024-06-27T05:38:00.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to 979f43cb-2e2d-4f68-952f-d8dab75eca80 2024-06-27T05:38:00.873780171Z [2024-06-27T05:38:00.873+0000] {scheduler_job.py:635} INFO - Setting external_id for to 883503af-560b-41a1-b3a0-dd76e90c1dba 2024-06-27T05:38:00.874098576Z [2024-06-27T05:38:00.873+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65b9eafe-6958-4b5b-b316-950243edc2e6 2024-06-27T05:38:02.066140399Z [2024-06-27T05:38:02.065+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:38:02.066557537Z [2024-06-27T05:38:02.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 05:36:00+00:00, run_id=scheduled__2024-06-27T05:36:00+00:00, run_start_date=2024-06-27 05:38:00.348797+00:00, run_end_date=2024-06-27 05:38:02.066236+00:00, run_duration=1.717439, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:36:00+00:00, data_interval_end=2024-06-27 05:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T05:38:02.073784802Z [2024-06-27T05:38:02.073+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T05:38:00+00:00, run_after=2024-06-27T05:40:00+00:00 2024-06-27T05:38:02.080392147Z [2024-06-27T05:38:02.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:38:02.081119347Z [2024-06-27T05:38:02.080+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, execution_date=2024-06-27 05:37:00+00:00, run_id=scheduled__2024-06-27T05:37:00+00:00, run_start_date=2024-06-27 05:38:00.350142+00:00, run_end_date=2024-06-27 05:38:02.080747+00:00, run_duration=1.730605, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:37:00+00:00, data_interval_end=2024-06-27 05:38:00+00:00, dag_hash=c209540eb16f65b8fa3217779a4624d8 2024-06-27T05:38:02.093237707Z [2024-06-27T05:38:02.092+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0 to 2024-06-27T05:38:00+00:00, run_after=2024-06-27T05:39:00+00:00 2024-06-27T05:38:02.138535356Z [2024-06-27T05:38:02.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T05:36:00+00:00 exited with status success for try_number 1 2024-06-27T05:38:02.138640914Z [2024-06-27T05:38:02.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:37:00+00:00 exited with status success for try_number 1 2024-06-27T05:38:02.145636396Z [2024-06-27T05:38:02.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_f366b8e5-ebb6-44d8-b640-1cdd7469cfa0, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:37:00+00:00, map_index=-1, run_start_date=2024-06-27 05:38:01.526692+00:00, run_end_date=2024-06-27 05:38:01.932457+00:00, run_duration=0.405765, state=success, executor_state=success, try_number=1, max_tries=1, job_id=674, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:38:00.424213+00:00, queued_by_job_id=2, pid=14609 2024-06-27T05:38:02.146013634Z [2024-06-27T05:38:02.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T05:36:00+00:00, map_index=-1, run_start_date=2024-06-27 05:38:01.169164+00:00, run_end_date=2024-06-27 05:38:01.560476+00:00, run_duration=0.391312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=673, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:38:00.424213+00:00, queued_by_job_id=2, pid=14589 2024-06-27T05:38:03.759137565Z [2024-06-27T05:38:03.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:38:03.759956190Z [2024-06-27T05:38:03.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:37:00+00:00, run_id=scheduled__2024-06-27T05:37:00+00:00, run_start_date=2024-06-27 05:38:00.351284+00:00, run_end_date=2024-06-27 05:38:03.759337+00:00, run_duration=3.408053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:37:00+00:00, data_interval_end=2024-06-27 05:38:00+00:00, dag_hash=837eb9d70b9301f734b1f413822c4bd5 2024-06-27T05:38:03.781785467Z [2024-06-27T05:38:03.781+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:38:00+00:00, run_after=2024-06-27T05:39:00+00:00 2024-06-27T05:38:04.895584732Z [2024-06-27T05:38:04.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T05:38:04.895864697Z [2024-06-27T05:38:04.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, execution_date=2024-06-27 05:37:00+00:00, run_id=scheduled__2024-06-27T05:37:00+00:00, run_start_date=2024-06-27 05:38:00.352655+00:00, run_end_date=2024-06-27 05:38:04.895364+00:00, run_duration=4.542709, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 05:37:00+00:00, data_interval_end=2024-06-27 05:38:00+00:00, dag_hash=b3e9a37c3adadb59e40e76967a353b16 2024-06-27T05:38:04.908366685Z [2024-06-27T05:38:04.907+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7 to 2024-06-27T05:38:00+00:00, run_after=2024-06-27T05:39:00+00:00 2024-06-27T05:38:04.949431224Z [2024-06-27T05:38:04.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:37:00+00:00 exited with status success for try_number 1 2024-06-27T05:38:04.949706376Z [2024-06-27T05:38:04.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T05:37:00+00:00 exited with status success for try_number 1 2024-06-27T05:38:04.959176138Z [2024-06-27T05:38:04.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:37:00+00:00, map_index=-1, run_start_date=2024-06-27 05:38:02.362913+00:00, run_end_date=2024-06-27 05:38:03.670114+00:00, run_duration=1.307201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=675, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:38:00.424213+00:00, queued_by_job_id=2, pid=14638 2024-06-27T05:38:04.959388853Z [2024-06-27T05:38:04.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eb3c6a16-94df-40d3-9677-2d80b3f6ffa7, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T05:37:00+00:00, map_index=-1, run_start_date=2024-06-27 05:38:02.453236+00:00, run_end_date=2024-06-27 05:38:04.367513+00:00, run_duration=1.914277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=676, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 05:38:00.424213+00:00, queued_by_job_id=2, pid=14639 2024-06-27T03:04:46.283881009Z 2024-06-27T03:04:46.305181052Z Cleaning logs every 900 seconds 2024-06-27T03:04:46.305301759Z Trimming airflow logs to 15 days. 2024-06-27T03:15:00.471027384Z Trimming airflow logs to 15 days. 2024-06-27T03:15:01.498296281Z Trimming airflow logs to 15 days. 2024-06-27T03:30:00.533009253Z Trimming airflow logs to 15 days. 2024-06-27T03:30:01.561137952Z Trimming airflow logs to 15 days. 2024-06-27T03:45:00.604218340Z Trimming airflow logs to 15 days. 2024-06-27T03:45:01.630661135Z Trimming airflow logs to 15 days. 2024-06-27T04:00:00.681463240Z Trimming airflow logs to 15 days. 2024-06-27T04:00:01.724301376Z Trimming airflow logs to 15 days. 2024-06-27T04:15:00.764331036Z Trimming airflow logs to 15 days. 2024-06-27T04:15:01.799651889Z Trimming airflow logs to 15 days. 2024-06-27T04:30:00.833574485Z Trimming airflow logs to 15 days. 2024-06-27T04:30:01.857158412Z Trimming airflow logs to 15 days. 2024-06-27T04:45:00.890210686Z Trimming airflow logs to 15 days. 2024-06-27T04:45:01.923966887Z Trimming airflow logs to 15 days. 2024-06-27T05:00:00.962190059Z Trimming airflow logs to 15 days. 2024-06-27T05:00:01.990522117Z Trimming airflow logs to 15 days. 2024-06-27T05:15:00.049645687Z Trimming airflow logs to 15 days. 2024-06-27T05:15:01.069512833Z Trimming airflow logs to 15 days. 2024-06-27T05:30:00.161075337Z Trimming airflow logs to 15 days. 2024-06-27T05:30:01.187202109Z Trimming airflow logs to 15 days.