2024-05-23T10:47:10.548368296Z ...... 2024-05-23T10:47:12.222460705Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-23T10:47:14.861642938Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-23T10:47:35.936666176Z 2024-05-23T10:47:37.975709732Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-23T10:47:40.618235133Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-23T10:47:52.930769219Z ____________ _____________ 2024-05-23T10:47:52.930791280Z ____ |__( )_________ __/__ /________ __ 2024-05-23T10:47:52.930794790Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-05-23T10:47:52.930797835Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-05-23T10:47:52.930800826Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-05-23T10:47:52.930819325Z [2024-05-23T10:47:52.929+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-05-23T10:47:52.950705181Z [2024-05-23T10:47:52.930+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-05-23T10:47:54.762364133Z [2024-05-23T10:47:54.760+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-05-23T10:47:54.814985096Z [2024-05-23T10:47:54.793+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-05-23T10:47:54.817149540Z [2024-05-23T10:47:54.816+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-05-23T10:47:54.896513118Z [2024-05-23T10:47:54.776+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 28 2024-05-23T10:47:54.896534553Z [2024-05-23T10:47:54.894+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T10:48:19.483973726Z [2024-05-23T10:48:19.483+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T10:48:19.762066041Z [2024-05-23T10:48:19.761+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T10:48:19.762077546Z 2024-05-23T10:48:19.768141366Z [2024-05-23T10:48:19.762+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T10:48:19.768149121Z [2024-05-23T10:48:19.763+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T10:48:19.768153028Z 2024-05-23T10:48:19.773488969Z [2024-05-23T10:48:19.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T10:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T10:48:19.773502101Z [2024-05-23T10:48:19.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T10:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T10:48:20.377693324Z [2024-05-23T10:48:20.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T10:46:00+00:00 exited with status queued for try_number 1 2024-05-23T10:48:20.392113677Z [2024-05-23T10:48:20.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to 047de818-83c1-4d67-a98b-df29c3004aa3 2024-05-23T10:48:22.953764833Z [2024-05-23T10:48:22.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T10:48:22.953794702Z [2024-05-23T10:48:22.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 10:46:00+00:00, run_id=scheduled__2024-05-23T10:46:00+00:00, run_start_date=2024-05-23 10:48:19.569493+00:00, run_end_date=2024-05-23 10:48:22.951330+00:00, run_duration=3.381837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 10:46:00+00:00, data_interval_end=2024-05-23 10:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T10:48:22.981628661Z [2024-05-23T10:48:22.980+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T10:48:00+00:00, run_after=2024-05-23T10:50:00+00:00 2024-05-23T10:48:23.025276126Z [2024-05-23T10:48:23.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T10:46:00+00:00 exited with status success for try_number 1 2024-05-23T10:48:23.040657106Z [2024-05-23T10:48:23.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T10:46:00+00:00, map_index=-1, run_start_date=2024-05-23 10:48:21.751580+00:00, run_end_date=2024-05-23 10:48:22.569480+00:00, run_duration=0.8179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 10:48:19.764635+00:00, queued_by_job_id=1, pid=50 2024-05-23T10:50:00.358454454Z [2024-05-23T10:50:00.357+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T10:50:00.427721910Z [2024-05-23T10:50:00.418+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T10:50:00.427741045Z 2024-05-23T10:50:00.427745814Z [2024-05-23T10:50:00.418+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T10:50:00.427749195Z [2024-05-23T10:50:00.419+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T10:50:00.427752764Z 2024-05-23T10:50:00.427757006Z [2024-05-23T10:50:00.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T10:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T10:50:00.427761046Z [2024-05-23T10:50:00.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T10:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T10:50:00.557579705Z [2024-05-23T10:50:00.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T10:48:00+00:00 exited with status queued for try_number 1 2024-05-23T10:50:00.576892306Z [2024-05-23T10:50:00.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6186fbff-bcd5-45b7-8cd2-7b6ed60565eb 2024-05-23T10:50:02.117471423Z [2024-05-23T10:50:02.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T10:50:02.117516983Z [2024-05-23T10:50:02.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 10:48:00+00:00, run_id=scheduled__2024-05-23T10:48:00+00:00, run_start_date=2024-05-23 10:50:00.383701+00:00, run_end_date=2024-05-23 10:50:02.115128+00:00, run_duration=1.731427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 10:48:00+00:00, data_interval_end=2024-05-23 10:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T10:50:02.134718651Z [2024-05-23T10:50:02.134+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T10:50:00+00:00, run_after=2024-05-23T10:52:00+00:00 2024-05-23T10:50:03.273818468Z [2024-05-23T10:50:03.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T10:48:00+00:00 exited with status success for try_number 1 2024-05-23T10:50:03.280692673Z [2024-05-23T10:50:03.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T10:48:00+00:00, map_index=-1, run_start_date=2024-05-23 10:50:01.416757+00:00, run_end_date=2024-05-23 10:50:02.045222+00:00, run_duration=0.628465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 10:50:00.419833+00:00, queued_by_job_id=1, pid=87 2024-05-23T10:52:00.090739308Z [2024-05-23T10:52:00.090+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T10:52:00.158717018Z [2024-05-23T10:52:00.158+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T10:52:00.158740839Z 2024-05-23T10:52:00.158751857Z [2024-05-23T10:52:00.158+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T10:52:00.159351917Z [2024-05-23T10:52:00.159+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T10:52:00.159364282Z 2024-05-23T10:52:00.162137507Z [2024-05-23T10:52:00.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T10:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T10:52:00.162828456Z [2024-05-23T10:52:00.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T10:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T10:52:00.261366936Z [2024-05-23T10:52:00.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T10:50:00+00:00 exited with status queued for try_number 1 2024-05-23T10:52:00.271371994Z [2024-05-23T10:52:00.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26853e4e-b475-4de8-9cc2-b70cf5c01828 2024-05-23T10:52:02.479974836Z [2024-05-23T10:52:02.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T10:52:02.481158694Z [2024-05-23T10:52:02.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 10:50:00+00:00, run_id=scheduled__2024-05-23T10:50:00+00:00, run_start_date=2024-05-23 10:52:00.109924+00:00, run_end_date=2024-05-23 10:52:02.480619+00:00, run_duration=2.370695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 10:50:00+00:00, data_interval_end=2024-05-23 10:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T10:52:02.493346970Z [2024-05-23T10:52:02.493+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T10:52:00+00:00, run_after=2024-05-23T10:54:00+00:00 2024-05-23T10:52:02.533817612Z [2024-05-23T10:52:02.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T10:50:00+00:00 exited with status success for try_number 1 2024-05-23T10:52:02.546479343Z [2024-05-23T10:52:02.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T10:50:00+00:00, map_index=-1, run_start_date=2024-05-23 10:52:01.095997+00:00, run_end_date=2024-05-23 10:52:01.546612+00:00, run_duration=0.450615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 10:52:00.159763+00:00, queued_by_job_id=1, pid=124 2024-05-23T10:52:57.442150597Z [2024-05-23T10:52:57.441+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T10:54:00.725961448Z [2024-05-23T10:54:00.725+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T10:54:00.795754099Z [2024-05-23T10:54:00.795+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T10:54:00.795763227Z 2024-05-23T10:54:00.796037519Z [2024-05-23T10:54:00.795+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T10:54:00.796600421Z [2024-05-23T10:54:00.796+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T10:54:00.796606328Z 2024-05-23T10:54:00.799483600Z [2024-05-23T10:54:00.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T10:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T10:54:00.800064432Z [2024-05-23T10:54:00.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T10:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T10:54:00.871339482Z [2024-05-23T10:54:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T10:52:00+00:00 exited with status queued for try_number 1 2024-05-23T10:54:00.878930483Z [2024-05-23T10:54:00.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcfcb707-7f1a-4bd3-aedd-17d37a6d93ee 2024-05-23T10:54:03.185148676Z [2024-05-23T10:54:03.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T10:54:03.185489425Z [2024-05-23T10:54:03.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 10:52:00+00:00, run_id=scheduled__2024-05-23T10:52:00+00:00, run_start_date=2024-05-23 10:54:00.762631+00:00, run_end_date=2024-05-23 10:54:03.185174+00:00, run_duration=2.422543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 10:52:00+00:00, data_interval_end=2024-05-23 10:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T10:54:03.195537045Z [2024-05-23T10:54:03.195+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T10:54:00+00:00, run_after=2024-05-23T10:56:00+00:00 2024-05-23T10:54:03.253513608Z [2024-05-23T10:54:03.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T10:52:00+00:00 exited with status success for try_number 1 2024-05-23T10:54:03.261079972Z [2024-05-23T10:54:03.260+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T10:52:00+00:00, map_index=-1, run_start_date=2024-05-23 10:54:01.852142+00:00, run_end_date=2024-05-23 10:54:02.315682+00:00, run_duration=0.46354, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 10:54:00.797283+00:00, queued_by_job_id=1, pid=161 2024-05-23T10:56:00.971663098Z [2024-05-23T10:56:00.969+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T10:56:01.061122743Z [2024-05-23T10:56:01.060+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T10:56:01.061135733Z 2024-05-23T10:56:01.061594964Z [2024-05-23T10:56:01.061+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T10:56:01.062744631Z [2024-05-23T10:56:01.062+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T10:56:01.062760237Z 2024-05-23T10:56:01.068294150Z [2024-05-23T10:56:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T10:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T10:56:01.068728647Z [2024-05-23T10:56:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T10:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T10:56:01.148594822Z [2024-05-23T10:56:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T10:54:00+00:00 exited with status queued for try_number 1 2024-05-23T10:56:01.160713695Z [2024-05-23T10:56:01.160+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a8b48b5-40f3-4dd7-b312-ce519d6e2232 2024-05-23T10:56:02.796164967Z [2024-05-23T10:56:02.795+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T10:56:02.796833974Z [2024-05-23T10:56:02.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 10:54:00+00:00, run_id=scheduled__2024-05-23T10:54:00+00:00, run_start_date=2024-05-23 10:56:01.000808+00:00, run_end_date=2024-05-23 10:56:02.796436+00:00, run_duration=1.795628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 10:54:00+00:00, data_interval_end=2024-05-23 10:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T10:56:02.808939530Z [2024-05-23T10:56:02.808+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T10:56:00+00:00, run_after=2024-05-23T10:58:00+00:00 2024-05-23T10:56:02.847434198Z [2024-05-23T10:56:02.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T10:54:00+00:00 exited with status success for try_number 1 2024-05-23T10:56:02.856621177Z [2024-05-23T10:56:02.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T10:54:00+00:00, map_index=-1, run_start_date=2024-05-23 10:56:02.169322+00:00, run_end_date=2024-05-23 10:56:02.614115+00:00, run_duration=0.444793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 10:56:01.063473+00:00, queued_by_job_id=1, pid=198 2024-05-23T10:47:42.543378560Z 2024-05-23T10:47:42.570965290Z Cleaning logs every 900 seconds 2024-05-23T10:47:42.570982057Z Trimming airflow logs to 15 days.